Experiment with testing of `dd-trace-java` on GitLab on Windows OS by AlexeyKuznetsov-DD · Pull Request #12311 · DataDog/dd-trace-java

AlexeyKuznetsov-DD · 2026-08-26T19:53:27Z

DO NOT MERGE

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Format the title according to the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any other useful labels
Avoid using close, fix, or any linking keywords when referencing an issue
Use solves instead, and assign the PR milestone to the issue
Update the CODEOWNERS file on source file addition, migration, or deletion
Update public documentation with any new configuration flags or behaviors
Once approved, use merge queue to merge the PR

Jira ticket: [PROJ-IDENT]

This reverts commit 4d4bcda.

dd-octo-sts · 2026-08-28T19:07:31Z

🟢 Java Benchmark SLOs — All performance SLOs passed

Suite	Status
Startup	🟢 pass

SLO thresholds are defined here based on automatically generated metrics. A warning is raised when results are within 5% of the threshold.

PR vs. master results

Scenario	Candidate	master	Δ (95% CI of mean)
startup:insecure-bank:iast:Agent	13.97 s	13.91 s	[-0.4%; +1.3%] (no difference)
startup:insecure-bank:tracing:Agent	12.91 s	12.93 s	[-1.0%; +0.5%] (no difference)
startup:petclinic:appsec:Agent	16.99 s	16.76 s	[+0.5%; +2.2%] (maybe worse)
startup:petclinic:iast:Agent	16.94 s	17.06 s	[-1.4%; +0.0%] (no difference)
startup:petclinic:profiling:Agent	16.85 s	16.27 s	[-1.1%; +8.2%] (no difference)
startup:petclinic:sca:Agent	17.02 s	16.82 s	[+0.3%; +2.1%] (maybe worse)
startup:petclinic:tracing:Agent	16.20 s	16.26 s	[-1.3%; +0.5%] (no difference)

Commit: 740e23ae · CI Pipeline · Benchmarking Platform UI

Load and DaCapo benchmarks can be triggered manually in the GitLab pipeline. Results will appear in the Benchmarking Platform UI after completion.

…ndows-tests # Conflicts: # dd-java-agent/agent-ci-visibility/src/test/groovy/datadog/trace/civisibility/utils/ShellCommandExecutorTest.groovy # internal-api/src/test/groovy/datadog/trace/util/ProcessSupervisorTest.groovy # utils/test-utils/src/main/java/datadog/trace/test/util/PortableCommand.java # utils/test-utils/src/test/java/datadog/trace/test/util/PortableCommandTest.java

pr-commenter · 2026-09-10T03:18:43Z

Kafka / producer-benchmark

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	alexeyk/gitlab-windows-tests
git_commit_date	1789753479	1789761960
git_commit_sha	`7b903a5`	`740e23a`

See matching parameters

	Baseline	Candidate
ci_job_date	1789763374	1789763374
ci_job_id	2059592051	2059592051
ci_pipeline_id	138596577	138596577
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion	11.0.31	11.0.31
jmhVersion	1.36	1.36
jvm	/usr/lib/jvm/java-11-openjdk-amd64/bin/java	/usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs	-Dhttp.proxyHost=127.0.0.1 -Dhttp.proxyPort=15002 -Dhttps.proxyHost=127.0.0.1 -Dhttps.proxyPort=15002 -Dhttp.nonProxyHosts=localhost	*.localhost
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-ikgil2ud 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-ikgil2ud 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
vmName	OpenJDK 64-Bit Server VM	OpenJDK 64-Bit Server VM
vmVersion	11.0.31+11-post-1ubuntu1-22.04.2-Ubuntu	11.0.31+11-post-1ubuntu1-22.04.2-Ubuntu

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results

scenario	Δ mean throughput
scenario:not-instrumented/KafkaProduceBenchmark.benchProduce	same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaProduceBenchmark.benchProduce	same
scenario:only-tracing-dsm-enabled-benchmarks/KafkaProduceBenchmark.benchProduce	same

pr-commenter · 2026-09-10T03:31:31Z

Kafka / consumer-benchmark

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	alexeyk/gitlab-windows-tests
git_commit_date	1789147414	1789179373
git_commit_sha	`3110972`	`788e4df`

See matching parameters

	Baseline	Candidate
ci_job_date	1789180683	1789180683
ci_job_id	2038083107	2038083107
ci_pipeline_id	137051809	137051809
cpu_model	Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz
jdkVersion	11.0.31	11.0.31
jmhVersion	1.36	1.36
jvm	/usr/lib/jvm/java-11-openjdk-amd64/bin/java	/usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs	-Dhttp.proxyHost=127.0.0.1 -Dhttp.proxyPort=15002 -Dhttps.proxyHost=127.0.0.1 -Dhttps.proxyPort=15002 -Dhttp.nonProxyHosts=localhost	*.localhost
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-27eklw4j 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-27eklw4j 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
vmName	OpenJDK 64-Bit Server VM	OpenJDK 64-Bit Server VM
vmVersion	11.0.31+11-post-1ubuntu1-22.04.2-Ubuntu	11.0.31+11-post-1ubuntu1-22.04.2-Ubuntu

Summary

Found 0 performance improvements and 1 performance regressions! Performance is the same for 2 metrics, 0 unstable metrics.

scenario	Δ mean throughput
scenario:only-tracing-dsm-enabled-benchmarks/KafkaConsumerBenchmark.benchConsume	worse [-9331.502op/s; -1683.014op/s] or [-5.545%; -1.000%]

See unchanged results

scenario	Δ mean throughput
scenario:not-instrumented/KafkaConsumerBenchmark.benchConsume	same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaConsumerBenchmark.benchConsume	same

# Conflicts: # telemetry/src/test/groovy/datadog/telemetry/HostInfoTest.groovy

# Conflicts: # utils/test-utils/src/main/java/datadog/trace/test/util/PortableCommand.java # utils/test-utils/src/main/java/datadog/trace/test/util/PortableCommandRunner.java

AlexeyKuznetsov-DD added 5 commits August 26, 2026 13:44

Test dd-trace-java under Windows.

66e10fb

Fix PowerShell quoting in Windows CI image

aa0cea7

Fix Windows CI prototype image build

f17b9e8

Try Windows CI on Server 2022 runners

4d4bcda

Revert "Try Windows CI on Server 2022 runners"

8d92d62

This reverts commit 4d4bcda.

AlexeyKuznetsov-DD self-assigned this Aug 26, 2026

AlexeyKuznetsov-DD added the tag: do not merge Do not merge changes label Aug 26, 2026

AlexeyKuznetsov-DD added 2 commits August 28, 2026 09:59

Merge branch 'master' into alexeyk/gitlab-windows-tests

b396728

Fixing tests on Windows.

af66eb9

This comment has been minimized.

Sign in to view

AlexeyKuznetsov-DD added 11 commits August 28, 2026 15:35

Fixing tests on Windows.

f7bbf17

Fixing tests on Windows.

3091e98

Fixing tests on Windows.

7e7f9da

Fixing tests on Windows.

5bc53ee

Merge branch 'master' into alexeyk/gitlab-windows-tests

93ca447

Make child-process test commands portable

2562626

Merge branch 'master' into alexeyk/gitlab-windows-tests

477fcfc

Merge branch 'master' into alexeyk/gitlab-windows-tests

bc430a4

Update Spotless to 8.10.1

cb6fbe0

WIP on test-inst fixes for Windows.

fe20856

AlexeyKuznetsov-DD added 6 commits September 10, 2026 12:47

Test coverage fix.

eed926d

Merge branch 'master' into alexeyk/gitlab-windows-tests

1929a85

# Conflicts: # telemetry/src/test/groovy/datadog/telemetry/HostInfoTest.groovy

Added test_inst_latest for Windows. Merged with master.

bc3f65c

Fixes for Windows.

2343829

Test-smoke prototype for Windows on GitLab.

9bf1baa

Fixes for tests under Windows on GitLab.

788e4df

AlexeyKuznetsov-DD added 2 commits September 16, 2026 16:41

Merge branch 'master' into alexeyk/gitlab-windows-tests

011fd95

Merge branch 'master' into alexeyk/gitlab-windows-tests

740e23a

# Conflicts: # utils/test-utils/src/main/java/datadog/trace/test/util/PortableCommand.java # utils/test-utils/src/main/java/datadog/trace/test/util/PortableCommandRunner.java

Navigation Menu

Experiment with testing of `dd-trace-java` on GitLab on Windows OS - #12311

Experiment with testing of `dd-trace-java` on GitLab on Windows OS#12311
AlexeyKuznetsov-DD wants to merge 26 commits into
masterfrom
alexeyk/gitlab-windows-tests

AlexeyKuznetsov-DD commented Aug 26, 2026

Uh oh!

This comment has been minimized.

dd-octo-sts Bot commented Aug 28, 2026 •

edited

Loading

Uh oh!

pr-commenter Bot commented Sep 10, 2026 •

edited

Loading

Uh oh!

pr-commenter Bot commented Sep 10, 2026 •

edited

Loading

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

Conversation

AlexeyKuznetsov-DD commented Aug 26, 2026

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Uh oh!

This comment has been minimized.

dd-octo-sts Bot commented Aug 28, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

🟢 Java Benchmark SLOs — All performance SLOs passed

Uh oh!

pr-commenter Bot commented Sep 10, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Kafka / producer-benchmark

Parameters

Summary

Uh oh!

pr-commenter Bot commented Sep 10, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Kafka / consumer-benchmark

Parameters

Summary

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

dd-octo-sts Bot commented Aug 28, 2026 •

edited

Loading

pr-commenter Bot commented Sep 10, 2026 •

edited

Loading

pr-commenter Bot commented Sep 10, 2026 •

edited

Loading