Skip to content

Test sarahchen6/improve-startup-stability branch of apm-sdks-benchmarks#11522

Draft
sarahchen6 wants to merge 4 commits into
masterfrom
sarahchen6/test-startup-benchmarks
Draft

Test sarahchen6/improve-startup-stability branch of apm-sdks-benchmarks#11522
sarahchen6 wants to merge 4 commits into
masterfrom
sarahchen6/test-startup-benchmarks

Conversation

@sarahchen6
Copy link
Copy Markdown
Contributor

What Does This Do

Test changes made in https://github.com/DataDog/apm-sdks-benchmarks/pull/162

Motivation

Additional Notes

Contributor Checklist

  • Format the title according to the contribution guidelines
  • Assign the type: and (comp: or inst:) labels in addition to any other useful labels
  • Avoid using close, fix, or any linking keywords when referencing an issue
    Use solves instead, and assign the PR milestone to the issue
  • Update the CODEOWNERS file on source file addition, migration, or deletion
  • Update public documentation with any new configuration flags or behaviors
  • Add your completed PR to the merge queue by commenting /merge. You can also:
    • Customize the commit message associated with the merge with /merge --commit-message "..."
    • Remove your PR from the merge queue with /merge -c
    • Skip all merge queue checks with /merge -f --reason "reason"; please use this judiciously, as some checks do not run at the PR-level
    • Get more information in this doc

Jira ticket: [PROJ-IDENT]

@sarahchen6 sarahchen6 added the tag: do not merge Do not merge changes label Jun 1, 2026
@datadog-datadog-prod-us1-2
Copy link
Copy Markdown
Contributor

datadog-datadog-prod-us1-2 Bot commented Jun 1, 2026

Pipelines

Fix all issues with BitsAI

⚠️ Warnings

🚦 64 Pipeline jobs failed

DataDog/apm-reliability/dd-trace-java | Amazon_Linux_2023_amd64.SI94: [test-app-java]   View in Datadog   GitLab

🔧 Fix in code (Fix with Cursor). Error: Process exited with status 8: running 'sh test-app-java_run.sh' during Java app execution.

DataDog/apm-reliability/dd-trace-java | Amazon_Linux_2_arm64.SIM: [test-app-java-container]   View in Datadog   GitLab

🔧 Fix in code (Fix with Cursor). Docker build failed after 3 attempts due to missing class files: '/jetty-classpath', '/CrashServlet.class', and '/JettyServletMain.class'.

DataDog/apm-reliability/dd-trace-java | RedHat_8_6_arm64.SI94: [test-app-java-alpine]   View in Datadog   GitLab

🔧 Fix in code (Fix with Cursor). Docker build failed: failed to calculate checksum of '/CrashServlet.class': not found.

View all 64 failed jobs.

Useful? React with 👍 / 👎

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: 777f665 | Docs | Datadog PR Page | Give us feedback!

@sarahchen6 sarahchen6 force-pushed the sarahchen6/test-startup-benchmarks branch 2 times, most recently from 777f665 to fd518c4 Compare June 2, 2026 19:21
@DataDog DataDog deleted a comment from dd-octo-sts Bot Jun 2, 2026
@DataDog DataDog deleted a comment from dd-octo-sts Bot Jun 2, 2026
@dd-octo-sts
Copy link
Copy Markdown
Contributor

dd-octo-sts Bot commented Jun 2, 2026

🟢 Java Benchmark SLOs — All performance SLOs passed

Suite Status
Startup 🟢 pass

SLO thresholds are defined here based on automatically generated metrics. A warning is raised when results are within 5% of the threshold.

PR vs. master results
Scenario Candidate master Δ (95% CI of mean)
startup:insecure-bank:iast:Agent 13.91 s 13.74 s [+nan%; +nan%] (no difference)
startup:insecure-bank:tracing:Agent 12.94 s 12.96 s [+nan%; +nan%] (no difference)
startup:petclinic:appsec:Agent 16.17 s 15.43 s [+nan%; +nan%] (no difference)
startup:petclinic:iast:Agent 16.70 s 16.20 s [+nan%; +nan%] (no difference)
startup:petclinic:profiling:Agent 16.21 s 16.32 s [+nan%; +nan%] (no difference)
startup:petclinic:tracing:Agent 15.99 s 15.91 s [+nan%; +nan%] (no difference)

Commit: fd518c44 · CI Pipeline · Benchmarking Platform UI


Load and DaCapo benchmarks can be triggered manually in the GitLab pipeline. Results will appear in the Benchmarking Platform UI after completion.

@sarahchen6 sarahchen6 force-pushed the sarahchen6/test-startup-benchmarks branch from fd518c4 to 777f665 Compare June 2, 2026 21:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

tag: do not merge Do not merge changes

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant