docs: public benchmarks page#343
Merged
Merged
Conversation
Maintainer ruled against pursuing an eager cached-provider warm-up: the manual workaround is trivial and no user has requested startup fail-fast. Removing it from the backlog in favor of publishing the benchmarks page. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Full-lane spec for docs/introduction/performance.md — a public, reproducible performance page evidencing the fast + zero-dependency story with ratios-first comparative numbers, stated method, honest wins/losses, and a reproduce command. Closes deferred B3. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Ratios-first comparative numbers (C1-C4) with a stated method, honest wins/losses, the C4-not-sync-vs-sync caveat, and a reproduce command; nav, llms.txt, and a Comparison cross-link. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Final review flagged the Results header carried machine/version/pinned-versions but not the snapshot date the design bundle requires as the staleness anchor. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
![github-actions[bot]](https://avatars.githubusercontent.com/in/15368?s=60&v=4){kind=small}
There was a problem hiding this comment.
Benchmark
Details
| Benchmark suite | Current: 54975a2 | Previous: cc9b991 | Ratio |
|---|---|---|---|
benchmarks/test_guard_lifecycle.py::test_g6_build_child_container |
398024.7604345961 iter/sec (stddev: 0.000059695039862492264) |
441640.9565652056 iter/sec (stddev: 0.000043376925864421575) |
1.11 |
benchmarks/test_guard_lifecycle.py::test_g7_request_lifecycle |
71841.0426936301 iter/sec (stddev: 0.000013053926567482786) |
64236.53059294389 iter/sec (stddev: 0.000013290673454590171) |
0.89 |
benchmarks/test_guard_resolve.py::test_g1_transient_resolve |
1195534.747489547 iter/sec (stddev: 4.989245559798193e-7) |
1158582.3636398478 iter/sec (stddev: 5.650145473654341e-7) |
0.97 |
benchmarks/test_guard_resolve.py::test_g2_cached_resolve |
2187504.4309094567 iter/sec (stddev: 7.119141350608533e-8) |
2147439.4112107945 iter/sec (stddev: 6.630843795883263e-8) |
0.98 |
benchmarks/test_guard_resolve.py::test_g3_deep_chain |
510871.9478534513 iter/sec (stddev: 5.295103495926966e-7) |
504934.6221106413 iter/sec (stddev: 6.141829246724879e-7) |
0.99 |
benchmarks/test_guard_resolve.py::test_g4_wide_resolve |
313911.4663511615 iter/sec (stddev: 7.209973995838154e-7) |
310245.65233487333 iter/sec (stddev: 6.802778111016106e-7) |
0.99 |
benchmarks/test_guard_resolve.py::test_g5_cross_scope |
1081607.1359473628 iter/sec (stddev: 4.15754185315573e-7) |
1025317.3793776303 iter/sec (stddev: 4.541638418625638e-7) |
0.95 |
This comment was automatically generated by workflow using github-action-benchmark.
Rewrite the intro and results discussion to report the measurements without win/lose or best-in-class framing: state modern-di's properties and each rival's, describe faster/slower per scenario, and keep the method and C4 caveat as facts. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Publishes
docs/introduction/performance.md— the public, reproducible performance page, nav'd under Introduction after Comparison.Design & rationale (single home):
planning/changes/2026-07-17.06-benchmarks-page.md. Closes deferred B3.benchmarks/README.md.exec-codegen frameworks on construction-heavy graphs) stated as prominently as wins; the C4-not-sync-vs-sync caveat explicit.just bench-compare(5-run median-of-medians); reproduce command on the page.init_cacheitem removed.🤖 Generated with Claude Code