ci: cache compilation and cancel superseded validation #400

Merged
buildagent merged 4 commits from codex/ci-compiler-cache into master 2026-10-20 22:51:03 +02:00
Member

Linux validation downloaded Rust 1.98.0 over a 1.94.0 image, rebuilt without the runner's shared compiler cache, and left superseded core/package/pilot runs occupying the queue. This update pins the matching toolchain image, enables compiler reuse in four Linux core lanes, cancels obsolete validation by event and ref, and starts package fan-out after shared lint to give core checks runner capacity.

All 39 Rust-image references use ci-rust:1.98.0-v7 at registry digest sha256:8de376754f48f8cbe01c52e9a7163bb00be353226f55ff9016192114f7c145f4. It carries Rust 1.98.0, rustfmt and Clippy. The image was built from the existing ci-images recipe at ed2bd54f, with BASE_IMAGE=git.h-dv.de/h-dv/ci-min:1.94.0-v7 and RUST_VERSION=1.98.0. Only its new versioned tag was published. The tool baseline was re-probed; a manifest read after registry logout and repository formatting with networking disabled both passed.

Clippy, workspace tests, daemon tests and corpus opt into the runner-supplied Redis cache after disk pre-flight. Each job owns a Unix socket. Missing tools/backend or failed startup leaves ordinary compilation enabled; successful startup configures server-I/O fallback. Statistics omit the backend URL. Both package matrices wait for their shared lint job, allowing independent core checks and pilots to start first. Their conditions still produce scope reports after failed/skipped lint and stop cancelled runs. This Forgejo instance did not enforce max-parallel during live validation; scheduling uses an explicit dependency. All eleven packages remain in both matrices. Core/package/pilot cancellation groups include both event and ref, preserving scheduled measurements. Release/channel writers retain their shared, non-cancelling publishing group.

The first Windows run failed before initialize returned in concise_search_text_keeps_the_snippet_origin_disclosure: 4,760 of 4,761 ordinary tests passed, with no product error on inherited stderr. The harness now includes the child's OS exit status on stdout EOF. A real-child test verifies exit code 2 from a CLI refusal is retained. #401 tracks the original startup failure, whose cause remains unknown; the diagnostic is not a root-cause fix. The obsolete runs were cancelled with their logs retained, and the replacement head requires all normal CI gates.

Local validation of the replacement tree:

  • 980 MCP tests passed under profile ci; its nine timing cases remain assigned to the serial timing lane. All 15 affected-target tests passed in snapshot and daemon modes.
  • All 500 fast-gate tests passed across 62 targets, including workflow/release, executable-mode, disk and frozen-package contracts.
  • Formatter, targeted Clippy and Windows-GNU compilation passed.
  • Real Redis with separate containers/target directories: cold miss; warm hit with byte-identical output; changed-source miss; compiler rejection; distinct sockets; stopped-backend uncached compilation; missing-backend disablement.
  • All eight workflows parse; 39 digest pins match; cancellation groups are distinct and preserve publisher serialization. Both matrices retain eleven packages; cadence/path-gating checks also cover their shared-lint ordering.

The final-head live Clippy job passed with 345 compiler-cache hits (294 Rust, 50 C/C++, one assembler), zero misses and zero cache errors; compilation took 5m17s. The earlier cold run populated those 345 entries with zero cache errors. These are compiler-reuse measurements; full-run speed depends on runner load and remaining compilation. Native Windows completed successfully in 39m29s, including all 4,762 ordinary tests, 27 serial timing tests, doctests and plugin qualification. Both pilots passed in 4m25s. All eleven package lanes and eleven real-corpus lanes passed in 55m10s. Linux core has passed all 4,980 ordinary tests, 37 serial timing tests, doctests, candidate C#/Timeline qualification and the broad corpus lane. Daemon transport qualification also passed; the complete Linux workflow finished in 1h23m46s. Its cache recorded 203 hits / 189 misses with zero errors. Workspace caching recorded 131 hits / 460 misses; corpus recorded 19 hits / 130 misses; both reported zero cache errors. The package duration does not establish an end-to-end CI speedup; repeated compilation remains a bottleneck. Test commands, required rows, thresholds, retry/incremental policies and runtime/plugin-host build selections retain their existing behavior.

Fixes #399

Linux validation downloaded Rust 1.98.0 over a 1.94.0 image, rebuilt without the runner's shared compiler cache, and left superseded core/package/pilot runs occupying the queue. This update pins the matching toolchain image, enables compiler reuse in four Linux core lanes, cancels obsolete validation by event and ref, and starts package fan-out after shared lint to give core checks runner capacity. All 39 Rust-image references use ci-rust:1.98.0-v7 at registry digest `sha256:8de376754f48f8cbe01c52e9a7163bb00be353226f55ff9016192114f7c145f4`. It carries Rust 1.98.0, rustfmt and Clippy. The image was built from the existing [ci-images recipe at ed2bd54f](https://git.h-dv.de/h-dv/ci-images/src/commit/ed2bd54fad9aedbc39cf7c4292cfa2502893b2b8/docker/Dockerfile.ci-rust), with `BASE_IMAGE=git.h-dv.de/h-dv/ci-min:1.94.0-v7` and `RUST_VERSION=1.98.0`. Only its new versioned tag was published. The tool baseline was re-probed; a manifest read after registry logout and repository formatting with networking disabled both passed. Clippy, workspace tests, daemon tests and corpus opt into the runner-supplied Redis cache after disk pre-flight. Each job owns a Unix socket. Missing tools/backend or failed startup leaves ordinary compilation enabled; successful startup configures server-I/O fallback. Statistics omit the backend URL. Both package matrices wait for their shared lint job, allowing independent core checks and pilots to start first. Their conditions still produce scope reports after failed/skipped lint and stop cancelled runs. This Forgejo instance did not enforce max-parallel during live validation; scheduling uses an explicit dependency. All eleven packages remain in both matrices. Core/package/pilot cancellation groups include both event and ref, preserving scheduled measurements. Release/channel writers retain their shared, non-cancelling publishing group. The first Windows run failed before initialize returned in `concise_search_text_keeps_the_snippet_origin_disclosure`: 4,760 of 4,761 ordinary tests passed, with no product error on inherited stderr. The harness now includes the child's OS exit status on stdout EOF. A real-child test verifies exit code 2 from a CLI refusal is retained. [#401](https://git.h-dv.de/h-dv/code-index/issues/401) tracks the original startup failure, whose cause remains unknown; the diagnostic is not a root-cause fix. The obsolete runs were cancelled with their logs retained, and the replacement head requires all normal CI gates. Local validation of the replacement tree: - 980 MCP tests passed under profile `ci`; its nine timing cases remain assigned to the serial timing lane. All 15 affected-target tests passed in snapshot and daemon modes. - All 500 fast-gate tests passed across 62 targets, including workflow/release, executable-mode, disk and frozen-package contracts. - Formatter, targeted Clippy and Windows-GNU compilation passed. - Real Redis with separate containers/target directories: cold miss; warm hit with byte-identical output; changed-source miss; compiler rejection; distinct sockets; stopped-backend uncached compilation; missing-backend disablement. - All eight workflows parse; 39 digest pins match; cancellation groups are distinct and preserve publisher serialization. Both matrices retain eleven packages; cadence/path-gating checks also cover their shared-lint ordering. The final-head live Clippy job passed with 345 compiler-cache hits (294 Rust, 50 C/C++, one assembler), zero misses and zero cache errors; compilation took 5m17s. The earlier cold run populated those 345 entries with zero cache errors. These are compiler-reuse measurements; full-run speed depends on runner load and remaining compilation. Native Windows completed successfully in 39m29s, including all 4,762 ordinary tests, 27 serial timing tests, doctests and plugin qualification. Both pilots passed in 4m25s. All eleven package lanes and eleven real-corpus lanes passed in 55m10s. Linux core has passed all 4,980 ordinary tests, 37 serial timing tests, doctests, candidate C#/Timeline qualification and the broad corpus lane. Daemon transport qualification also passed; the complete Linux workflow finished in 1h23m46s. Its cache recorded 203 hits / 189 misses with zero errors. Workspace caching recorded 131 hits / 460 misses; corpus recorded 19 hits / 130 misses; both reported zero cache errors. The package duration does not establish an end-to-end CI speedup; repeated compilation remains a bottleneck. Test commands, required rows, thresholds, retry/incremental policies and runtime/plugin-host build selections retain their existing behavior. Fixes #399
ci: align Rust image and enable shared compiler cache
Some checks failed
Package CI / package-corpus (vue) (pull_request) Successful in 34s
Package CI / package-corpus (xaml) (pull_request) Successful in 35s
Pilot plugin compatibility / Fetch the pinned runtime once (pull_request) Successful in 1m16s
CI / cargo test (daemon transport) (pull_request) Has been cancelled
CI / Plugin path cost + pool throughput (nightly) (pull_request) Has been cancelled
CI / OSS corpus (tier 1) (pull_request) Has been cancelled
CI / cargo test (pull_request) Has been cancelled
CI (Windows) / fmt + clippy + build + test (windows) (pull_request) Has been cancelled
Package CI / package overhead budgets (nightly, one package at a time) (pull_request) Has been cancelled
Package CI / package (python) (pull_request) Has been cancelled
Pilot plugin compatibility / Pilot compatibility (timeline) (pull_request) Has been cancelled
Pilot plugin compatibility / Pilot compatibility result (pull_request) Has been cancelled
Package CI / package (csharp) (pull_request) Has been cancelled
Package CI / package-corpus (python) (pull_request) Has been cancelled
Package CI / package (php) (pull_request) Has been cancelled
Package CI / package (svelte) (pull_request) Has been cancelled
Package CI / package-corpus (rust) (pull_request) Has been cancelled
Package CI / package (vue) (pull_request) Has been cancelled
Package CI / package-corpus (php) (pull_request) Has been cancelled
Package CI / package (timeline) (pull_request) Has been cancelled
Package CI / package-corpus (typescript) (pull_request) Has been cancelled
Pilot plugin compatibility / Pilot compatibility (csharp) (pull_request) Has been cancelled
Package CI / package (javascript) (pull_request) Has been cancelled
Package CI / package (xaml) (pull_request) Has been cancelled
Package CI / package-corpus (csharp) (pull_request) Has been cancelled
Package CI / package (rust) (pull_request) Has been cancelled
Package CI / package-corpus (ruby) (pull_request) Has been cancelled
Package CI / package (typescript) (pull_request) Has been cancelled
Package CI / package (ruby) (pull_request) Has been cancelled
Package CI / package-corpus (javascript) (pull_request) Has been cancelled
0fff151195
ci: cancel stale validation and preserve MCP child exit status
Some checks failed
CI / cargo doc (intra-doc links) (pull_request) Has been cancelled
CI / cargo test (pull_request) Has been cancelled
CI / cargo test (daemon transport) (pull_request) Has been cancelled
CI / OSS corpus (tier 1) (pull_request) Has been cancelled
CI / Plugin path cost + pool throughput (nightly) (pull_request) Has been cancelled
CI / cargo clippy (pull_request) Has been cancelled
Package CI / package overhead budgets (nightly, one package at a time) (pull_request) Has been cancelled
Package CI / package (typescript) (pull_request) Has been cancelled
Package CI / package (php) (pull_request) Has been cancelled
Package CI / package-corpus (php) (pull_request) Has been cancelled
Package CI / package suites (clippy) (pull_request) Has been cancelled
Package CI / package-corpus (javascript) (pull_request) Has been cancelled
Package CI / package (timeline) (pull_request) Has been cancelled
Package CI / package-corpus (rust) (pull_request) Has been cancelled
Package CI / package-corpus (python) (pull_request) Has been cancelled
Pilot plugin compatibility / Pilot compatibility (csharp) (pull_request) Has been cancelled
Pilot plugin compatibility / Pilot compatibility (timeline) (pull_request) Has been cancelled
Pilot plugin compatibility / Pilot compatibility result (pull_request) Has been cancelled
Package CI / package (vue) (pull_request) Has been cancelled
Package CI / package (csharp) (pull_request) Has been cancelled
Package CI / package-corpus (csharp) (pull_request) Has been cancelled
Package CI / package-corpus (ruby) (pull_request) Has been cancelled
Package CI / package (rust) (pull_request) Has been cancelled
CI (Windows) / fmt + clippy + build + test (windows) (pull_request) Has been cancelled
Package CI / package (ruby) (pull_request) Has been cancelled
Package CI / package (svelte) (pull_request) Has been cancelled
Package CI / package (python) (pull_request) Has been cancelled
Package CI / package-corpus (typescript) (pull_request) Has been cancelled
Package CI / package (xaml) (pull_request) Has been cancelled
Package CI / package (javascript) (pull_request) Has been cancelled
2801e83b7e
buildagent changed title from ci: use pinned Rust image and shared compiler cache to ci: cache compilation and cancel superseded validation 2026-10-20 21:10:57 +02:00
ci: bound package fan-out to leave capacity for core checks
Some checks failed
CI / cargo test (pull_request) Has been cancelled
CI / cargo test (daemon transport) (pull_request) Has been cancelled
CI / OSS corpus (tier 1) (pull_request) Has been cancelled
CI / Plugin path cost + pool throughput (nightly) (pull_request) Has been cancelled
CI / cargo clippy (pull_request) Has been cancelled
Package CI / package overhead budgets (nightly, one package at a time) (pull_request) Has been cancelled
Package CI / package-corpus (rust) (pull_request) Has been cancelled
Package CI / package (ruby) (pull_request) Has been cancelled
Package CI / package (python) (pull_request) Has been cancelled
Package CI / package suites (clippy) (pull_request) Has been cancelled
Package CI / package (php) (pull_request) Has been cancelled
Package CI / package (svelte) (pull_request) Has been cancelled
Package CI / package-corpus (ruby) (pull_request) Has been cancelled
Package CI / package-corpus (typescript) (pull_request) Has been cancelled
Package CI / package (javascript) (pull_request) Has been cancelled
Pilot plugin compatibility / Fetch the pinned runtime once (pull_request) Has been cancelled
Pilot plugin compatibility / Pilot compatibility (csharp) (pull_request) Has been cancelled
Pilot plugin compatibility / Pilot compatibility (timeline) (pull_request) Has been cancelled
Pilot plugin compatibility / Pilot compatibility result (pull_request) Has been cancelled
Package CI / package (vue) (pull_request) Has been cancelled
Package CI / package (timeline) (pull_request) Has been cancelled
Package CI / package (xaml) (pull_request) Has been cancelled
Package CI / package (rust) (pull_request) Has been cancelled
CI (Windows) / fmt + clippy + build + test (windows) (pull_request) Has been cancelled
Package CI / package (typescript) (pull_request) Has been cancelled
Package CI / package-corpus (php) (pull_request) Has been cancelled
Package CI / package-corpus (python) (pull_request) Has been cancelled
Package CI / package-corpus (csharp) (pull_request) Has been cancelled
Package CI / package (csharp) (pull_request) Has been cancelled
Package CI / package-corpus (javascript) (pull_request) Has been cancelled
df986a8347
ci: order package fan-out after shared lint on Forgejo
All checks were successful
CI / cargo check (MSRV 1.98) (pull_request) Successful in 8m33s
Package CI / package-corpus (svelte) (pull_request) Successful in 35s
Package CI / package-corpus (timeline) (pull_request) Successful in 27s
CI / cargo check (windows-gnu) (pull_request) Successful in 12m11s
Package CI / package-corpus (vue) (pull_request) Successful in 32s
Package CI / package-corpus (xaml) (pull_request) Successful in 40s
Package CI / package (xaml) (pull_request) Successful in 30m0s
Package CI / package (svelte) (pull_request) Successful in 30m43s
Package CI / package (vue) (pull_request) Successful in 30m42s
Package CI / package (timeline) (pull_request) Successful in 30m47s
Package CI / package (rust) (pull_request) Successful in 31m19s
Package CI / package (php) (pull_request) Successful in 31m38s
Package CI / package (typescript) (pull_request) Successful in 31m54s
Package CI / package (javascript) (pull_request) Successful in 31m54s
Package CI / package (csharp) (pull_request) Successful in 32m18s
CI (Windows) / fmt + clippy + build + test (windows) (pull_request) Successful in 39m6s
Package CI / package (ruby) (pull_request) Successful in 32m42s
Package CI / package (python) (pull_request) Successful in 35m50s
Package CI / package-corpus (javascript) (pull_request) Successful in 43m48s
Package CI / package-corpus (csharp) (pull_request) Successful in 43m48s
Package CI / package-corpus (python) (pull_request) Successful in 44m9s
Package CI / package-corpus (php) (pull_request) Successful in 44m15s
Package CI / package-corpus (rust) (pull_request) Successful in 42m58s
Package CI / package-corpus (typescript) (pull_request) Successful in 41m43s
Package CI / package-corpus (ruby) (pull_request) Successful in 47m19s
Package CI / package overhead budgets (nightly, one package at a time) (pull_request) Has been skipped
CI / OSS corpus (tier 1) (pull_request) Successful in 1h11m48s
CI / cargo test (pull_request) Successful in 59m9s
CI / cargo test (daemon transport) (pull_request) Successful in 10m31s
CI / Plugin path cost + pool throughput (nightly) (pull_request) Has been skipped
3d28520818
Sign in to join this conversation.
No reviewers
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set

Reference
h-dv/code-index!400
No description provided.