Skip to content

[bug] chaos: million-files-nested invariant counts only top-level objects, fails against mirrored nested folders #318

Description

@pmaxhogan

Soak-gated scenario million-files-nested fails with 'every nested file uploaded exactly once, got of ' on ANY commit since folder mirroring (PR #150): live_object_count in crates/driven-chaos/src/scenarios/file_size.rs:178-186 does a non-recursive list_folder on the source root, so for a nested source it only ever counts the top-level subfolder objects (hence 'got 1000 of 1000000' - 1000 = dirs() - during the 2026-08-18 4h soak on d462592). Reproduced identically at small N on both post-wave main (d462592) and pre-wave v2.11.1 (accce5b): uploaded count == directory count in every case, so this is a harness assertion bug, not an engine regression. Flat-source siblings (tiny-files-100k-in-one-dir) are unaffected because their files really do live at the root.

Fix: make live_object_count walk folders recursively, or assert against file_state rows instead of a top-level remote listing. Until then, million-files-nested is red on every full soak.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't workingtestTesting work

    Projects

    • Status
      Todo

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions