Skip to content

V2: Small-file bundling (.tar.gz batches) to cut round-trips/rate-limits #35

Description

@pmaxhogan

Why it matters

Cold folders with thousands of tiny files generate one upload round-trip each, which is slow and burns Google Drive API rate limits. Packing them into archives drastically cuts round-trips.

Next action

Add small-file bundling: pack cold folders of many tiny files into a single .tar.gz batch object. The restore, search, and backup engines must learn about bundles (index members, restore individual files out of a bundle, re-bundle on change).

Status

V2 / post-V1.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    area:driveGoogle Drive / remote storeenhancementNew feature or requeststatus:v2Deferred to post-V1 / V2

    Projects

    • Status
      Done

    Milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions