Repository navigation

perf: Optimize metadata records processing in `SqlStorageClient` - #1551

Merged

vdusek merged 24 commits into

apify:masterfrom

Mantisus:sql-metadata-buffer

Feb 10, 2026

Merged

perf: Optimize metadata records processing in `SqlStorageClient`#1551
vdusek merged 24 commits into
apify:masterfrom
Mantisus:sql-metadata-buffer

Commits on Nov 10, 2025
- add buffer tables
  Mantisus
  committed
  5d0802b
Commits on Nov 11, 2025
- some optimization
  Mantisus
  committed
  4b9386f
- index optimization
  Mantisus
  committed
  7848a21
- fix
  Mantisus
  committed
  3665a4c
- Merge branch 'master' into sql-metadata-buffer
  Mantisus
  committed
  4236b20
- recalculate only for is_empty
  Mantisus
  committed
  4e74b70
Commits on Nov 14, 2025
- add lenght for all String fields
  Mantisus
  committed
  251253c
- Merge branch 'master' into sql-metadata-buffer
  Mantisus
  committed
  d7171db
Commits on Nov 16, 2025
- consistent use `_update_metadata`
  Mantisus
  committed
  c8054b9
- up block time interval
  Mantisus
  committed
  83209ce
- fix
  Mantisus
  committed
  1ee46da
- up lengrh for data
  Mantisus
  committed
  d4cd262
Commits on Nov 17, 2025
- up docs
  Mantisus
  committed
  eae231d
Commits on Jan 26, 2026
- Merge branch 'master' into sql-metadata-buffer
  Mantisus
  committed
  c3fd6e8
- remove foreign key constraint for buffer tables
  Mantisus
  committed
  e0d07b4
- Update src/crawlee/storage_clients/_sql/_request_queue_client.py
  
  Mantisus
  and
  Copilot
  authored
  4ed54a9
- fixes
  Mantisus
  committed
  aea99e7
- merge
  Mantisus
  committed
  7bf9e1e
- Update src/crawlee/storage_clients/_sql/_db_models.py
  
  Mantisus
  and
  Copilot
  authored
  c48f179
- Update src/crawlee/storage_clients/_sql/_client_mixin.py
  
  Mantisus
  and
  Copilot
  authored
  24fe92d
- Update src/crawlee/storage_clients/_sql/_request_queue_client.py
  
  Mantisus
  and
  Copilot
  authored
  83225de
- update types
  Mantisus
  committed
  bedcd8d
- change level message
  Mantisus
  committed
  9d143a7
Commits on Feb 9, 2026
- Merge branch 'master' into sql-metadata-buffer
  Mantisus
  committed
  9c2f119

Commits

Commits on Nov 10, 2025

Commits on Nov 11, 2025

Commits on Nov 14, 2025

Commits on Nov 16, 2025

Commits on Nov 17, 2025

Commits on Jan 26, 2026

Commits on Feb 9, 2026