Skip to content

Commit ad6edba

Browse files
committed
feat(WP-4.2): per-service query API and domain queries over HTTP
- AddSourceFlowQueryApi + MapSourceFlowQueryApi (/query, /validate, /explain, /schema) and MapDomainQueries (/queries, /queries/{name}/v{n}); startup fails closed without an authorization decision (SFQ0504, checked when the request pipeline is built). - Transport guard (64 KB, JSON only, depth 16), per-principal rate and concurrency limits plus a service limit (SFQ0502/0503 with Retry-After), permissions and tenant from claims, problem+json without input echo, security headers, NDJSON with a trailer, CSV with formula neutralisation, OpenAPI metadata. - IQueryService.ExplainAsync and IQueryExplainer; the PostgreSQL engine shows its parameterised SQL. - Bank.Api uses the library API (anonymous only by explicit opt-in). - Tests UT-ASP-21..36; STATUS progress summary.
1 parent 22ac63b commit ad6edba

9 files changed

Lines changed: 1353 additions & 333 deletions

File tree

‎docs/v3.0.0/implementation/STATUS.md‎

Lines changed: 32 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -2,6 +2,36 @@
22

33
Updated in the PR that completes a work package (CONTRIBUTING.md). Status values: `todo`, `in progress`, `done`.
44

5+
## Progress summary
6+
7+
Updated 2026-11-11. **28 of 63 work packages are done (44%)**, 2 in progress and 33 not started. By estimated effort, 56 of 138.5 engineer-weeks are done (40%).
8+
9+
| Milestone | Done | In progress | Todo | Effort done (ew) |
10+
|-----------|------|-------------|------|------------------|
11+
| M0 Foundations | 5 | 0 | 0 | 4 of 4 |
12+
| M1 Core | 14 | 0 | 1 | 36.5 of 37 |
13+
| M2 PostgreSQL | 8 | 2 | 1 | 13 of 19 |
14+
| M3 Cloud transports | 0 | 0 | 7 | 0 of 19 |
15+
| M4 Tooling and operations | 1 | 0 | 6 | 2.5 of 16.5 |
16+
| M5 Security and migration | 0 | 0 | 5 | 0 of 11 |
17+
| Track S: Workflow DSL and Studio | 0 | 0 | 13 | 0 of 32 |
18+
19+
Completed in this round:
20+
21+
- WP-1.2: analyzers SF0005 and SF0014, the SF0010 code fix, and text `CorrelateBy`.
22+
- WP-1.9: `CommandRejected<T>` replies (E2E-15) and the node registry with lease fair-share.
23+
- WP-1.12: the schema catalog (ADR-029). This covers JSON Schema per type, fingerprints, startup registration that fails on a changed published version, compatibility rules SFC01–SFC10, and AsyncAPI export.
24+
- WP-1.13: named domain queries (ADR-030), the typed builder, and analyzers SF0015, SF0016 and SF0018.
25+
- WP-1.14: the Bank.Api host, the Studio demo console, the docker-compose demo, and images on ghcr.io.
26+
- WP-4.2: the production query API and domain queries over HTTP.
27+
28+
Still in progress:
29+
30+
- WP-2.7 (`SourceFlow.Storage.EntityFrameworkCore` read models): rebuilding a projection into a new schema, which waits for the blue/green rebuild tooling.
31+
- WP-2.8 (SFQL on PostgreSQL): index sync (`db index sync`).
32+
33+
Not started: the v2 retirements (1.R, 2.R, 3.R), every cloud transport (M3), the CLI, health and dashboards, SQL Server, event partitioning, chaos and load testing, payload protection, crypto-shredding, the v2 migration tool, and the whole Studio track.
34+
535
| WP | Title | Estimate (ew) | Status | Notes |
636
|----|-------|---------------|--------|-------|
737
| WP-0.1 | Branch and versioning | 0.5 | done | |
@@ -31,7 +61,7 @@ Updated in the PR that completes a work package (CONTRIBUTING.md). Status values
3161
| WP-2.5 | Snapshots and aggregate cache | 1.5 | done | Background snapshot writer (bounded, drop-oldest, drained on shutdown), MemoryCache aggregate cache (ReadTail, Optimistic with rejection confirmation and no shortcut for If-Match), cache and snapshot metrics; UT-SNAP-01..10, SCK-51..53/55 on in-memory and PostgreSQL (with and without RLS), parallel deposits on PostgreSQL in both cache modes. PERF-04 moves to the WP-2.10 baseline |
3262
| WP-2.6 | Tenancy with row-level security | 1 | done | V002 tenant_isolation policies; TenantIsolation.RowLevelSecurity enables and forces RLS (migrator applies and verifies the state); session-scoped set_config; system (BYPASSRLS) data source for the global log; tenant-aware buckets. The whole SCK passes under RLS through a DML-only role; SCK-59/60/M07, Bank transfer E2E under RLS. Per-tenant metric tags (bounded top-N) move to WP-4.3 |
3363
| WP-2.7 | `SourceFlow.Storage.EntityFrameworkCore` read models | 2 | in progress | Core session-projection SPI (ISessionProjection, IProjectionUnitOfWork, IStorageSession.FlushAsync for ES-R1), generator support (GEN-41/42), IEfProjection, EfSessionContextFactory on the session connection and transaction, UseEntityFrameworkProjections, IdempotentUpsert; UT-EF-01..04, SCK-61..64 inline and async on PostgreSQL. Rebuild with schema-per-generation waits for the blue/green rebuild tooling (doc 06 §6) |
34-
| WP-2.8 | SFQL on PostgreSQL (incl. joins and grouping) + index sync + domain queries | 3.5 | in progress | PostgreSqlQueryEngine (`IQueryEngine`): one parameterised statement per page (every request value a typed `$n` parameter, I-3), keyset predicate and ORDER BY outside a derived table, `COLLATE "C"` text ordering, horizon predicate, per-version rename CASE, tenant predicates (G-9), `NULLIF` division, read-only transaction with `statement_timeout` (`QueryTimeout`, default 5 s) and the RLS tenant setting; aggregate and schema sources stay in the interpreter. Cross-provider equivalence with the interpreter on the same data (QRY-01..20, incl. joins, grouping/having, distinct, subqueries, keyset pages interchangeable between engines), golden SQL (QRY-42/43), injection corpus (QRY-44), no-literal CsCheck property (QRY-60). Catalog now types enums by their JSON (number or string). Next: index sync (`db index sync`) and `[DomainQuery]` |
64+
| WP-2.8 | SFQL on PostgreSQL (incl. joins and grouping) + index sync + domain queries | 3.5 | in progress | PostgreSqlQueryEngine (`IQueryEngine`): one parameterised statement per page (every request value a typed `$n` parameter, I-3), keyset predicate and ORDER BY outside a derived table, `COLLATE "C"` text ordering, horizon predicate, per-version rename CASE, tenant predicates (G-9), `NULLIF` division, read-only transaction with `statement_timeout` (`QueryTimeout`, default 5 s) and the RLS tenant setting; aggregate and schema sources stay in the interpreter. Cross-provider equivalence with the interpreter on the same data (QRY-01..20, incl. joins, grouping/having, distinct, subqueries, keyset pages interchangeable between engines), golden SQL (QRY-42/43), injection corpus (QRY-44), no-literal CsCheck property (QRY-60). Catalog now types enums by their JSON (number or string). Domain queries run through the engine (ExecuteAsync and `/queries`). `/query/explain` shows the parameterised SQL. Next: index sync (`db index sync`) |
3565
| WP-2.9 | Storage conformance kit complete | 2 | done | SCK-01..58 in SourceFlow.Testing, run on in-memory, PostgreSQL and PostgreSQL with RLS. New in this package: SCK-23 (in-flight writes invisible), SCK-37 (batched retention via IStoreRetention, plus the host retention loop), SCK-54 (CsCheck property: snapshot + tail = full fold), PostgreSQL SCK-28 (LISTEN loss and reconnect), and SCK-L01 CsCheck linearisability of appends and the outbox. SCK-36 is covered by SCK-34. SCK-20 (one round trip) moves to WP-2.10, and SCK-65..72 (partitioned events) to WP-4.5 |
3666
| WP-2.10 | Performance baseline | 1 | done | benchmarks/SourceFlow.Benchmarks (BenchmarkDotNet PERF-01..04, 06; measurement harness PERF-05, 08, 10); baselines in benchmarks/baselines and the report in implementation/perf-baseline.md. One-round-trip PostgreSQL commit (SCK-20), batch-aware document projections and adaptive subscription batches. Deviations logged with owners (PERF-01/02 allocations, PERF-10 borderline). PERF-07 waits for M3 and PERF-09 for WP-4.7 |
3767
| WP-2.R | Retire v2 EF stores | 0.5 | todo | |
@@ -43,7 +73,7 @@ Updated in the PR that completes a work package (CONTRIBUTING.md). Status values
4373
| WP-3.6 | Cross-service E2E per transport | 1.5 | todo | |
4474
| WP-3.R | Retire v2 cloud providers | 0.5 | todo | |
4575
| WP-4.1 | `SourceFlow.Tool` (`dotnet sourceflow`) | 3 | todo | |
46-
| WP-4.2 | `SourceFlow.AspNetCore` (incl. the per-service query API) | 2.5 | in progress | MapCommand (Idempotency-Key, If-Match, ETag, consistency token, ProblemDetails) done, UT-ASP-01..06; query endpoints wait for WP-1.13 |
76+
| WP-4.2 | `SourceFlow.AspNetCore` (incl. the per-service query API) | 2.5 | done | MapCommand (Idempotency-Key, If-Match, ETag, consistency token, ProblemDetails); `AddSourceFlowQueryApi` + `MapSourceFlowQueryApi` (`/query`, `/validate`, `/explain`, `/schema`) and `MapDomainQueries` (`/queries`, `/queries/{name}/v{n}`): fail-closed without an authorization decision (SFQ0504, checked when the pipeline is built), transport guard (64 KB, JSON only, depth 16 → 413/415/400), per-principal rate and concurrency limits and a service limit (SFQ0502/0503, Retry-After), permissions and tenant from claims, problem+json without input echo, security headers, NDJSON with trailer, CSV with formula neutralisation, OpenAPI metadata. UT-ASP-01..06, 21..36. The Bank demo now uses it (anonymous only by explicit opt-in). QRY-53..56 (API end to end on PostgreSQL) and the nightly DAST scan remain with WP-4.7 |
4777
| WP-4.3 | Health checks, dashboards and alerts | 2 | todo | |
4878
| WP-4.4 | `SourceFlow.Storage.SqlServer` + SFQL SQL Server compiler | 4 | todo | |
4979
| WP-4.5 | `PartitionEvents` + stream archiving | 1.5 | todo | |

0 commit comments

Comments
 (0)