Skip to content

Latest commit

 

History

History
88 lines (70 loc) · 4 KB

File metadata and controls

88 lines (70 loc) · 4 KB
description api-verity-lab compared with Schemathesis, from dated GitHub evidence: property-based API testing against contract governance, and where each fits.

api-verity-lab compared with Schemathesis

Generated from data/competitive-capabilities.json, which is gathered by scripts/fetch_competitor_meta.py. Repository facts below were fetched 2026-09-09.

Repository schemathesis/schemathesis
Licence MIT
Stars 3554
Latest release v4.25.0
Deployment CLI/library; Schemathesis.io is a separate hosted service
Audience QA/backend engineers property-testing HTTP APIs

What Schemathesis is good at

  • Best-in-class hypothesis-driven API fuzzing
  • Strong failure minimization

That list is from the evidence file, not from this project's opinion of Schemathesis. A comparison page that only enumerated the other tool's gaps would be an advertisement, and this project's whole credibility rests on claims a reader can check.

Where it stops

  • No governance/diff/broker/deploy-decision workflow; single-service focus

Protocols

Schemathesis: OpenAPI 3.x, GraphQL (historical; scope in v4 reduced - KNOWLEDGE-BASED)

api-verity-lab: OpenAPI 3.0/3.1/3.2, Swagger 2.0, AsyncAPI 2.x/3.x, GraphQL SDL, gRPC (proto and descriptor sets), MCP tool manifests, WSDL 1.1.

Capability by capability

Schemathesis api-verity-lab
asyncapi support no yes — apiverity breaking
breaking change rules partial (detects failures at runtime, not spec-level rules) yes — apiverity breaking
broker publication no no
can i deploy no yes — apiverity serve (/v1/can-i-deploy)
consumer contracts no yes — apiverity breaking --consumers
drift detection no yes — apiverity drift
frontend ui no (hosted reports on Schemathesis.io) yes — apiverity serve (web/)
graphql breaking unknown (v4 scope) yes — apiverity breaking
grpc compat no yes — apiverity breaking
linting no yes — apiverity validate
load testing no yes — apiverity regression --shape
mock server no yes — apiverity mock
openapi diff no yes — apiverity diff
otel export no yes — apiverity test --otlp-endpoint
performance budgets no yes — apiverity regression
plugin api yes (hooks/extensions) yes — apiverity plugins
rbac audit no yes — apiverity audit
response validation yes yes — apiverity test
sarif export yes (SARIF reporter) yes — apiverity report --format sarif
schema driven fuzzing yes yes — apiverity test
self hosted server no yes — apiverity serve
semver verdicts no yes — apiverity breaking --check-semver
service virtualization no yes — apiverity mock --workspace
stateful workflows yes (OpenAPI links) yes — apiverity workflow
traffic replay no yes — apiverity replay

The Schemathesis column is yes / partial / no / unknown from the evidence file, with no recorded only where the absence is verifiable or the area is clearly outside that product's documented scope; the legend and the evidence notes are in the data file. The api-verity-lab column names the command that provides each one, because that column is not in the evidence file -- it was gathered to describe other tools -- and an unsourced yes in every row is the thing this project exists to not do. A test asserts every command named there exists.

Using both

Nothing here argues for replacing Schemathesis. A tool that owns its lane is worth using in it; this project's claim is a different one -- one contract model and one result format across every protocol you speak, including the ones your agents speak.

The full comparison covers every tool at once, and the benchmark is reproducible, including where this project loses.