You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Commit 7e2b8cd
Browse filesBrowse the repository at this point in the historyBrowse files
Copy file name to clipboardExpand all lines: README.md
+9-4Lines changed: 9 additions & 4 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -30,13 +30,16 @@
30
30
31
31
## What is relay
32
32
33
-
relay is the LLM provider runtime that powers the [reflect](https://github.com/GrayCodeAI/reflect) coding agent. It handles everything between your application and LLM APIs — authentication, model resolution, streaming, retries, rate limiting, and caching.
33
+
Relay is an independent open-source LLM provider runtime from GrayCodeAI, built
34
+
for any application that needs model access. It handles authentication, model
35
+
resolution, streaming, retries, rate limiting, and caching.
34
36
35
37
When your app calls a model, relay figures out which provider to use, how to talk to it, and how to stream the response back. Switch from Anthropic to Ollama? relay handles the translation. API returns 529? relay retries with backoff. Response hits `max_tokens`? relay continues automatically.
36
38
37
39
**Your app never talks to an LLM API directly. relay does.**
38
40
39
-
Reflect is the product face: it owns UX, agent orchestration, tools, permissions,
41
+
The [Reflect](https://github.com/GrayCodeAI/reflect) coding agent is one consumer:
42
+
it owns UX, agent orchestration, tools, permissions,
40
43
sessions, and product semantics. Relay is the provider engine: it owns
41
44
credentials, catalog and route resolution, provider transports, normalized
42
45
streams, retry/fallback, usage, and provider telemetry. Reflect integrates through
@@ -45,7 +48,9 @@ provider packages.
45
48
46
49
## Ecosystem Boundaries
47
50
48
-
relay is a Reflect support engine. Keep the dependency edge one-way.
51
+
Relay and Reflect are independently usable, versioned, and released projects.
52
+
Relay has no dependency on Reflect. Any host application can integrate through
53
+
Relay's public API; agent behavior and product UX belong to that host.
49
54
50
55
Hosts may import exactly four packages:
51
56
@@ -361,7 +366,7 @@ tool-call count, and deployment-routing state remain queryable.
361
366
362
367
## Ecosystem
363
368
364
-
relay is part of the graycode-eco:
369
+
GrayCodeAI maintains these independent open-source projects:
0 commit comments