Skip to content

VAP15-97 docs: custom LLM URL must resolve to a public IP #1418

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
jeffrey-hoekman-vapi merged 2 commits into from
Nov 11, 2026
Merged

VAP15-97 docs: custom LLM URL must resolve to a public IP #1418

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
5242a82
VAP15-97 docs: custom LLM URL must resolve to a public IP
jeffrey-hoekman-vapi Nov 11, 2026
321b201
VAP15-97 docs: move URL rules into the step and match every blocked l…
jeffrey-hoekman-vapi Nov 11, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions fern/calls/call-ended-reason.mdx
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -127,6 +127,7 @@ Additional model errors:

- `pipeline-no-available-llm-model` / `call.in-progress.error-pipeline-no-available-llm-model` — No suitable LLM model was available. Check your model configuration.
- `call.in-progress.error-pipeline-ws-model-connection-failed` — Failed to connect to a custom LLM WebSocket endpoint.
- `pipeline-error-custom-llm-llm-failed` with a call log entry that starts with `Custom LLM URL blocked:` — The Custom LLM URL was refused before the request was sent, and the rest of the entry names the reason. For the URL requirements, see [Bring your own server](/customization/custom-llm/using-your-server). A configured fallback model is tried first.
Comment thread
jeffrey-hoekman-vapi marked this conversation as resolved.
Resolved

## Pipeline errors: voice (TTS)

Expand Down
2 changes: 2 additions & 0 deletions fern/customization/custom-llm/using-your-server.mdx
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -61,6 +61,8 @@ On the **Assistant** tab, select **MODEL**. In **Model Settings**, open **Model*
**3. Enter Ngrok URL:**
Enter `gpt-4.1-mini` in the second **Model** field. Paste the public base URL for your OpenAI-compatible endpoint into **Custom LLM URL** (for example, the URL generated by Ngrok for your server). The server handles requests at `/chat/completions`.

The URL must use `https://` and resolve to a public IP address, and so must every URL it redirects to. Localhost, private network, and link-local addresses are refused, as is a URL that includes credentials, a query string, or a fragment.

<Note>
Set the custom LLM URL on a stored assistant, as in this step. A web call or chat authenticated with a public API key or a public JWT that supplies `model.url` is rejected with a `403` response. For more information, including how to set the URL per request from your server, see [Model URLs on public-key requests](/assistants/concepts/transient-vs-permanent-configurations#model-urls-on-public-key-requests).
</Note>
Expand Down
Loading