chore(api): update pinned OpenAPI spec (#1083)

Automated update of the pinned Braintrust OpenAPI specification.

- Upstream commit:
[`3384e4be354e`](braintrustdata/braintrust-openapi@3384e4b)
→
[`4cc061569451`](braintrustdata/braintrust-openapi@4cc0615)
- [Upstream spec
diff](braintrustdata/braintrust-openapi@3384e4b...4cc0615)
- Reviewed generated surface: 152 selected operations, 241 reachable
schemas → requires manual review (`OpenAPI spec contains unreviewed
OpenAPI tags: ['CustomColumns', 'Ingest keys']`)
- All upstream operations: 166 → 162
- All upstream component schemas: 261 → 256

### Operation changes

- Added: `createIngestKey`, `deleteCustomColumnId`, `deleteIngestKey`,
`getCustomColumn`, `listIngestKeys`, `patchCustomColumnId`,
`postCustomColumn`, `putCustomColumn`
- Removed: `deleteAgentId`, `deleteOrgAutomationId`, `getAgent`,
`getAgentId`, `getOrgAutomation`, `getOrgAutomationId`, `patchAgentId`,
`patchOrgAutomationId`, `postAgent`, `postOrgAutomation`, `putAgent`,
`putOrgAutomation`

### Component schema changes

- Added: `CreateCustomColumn`, `CustomColumn`, `CustomColumnVariant`,
`IngestKey`, `PatchCustomColumn`
- Removed: `Agent`, `AgentIdParam`, `AgentName`, `CreateAgent`,
`CreateOrgAutomation`, `OrgAutomation`, `OrgAutomationIdParam`,
`OrgAutomationName`, `PatchAgent`, `PatchOrgAutomation`

### Automated validation

The update workflow regenerates committed sources and public API
reference sections, then runs:

- `make -C py test-api-codegen`
- `make -C py test-core`
- `cd py && nox -s test_types`

This pull request is never auto-merged. Review the upstream and
generated diffs, retry-policy classifications, public type changes, and
any intentionally unsupported tags before merging.

### Manual fixes

The automated run failed regeneration because upstream added the
`CustomColumns` and `Ingest keys` tags (unreviewed) and removed the
`Agents` and `OrgAutomations` tags (still listed in
`endpoint_generator.generated_tags`). Follow-up commits:

- Removed `Agents` and `OrgAutomations` from `generated_tags` in
`openapi/config.json`.
- Added `CustomColumns` and `Ingest keys` to `unsupported_tags` (not yet
part of the reviewed public REST client surface), and documented them in
`openapi/README.md`. No client resources or types are generated for
them.
- Regenerated the client and `py/src/braintrust/api/README.md` (deletes
`_generated/agents.py`, `_generated/org_automations.py`, and their
models).
- Hand-written updates: removed the `agents` / `org_automations`
properties in `api/client.py` and the Agent / OrgAutomation re-exports
in `api/types/__init__.py`; updated `api/test_generated_models.py`,
`type_tests/test_api_client.py`, and the pinned unsupported-tag set in
`tests/api_codegen/test_generation.py`.

**Breaking:** `client.agents`, `client.org_automations`, and the types
`Agent`, `CreateAgent`, `PatchAgent`, `GetAgentResponse`,
`OrgAutomation`, `CreateOrgAutomation`, `PatchOrgAutomation`,
`GetOrgAutomationResponse` are no longer available, matching the
upstream removal.

### Workflow results

Original automated run:

| Check | Result |
| --- | --- |
| Regeneration | `failure` |
| Codegen tests | `failure` |
| Runtime tests | `success` |
| Type tests | `success` |

After manual fixes (run locally):

| Check | Result |
| --- | --- |
| `make -C py generate-api-client` | `success` (140 selected operations,
231 reachable schemas) |
| `make -C py check-api-client-codegen` | `success` |
| `make -C py test-api-codegen` | `success` (66 passed) |
| `make -C py test-core` | `success` (1131 passed) |
| `cd py && nox -s test_types` | `success` (37 passed) |
| `make -C py lint` | `success` |

---------

Co-authored-by: AbhiPrasad <18689448+AbhiPrasad@users.noreply.github.com>
Co-authored-by: Abhijeet Prasad <abhijeet@braintrustdata.com>

Author: github-actions[bot]

openapi/README.md

@@ -25,8 +25,7 @@ The reviewed generated surface includes these tags:
 - access and organization resources: Acls, Groups, ProjectGroups, Roles, Users, Organizations,
   ApiKeys, and ServiceTokens;
 - configuration resources: AiSecrets, EnvVars, Environments, and McpServers;
-- project resources: Agents, ProjectAutomations, OrgAutomations, ProjectScores, ProjectTags,
-  SpanIframes, and Views; and
+- project resources: ProjectAutomations, ProjectScores, ProjectTags, SpanIframes, and Views; and
 - versioned data resources: DatasetSnapshots.
 
 Each tag produces one resource and operation registry. Models used by one resource stay in that
@@ -37,8 +36,12 @@ Every tag in the pinned spec must be either selected or present in `unsupported_
 
 - **CrossObject:** cross-object event insertion belongs to the specialized at-least-once
   log-ingestion path.
+- **CustomColumns:** custom column management is not yet part of the reviewed public REST client
+  surface.
 - **Evals:** eval launch is a long-running, payload-dependent workflow that can stream and needs a
   specialized client.
+- **Ingest keys:** ingest key management is not yet part of the reviewed public REST client
+  surface.
 - **Logs:** project-log event ingestion, fetching, and feedback remain on the specialized logging
   path.
 - **Other:** the unauthenticated, text-only hello-world endpoint is a service diagnostic rather

openapi/config.json

@@ -3,8 +3,8 @@
   "spec": {
     "repository": "braintrustdata/braintrust-openapi",
     "path": "openapi/spec.json",
-    "commit": "3384e4be354ec957292f986fcf3e3a4009907651",
-    "sha256": "cbb5046620f73b5bf4e1e73c0eb12542ab9cbd3393ec568eda3f1a20f0f90a44"
+    "commit": "4cc0615694512d6e77fce6bff2c70d1531208daa",
+    "sha256": "ed5153cb78828024c12575df294a886624341065e9e9dd5095d52992087db1be"
   },
   "tools": {
     "datamodel-code-generator": "0.81.0",
@@ -36,15 +36,13 @@
       "Prompts",
       "Functions",
       "Acls",
-      "Agents",
       "AiSecrets",
       "ApiKeys",
       "DatasetSnapshots",
       "EnvVars",
       "Environments",
       "Groups",
       "McpServers",
-      "OrgAutomations",
       "Organizations",
       "ProjectAutomations",
       "ProjectGroups",
@@ -58,7 +56,9 @@
     ],
     "unsupported_tags": {
       "CrossObject": "Cross-object event insertion belongs to the specialized at-least-once log-ingestion path.",
+      "CustomColumns": "Custom column management is not yet part of the reviewed public REST client surface.",
       "Evals": "Eval launch is a long-running, payload-dependent workflow that can stream and requires a specialized client.",
+      "Ingest keys": "Ingest key management is not yet part of the reviewed public REST client surface.",
       "Logs": "Project-log event ingestion, fetching, and feedback remain on the specialized logging path.",
       "Other": "The unauthenticated text-only hello-world endpoint is a service diagnostic, not a public resource.",
       "Proxy": "Provider passthrough requires proxy routing and streaming support, and the catch-all operationId is not valid Python."

py/src/braintrust/api/README.md

@@ -88,15 +88,13 @@ The table lists every reviewed generated method. Consult the method's Python sig
 | `client.prompts` | `post_prompt` — `POST /v1/prompt`<br>`put_prompt` — `PUT /v1/prompt`<br>`get_prompt` — `GET /v1/prompt`<br>`get_prompt_id` — `GET /v1/prompt/{prompt_id}`<br>`patch_prompt_id` — `PATCH /v1/prompt/{prompt_id}`<br>`delete_prompt_id` — `DELETE /v1/prompt/{prompt_id}` |
 | `client.functions` | `post_function` — `POST /v1/function`<br>`put_function` — `PUT /v1/function`<br>`get_function` — `GET /v1/function`<br>`get_function_id` — `GET /v1/function/{function_id}`<br>`patch_function_id` — `PATCH /v1/function/{function_id}`<br>`delete_function_id` — `DELETE /v1/function/{function_id}` |
 | `client.acls` | `post_acl` — `POST /v1/acl`<br>`delete_acl` — `DELETE /v1/acl`<br>`get_acl` — `GET /v1/acl`<br>`get_acl_id` — `GET /v1/acl/{acl_id}`<br>`delete_acl_id` — `DELETE /v1/acl/{acl_id}`<br>`acl_batch_update` — `POST /v1/acl/batch_update`<br>`acl_list_org` — `GET /v1/acl/list_org` |
-| `client.agents` | `post_agent` — `POST /v1/agent`<br>`put_agent` — `PUT /v1/agent`<br>`get_agent` — `GET /v1/agent`<br>`get_agent_id` — `GET /v1/agent/{agent_id}`<br>`patch_agent_id` — `PATCH /v1/agent/{agent_id}`<br>`delete_agent_id` — `DELETE /v1/agent/{agent_id}` |
 | `client.ai_secrets` | `post_ai_secret` — `POST /v1/ai_secret`<br>`put_ai_secret` — `PUT /v1/ai_secret`<br>`delete_ai_secret` — `DELETE /v1/ai_secret`<br>`get_ai_secret` — `GET /v1/ai_secret`<br>`get_ai_secret_id` — `GET /v1/ai_secret/{ai_secret_id}`<br>`patch_ai_secret_id` — `PATCH /v1/ai_secret/{ai_secret_id}`<br>`delete_ai_secret_id` — `DELETE /v1/ai_secret/{ai_secret_id}` |
 | `client.api_keys` | `get_api_key` — `GET /v1/api_key`<br>`get_api_key_id` — `GET /v1/api_key/{api_key_id}`<br>`delete_api_key_id` — `DELETE /v1/api_key/{api_key_id}` |
 | `client.dataset_snapshots` | `post_dataset_snapshot` — `POST /v1/dataset_snapshot`<br>`put_dataset_snapshot` — `PUT /v1/dataset_snapshot`<br>`get_dataset_snapshot` — `GET /v1/dataset_snapshot`<br>`get_dataset_snapshot_id` — `GET /v1/dataset_snapshot/{dataset_snapshot_id}`<br>`patch_dataset_snapshot_id` — `PATCH /v1/dataset_snapshot/{dataset_snapshot_id}`<br>`delete_dataset_snapshot_id` — `DELETE /v1/dataset_snapshot/{dataset_snapshot_id}` |
 | `client.env_vars` | `post_env_var` — `POST /v1/env_var`<br>`put_env_var` — `PUT /v1/env_var`<br>`get_env_var` — `GET /v1/env_var`<br>`get_env_var_id` — `GET /v1/env_var/{env_var_id}`<br>`patch_env_var_id` — `PATCH /v1/env_var/{env_var_id}`<br>`delete_env_var_id` — `DELETE /v1/env_var/{env_var_id}` |
 | `client.environments` | `list_environments` — `GET /environment`<br>`create_environment` — `POST /environment`<br>`get_environment` — `GET /environment/{environment_id}`<br>`update_environment` — `PATCH /environment/{environment_id}`<br>`delete_environment` — `DELETE /environment/{environment_id}` |
 | `client.groups` | `post_group` — `POST /v1/group`<br>`put_group` — `PUT /v1/group`<br>`get_group` — `GET /v1/group`<br>`get_group_id` — `GET /v1/group/{group_id}`<br>`patch_group_id` — `PATCH /v1/group/{group_id}`<br>`delete_group_id` — `DELETE /v1/group/{group_id}` |
 | `client.mcp_servers` | `post_mcp_server` — `POST /v1/mcp_server`<br>`put_mcp_server` — `PUT /v1/mcp_server`<br>`get_mcp_server` — `GET /v1/mcp_server`<br>`get_mcp_server_id` — `GET /v1/mcp_server/{mcp_server_id}`<br>`patch_mcp_server_id` — `PATCH /v1/mcp_server/{mcp_server_id}`<br>`delete_mcp_server_id` — `DELETE /v1/mcp_server/{mcp_server_id}` |
-| `client.org_automations` | `post_org_automation` — `POST /v1/org_automation`<br>`put_org_automation` — `PUT /v1/org_automation`<br>`get_org_automation` — `GET /v1/org_automation`<br>`get_org_automation_id` — `GET /v1/org_automation/{org_automation_id}`<br>`patch_org_automation_id` — `PATCH /v1/org_automation/{org_automation_id}`<br>`delete_org_automation_id` — `DELETE /v1/org_automation/{org_automation_id}` |
 | `client.organizations` | `get_organization` — `GET /v1/organization`<br>`get_organization_id` — `GET /v1/organization/{organization_id}`<br>`patch_organization_id` — `PATCH /v1/organization/{organization_id}`<br>`patch_organization_members` — `PATCH /v1/organization/members`<br>`get_organization_api_keys` — `GET /v1/organization/api_keys` |
 | `client.project_automations` | `post_project_automation` — `POST /v1/project_automation`<br>`put_project_automation` — `PUT /v1/project_automation`<br>`get_project_automation` — `GET /v1/project_automation`<br>`get_project_automation_id` — `GET /v1/project_automation/{project_automation_id}`<br>`patch_project_automation_id` — `PATCH /v1/project_automation/{project_automation_id}`<br>`delete_project_automation_id` — `DELETE /v1/project_automation/{project_automation_id}` |
 | `client.project_groups` | `post_project_group` — `POST /v1/project_group`<br>`put_project_group` — `PUT /v1/project_group`<br>`get_project_group` — `GET /v1/project_group`<br>`get_project_group_id` — `GET /v1/project_group/{project_group_id}`<br>`patch_project_group_id` — `PATCH /v1/project_group/{project_group_id}`<br>`delete_project_group_id` — `DELETE /v1/project_group/{project_group_id}` |
@@ -132,10 +130,9 @@ Only request and response models reachable directly from reviewed resource metho
 | --- | --- | --- |
 | `AISecret` | `Acl` | `AclBatchUpdateRequest` |
 | `AclBatchUpdateResponse` | `AclItem` | `AclListOrgResponse` |
-| `Agent` | `ApiKey` | `CreateAISecret` |
-| `CreateAgent` | `CreateDataset` | `CreateDatasetSnapshot` |
-| `CreateEnvironment` | `CreateExperiment` | `CreateFunction` |
-| `CreateGroup` | `CreateMCPServer` | `CreateOrgAutomation` |
+| `ApiKey` | `CreateAISecret` | `CreateDataset` |
+| `CreateDatasetSnapshot` | `CreateEnvironment` | `CreateExperiment` |
+| `CreateFunction` | `CreateGroup` | `CreateMCPServer` |
 | `CreateProject` | `CreateProjectAutomation` | `CreateProjectGroup` |
 | `CreateProjectScore` | `CreateProjectTag` | `CreatePrompt` |
 | `CreateRole` | `CreateServiceTokenOutput` | `CreateSpanIFrame` |
@@ -145,29 +142,28 @@ Only request and response models reachable directly from reviewed resource metho
 | `EnvVar` | `Environment` | `Experiment` |
 | `FeedbackDatasetEventRequest` | `FeedbackExperimentEventRequest` | `FeedbackResponseSchema` |
 | `FetchDatasetEventsResponse` | `FetchEventsRequest` | `FetchExperimentEventsResponse` |
-| `Function` | `GetAclResponse` | `GetAgentResponse` |
-| `GetAiSecretResponse` | `GetApiKeyResponse` | `GetDatasetResponse` |
-| `GetDatasetSnapshotResponse` | `GetEnvVarResponse` | `GetExperimentResponse` |
-| `GetFunctionResponse` | `GetGroupResponse` | `GetMcpServerResponse` |
-| `GetOrgAutomationResponse` | `GetOrganizationApiKeysResponse` | `GetOrganizationResponse` |
-| `GetProjectAutomationResponse` | `GetProjectGroupResponse` | `GetProjectResponse` |
-| `GetProjectScoreResponse` | `GetProjectTagResponse` | `GetPromptResponse` |
-| `GetRoleResponse` | `GetServiceTokenResponse` | `GetSpanIframeResponse` |
-| `GetUserResponse` | `GetViewResponse` | `Group` |
-| `InsertDatasetEventRequest` | `InsertEventsResponse` | `InsertExperimentEventRequest` |
-| `ListEnvironmentsResponse` | `MCPServer` | `OrgAutomation` |
-| `Organization` | `PatchAISecret` | `PatchAgent` |
-| `PatchDataset` | `PatchDatasetSnapshot` | `PatchEnvironment` |
-| `PatchExperiment` | `PatchFunction` | `PatchGroup` |
-| `PatchMCPServer` | `PatchOrgAutomation` | `PatchOrganization` |
-| `PatchOrganizationMembers` | `PatchOrganizationMembersOutput` | `PatchProject` |
-| `PatchProjectAutomation` | `PatchProjectGroup` | `PatchProjectScore` |
-| `PatchProjectTag` | `PatchPrompt` | `PatchRole` |
-| `PatchSpanIFrame` | `PatchView` | `Project` |
-| `ProjectAutomation` | `ProjectGroup` | `ProjectScore` |
-| `ProjectTag` | `Prompt` | `Role` |
-| `ServiceToken` | `SpanIFrame` | `SummarizeDatasetResponse` |
-| `SummarizeExperimentResponse` | `User` | `View` |
+| `Function` | `GetAclResponse` | `GetAiSecretResponse` |
+| `GetApiKeyResponse` | `GetDatasetResponse` | `GetDatasetSnapshotResponse` |
+| `GetEnvVarResponse` | `GetExperimentResponse` | `GetFunctionResponse` |
+| `GetGroupResponse` | `GetMcpServerResponse` | `GetOrganizationApiKeysResponse` |
+| `GetOrganizationResponse` | `GetProjectAutomationResponse` | `GetProjectGroupResponse` |
+| `GetProjectResponse` | `GetProjectScoreResponse` | `GetProjectTagResponse` |
+| `GetPromptResponse` | `GetRoleResponse` | `GetServiceTokenResponse` |
+| `GetSpanIframeResponse` | `GetUserResponse` | `GetViewResponse` |
+| `Group` | `InsertDatasetEventRequest` | `InsertEventsResponse` |
+| `InsertExperimentEventRequest` | `ListEnvironmentsResponse` | `MCPServer` |
+| `Organization` | `PatchAISecret` | `PatchDataset` |
+| `PatchDatasetSnapshot` | `PatchEnvironment` | `PatchExperiment` |
+| `PatchFunction` | `PatchGroup` | `PatchMCPServer` |
+| `PatchOrganization` | `PatchOrganizationMembers` | `PatchOrganizationMembersOutput` |
+| `PatchProject` | `PatchProjectAutomation` | `PatchProjectGroup` |
+| `PatchProjectScore` | `PatchProjectTag` | `PatchPrompt` |
+| `PatchRole` | `PatchSpanIFrame` | `PatchView` |
+| `Project` | `ProjectAutomation` | `ProjectGroup` |
+| `ProjectScore` | `ProjectTag` | `Prompt` |
+| `Role` | `ServiceToken` | `SpanIFrame` |
+| `SummarizeDatasetResponse` | `SummarizeExperimentResponse` | `User` |
+| `View` |  |  |
 <!-- END GENERATED REST TYPES -->
 
 The reference sections above are synchronized with the Python surface by `make generate-api-client`; do not edit those sections manually.