Skip to content

Commit 7e85ea9

Browse files
cosmicBboyclaude
andcommitted
feat(webhooks): add flyteplugins-webhooks-clickup
Receive ClickUp webhooks in Flyte. Exports `ClickUpProvider`, a Provider subclass with its defaults pre-wired, so wiring it up reads: WebhookAppEnvironment(providers=[ClickUpProvider()]) Implements the contract from flyteplugins-webhooks-core: which environment variable holds the secret, how to verify a delivery, how to parse one into a WebhookEvent, plus typed constants for every event ClickUp can send. examples/clickup_webhooks.py runs with no ClickUp account at all — `--local` replays the plugin's own SAMPLE_DELIVERY through the app, so you can watch a delivery be verified, normalized, and dispatched before wiring anything up. Runs the shared conformance check, which replays that same sample through verify and parse rather than trusting them to agree with each other. Calling the ClickUp API is deliberately not this plugin's job. Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01VKZrTNjjWVzTZUxDFbn4Nk Signed-off-by: Niels Bantilan <niels.bantilan@gmail.com>
1 parent 730652d commit 7e85ea9

9 files changed

Lines changed: 1995 additions & 0 deletions

File tree

plugins/webhooks/clickup/README.md

Lines changed: 83 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,83 @@
1+
# flyteplugins-webhooks-clickup
2+
3+
Receive ClickUp webhooks in Flyte.
4+
5+
```bash
6+
pip install "flyteplugins-webhooks-core[app]" flyteplugins-webhooks-clickup
7+
```
8+
9+
## Using it
10+
11+
Hand a `ClickUpProvider()` to a `WebhookAppEnvironment` and register handlers with the
12+
typed constants in `events`:
13+
14+
```python
15+
import flyte
16+
from flyteplugins.webhooks.core import DuplicateRun, WebhookAppEnvironment, idempotent_run
17+
from flyteplugins.webhooks.clickup import ClickUpProvider, events
18+
19+
app_env = WebhookAppEnvironment(
20+
name="clickup-webhooks",
21+
providers=[ClickUpProvider()],
22+
secrets=[flyte.Secret("CLICKUP_WEBHOOK_SECRET", as_env_var="CLICKUP_WEBHOOK_SECRET")],
23+
)
24+
25+
26+
@app_env.on_event(events.Task.STATUS_UPDATED)
27+
async def handle(event):
28+
import flyte.remote as remote
29+
30+
task = remote.Task.get(name="my-env.my_task", auto_version="latest")
31+
try:
32+
run = await idempotent_run.aio(task, key=event.dedupe_key(), resource=event.resource_id)
33+
except DuplicateRun as exc:
34+
return {"skipped": str(exc)}
35+
return {"run": run.name}
36+
37+
38+
flyte.serve(app_env)
39+
```
40+
41+
Handlers must `await idempotent_run.aio(...)`. The blocking form stalls the
42+
app's event loop, and ClickUp times deliveries out in seconds.
43+
44+
One app can serve several products at once — hand it one provider per product.
45+
46+
## Try it
47+
48+
`examples/clickup_webhooks.py` runs two ways. The first needs no ClickUp account:
49+
50+
```bash
51+
python examples/clickup_webhooks.py --local # replay a real sample delivery in-process
52+
python examples/clickup_webhooks.py # deploy the receiver to Flyte
53+
```
54+
55+
`--local` posts this plugin's `SAMPLE_DELIVERY` through the app with FastAPI's
56+
test client, so you see a delivery verified, normalized, and dispatched — plus
57+
an unsigned one refused with a 401, and the same delivery replayed to show the
58+
dedupe key is stable.
59+
60+
## Setup
61+
62+
1. Store the secret and mount it on the app:
63+
```bash
64+
flyte create secret CLICKUP_WEBHOOK_SECRET --value <secret>
65+
```
66+
2. Point ClickUp at `<app-url>/webhook/clickup`, from
67+
Space Settings → Integrations → Webhooks (it shows the signing secret on creation).
68+
69+
**Verification:** HMAC-SHA256 over the raw body (`X-Clickup-Signature`).
70+
71+
The list id is at the top level on list-scoped events and on the nested task for task-scoped ones; the parser reads both.
72+
73+
## Event constants
74+
75+
`events` spells every event this plugin can dispatch, as `str` enums grouped by
76+
event type, so a typo fails at import rather than by silently never matching.
77+
Raw strings still work, for events the constants do not cover yet.
78+
79+
## What this plugin does not do
80+
81+
Call the ClickUp API. Use `httpx` — ClickUp ships no Python SDK, and its API is a handful of REST calls directly from your tasks — see
82+
`examples/external_saas_integrations`. This plugin owns only the part that is
83+
Flyte's: authenticating an inbound delivery and turning it into a run.
Lines changed: 123 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,123 @@
1+
"""Receive ClickUp webhooks in Flyte, and see one arrive without leaving your laptop.
2+
3+
Two ways to run this. The second needs no ClickUp account at all:
4+
5+
python clickup_webhooks.py --local # replay a real sample delivery in-process
6+
python clickup_webhooks.py # deploy the receiver to Flyte
7+
8+
`--local` runs the app through FastAPI's test client and posts this plugin's
9+
`SAMPLE_DELIVERY` — a `taskCreated` delivery — signed with a throwaway secret. You see the
10+
delivery verified, normalized, and dispatched to a handler, which is the whole
11+
path a real webhook takes.
12+
13+
To receive real events, deploy it and point ClickUp at `<app-url>/webhook/clickup`
14+
from Space Settings -> Integrations -> Webhooks.
15+
16+
Setup for the real thing:
17+
flyte create secret CLICKUP_WEBHOOK_SECRET --value <secret>
18+
19+
ClickUp shows the signing secret once, when you create the webhook.
20+
"""
21+
22+
import os
23+
import sys
24+
25+
import flyte
26+
from flyteplugins.webhooks.core import WebhookAppEnvironment
27+
28+
from flyteplugins.webhooks.clickup import DEFAULT_SECRET_ENV, SAMPLE_DELIVERY, ClickUpProvider, events
29+
30+
image = flyte.Image.from_debian_base(python_version=(3, 12)).with_pip_packages(
31+
"flyteplugins-webhooks-core[app]", "flyteplugins-webhooks-clickup"
32+
)
33+
34+
app_env = WebhookAppEnvironment(
35+
name="clickup-webhooks",
36+
providers=[ClickUpProvider()],
37+
image=image,
38+
secrets=[flyte.Secret(DEFAULT_SECRET_ENV, as_env_var=DEFAULT_SECRET_ENV)],
39+
)
40+
41+
42+
@app_env.on_event(events.Task.CREATED)
43+
async def on_primary(event):
44+
"""React to the event this plugin's sample delivery carries.
45+
46+
Returning a dict is enough to see the path working. To do real work, launch
47+
a deployed task instead — see `launch_a_task` below.
48+
"""
49+
return {
50+
"saw": event.qualified_type,
51+
"resource": event.resource_id,
52+
"title": event.title,
53+
# The key `idempotent_run` would dedupe on. Replaying the same delivery
54+
# produces the same key, which is what makes a redelivery a no-op.
55+
"dedupe_key": event.dedupe_key(),
56+
}
57+
58+
59+
@app_env.on_event(events.Task.STATUS_UPDATED)
60+
async def on_secondary(event):
61+
"""A second handler, to show dispatch picking the right one per event."""
62+
return {"saw": event.qualified_type, "resource": event.resource_id}
63+
64+
65+
async def launch_a_task(event):
66+
"""What a handler looks like once it does real work.
67+
68+
Not registered above, because it needs `clickup-tickets.triage_task` deployed first
69+
and a Flyte backend to launch into. Wire it up with:
70+
71+
@app_env.on_event(events.Task.CREATED)
72+
73+
`idempotent_run` refuses to launch when a run carrying the same dedupe key
74+
is already live or has succeeded, so ClickUp redelivering an event — which
75+
it does on any non-2xx — never starts a second run.
76+
"""
77+
import flyte.remote as remote
78+
from flyteplugins.webhooks.core import DuplicateRun, idempotent_run
79+
80+
task = remote.Task.get(name="clickup-tickets.triage_task", auto_version="latest")
81+
try:
82+
# Always `.aio`: the blocking form stalls the app's event loop, and
83+
# webhook senders time deliveries out in seconds.
84+
run = await idempotent_run.aio(task, key=event.dedupe_key(), task_id=event.resource_id)
85+
except DuplicateRun as exc:
86+
return {"skipped": str(exc)}
87+
return {"run": run.name}
88+
89+
90+
def _try_locally() -> None:
91+
"""Post this plugin's sample delivery to the app, in-process."""
92+
from fastapi.testclient import TestClient
93+
94+
secret = os.environ.setdefault(DEFAULT_SECRET_ENV, "local-trial-secret")
95+
build_headers, body = SAMPLE_DELIVERY
96+
client = TestClient(app_env.app)
97+
98+
print("POST /webhook/clickup (signed with a throwaway secret)")
99+
response = client.post("/webhook/clickup", content=body, headers=build_headers(body, secret))
100+
print(f" {response.status_code} {response.json()}\n")
101+
102+
print("the same delivery again — note the identical dedupe_key:")
103+
again = client.post("/webhook/clickup", content=body, headers=build_headers(body, secret))
104+
print(f" {again.status_code} {again.json()}\n")
105+
106+
print("an unsigned delivery is refused:")
107+
bad = client.post("/webhook/clickup", content=body, headers={})
108+
print(f" {bad.status_code} {bad.json()}\n")
109+
110+
print("normalized events the app has seen:")
111+
for seen in client.get("/api/events").json():
112+
print(f" {seen['provider']} {seen['qualified_type']} resource={seen['resource_id']}")
113+
114+
115+
if __name__ == "__main__":
116+
if "--local" in sys.argv:
117+
_try_locally()
118+
else:
119+
flyte.init_from_config()
120+
handle = flyte.serve(app_env)
121+
handle.activate(wait=True)
122+
print(f"Dashboard ready at {handle.endpoint}")
123+
print(f"Point ClickUp at {handle.endpoint}/webhook/clickup")
Lines changed: 56 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,56 @@
1+
[project]
2+
name = "flyteplugins-webhooks-clickup"
3+
dynamic = ["version"]
4+
description = "Receive ClickUp webhooks in Flyte."
5+
readme = "README.md"
6+
authors = [{ name = "Flyte Contributors" }]
7+
requires-python = ">=3.10"
8+
dependencies = ["flyteplugins-webhooks-core"]
9+
10+
[build-system]
11+
requires = ["setuptools", "setuptools_scm"]
12+
build-backend = "setuptools.build_meta"
13+
14+
[dependency-groups]
15+
dev = [
16+
"pytest>=8.3.5",
17+
"pytest-asyncio>=0.26.0",
18+
"fastapi>=0.115",
19+
"uvicorn>=0.30",
20+
"httpx>=0.27",
21+
]
22+
23+
[tool.setuptools]
24+
include-package-data = true
25+
26+
[tool.setuptools.packages.find]
27+
where = ["src"]
28+
include = ["flyteplugins*"]
29+
30+
[tool.setuptools_scm]
31+
root = "../../.."
32+
33+
[tool.pytest.ini_options]
34+
norecursedirs = []
35+
log_cli = true
36+
log_cli_level = 20
37+
markers = []
38+
asyncio_mode = "auto"
39+
asyncio_default_fixture_loop_scope = "function"
40+
41+
[tool.coverage.run]
42+
branch = true
43+
44+
[tool.ruff]
45+
line-length = 120
46+
47+
[tool.ruff.lint]
48+
select = ["E", "W", "F", "I", "PLW", "YTT", "ASYNC", "C4", "T10", "EXE", "ISC", "LOG", "PIE", "Q", "RSE", "FLY", "PGH", "PLC", "PLE", "FURB", "RUF"]
49+
ignore = ["PGH003", "PLC0415"]
50+
51+
[tool.ruff.lint.per-file-ignores]
52+
"examples/*" = ["E402"]
53+
54+
[tool.uv.sources]
55+
flyte = { path = "../../..", editable = true }
56+
flyteplugins-webhooks-core = { path = "../core", editable = true }
Lines changed: 31 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,31 @@
1+
"""ClickUp webhooks for Flyte.
2+
3+
Hand a `ClickUpProvider()` to a `WebhookAppEnvironment` and register handlers with the
4+
typed constants in `events`. Calling the ClickUp API is not this plugin's job —
5+
it is a handful of REST calls, so use `httpx` from your tasks. See
6+
`examples/external_saas_integrations`.
7+
"""
8+
9+
import hashlib
10+
import hmac
11+
12+
from . import events
13+
from ._provider import DEFAULT_SECRET_ENV, ClickUpProvider, parse, verify
14+
15+
__all__ = ["DEFAULT_SECRET_ENV", "SAMPLE_DELIVERY", "ClickUpProvider", "events", "parse", "verify"]
16+
17+
18+
def _sample_headers(body: bytes, secret: str) -> dict[str, str]:
19+
return {"X-Clickup-Signature": hmac.new(secret.encode(), body, hashlib.sha256).hexdigest()}
20+
21+
22+
#: A real `taskCreated` delivery, trimmed to the fields the parser reads.
23+
SAMPLE_DELIVERY = (
24+
_sample_headers,
25+
(
26+
b'{"event": "taskCreated", "task_id": "abc123", "list_id": "9000",'
27+
b' "webhook_id": "wh-000", "timestamp": 1700000000000,'
28+
b' "task": {"id": "abc123", "name": "Fix the thing",'
29+
b' "url": "https://app.clickup.com/t/abc123"}}'
30+
),
31+
)
Lines changed: 71 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,71 @@
1+
"""ClickUp webhook verification and payload normalization."""
2+
3+
from __future__ import annotations
4+
5+
from typing import Mapping
6+
7+
from flyteplugins.webhooks.core import (
8+
Provider,
9+
WebhookEvent,
10+
constant_time_equals,
11+
hex_hmac_sha256,
12+
json_body,
13+
lower_headers,
14+
)
15+
16+
#: Environment variable this provider reads its secret from by default.
17+
DEFAULT_SECRET_ENV = "CLICKUP_WEBHOOK_SECRET"
18+
19+
20+
def verify(body: bytes, headers: Mapping[str, str], secret: str) -> bool:
21+
"""Verify the `X-Clickup-Signature` HMAC over the raw body."""
22+
signature = lower_headers(headers).get("x-clickup-signature")
23+
return bool(signature) and constant_time_equals(hex_hmac_sha256(secret, body), signature.strip())
24+
25+
26+
def parse(headers: Mapping[str, str], body: bytes) -> WebhookEvent:
27+
"""Normalize a ClickUp delivery into a `WebhookEvent`."""
28+
payload = json_body(body)
29+
task = payload.get("task") or {}
30+
# ClickUp puts the list id at the top level on list-scoped events and only on
31+
# the nested task for task-scoped ones; read both or a `scopes` allowlist
32+
# cannot attribute task events.
33+
list_id = payload.get("list_id") or (task.get("list") or {}).get("id")
34+
task_id = payload.get("task_id") or task.get("id")
35+
return WebhookEvent(
36+
provider="clickup",
37+
event_type=payload.get("event", "unknown"),
38+
delivery_id=str(payload.get("webhook_id") or ""),
39+
resource_id=str(task_id) if task_id is not None else None,
40+
occurred_at=str(payload.get("timestamp")) if payload.get("timestamp") is not None else None,
41+
scope=str(list_id) if list_id is not None else None,
42+
title=task.get("name"),
43+
url=task.get("url"),
44+
payload=payload,
45+
)
46+
47+
48+
class ClickUpProvider(Provider):
49+
"""ClickUp's webhook provider, with its defaults pre-wired.
50+
51+
```python
52+
from flyteplugins.webhooks.core import WebhookAppEnvironment
53+
from flyteplugins.webhooks.clickup import ClickUpProvider
54+
55+
app_env = WebhookAppEnvironment(name="webhooks", providers=[ClickUpProvider()])
56+
```
57+
58+
Args:
59+
secret_env: Environment variable holding the secret, mounted from a
60+
`flyte.Secret`. Override only if you store it under a non-standard
61+
name; the default is what the docs and examples assume.
62+
"""
63+
64+
def __init__(self, *, secret_env: str = DEFAULT_SECRET_ENV) -> None:
65+
super().__init__(
66+
name="clickup",
67+
secret_env=secret_env,
68+
verify=verify,
69+
parse=parse,
70+
setup_hint="Space Settings -> Integrations -> Webhooks",
71+
)

0 commit comments

Comments
 (0)