Gesture Reels — Chrome Extension

Hands-free control for Instagram Reels and YouTube Shorts using air gestures via your webcam. All hand tracking runs locally in the browser (MediaPipe HandLandmarker, WASM + model bundled — nothing is sent to any server).

Gestures

Gesture	Action	Trigger
Index finger point up ☝️	Next reel/short	0.4s hold, repeats every 1s while held
Peace sign ✌️ hold	Previous reel/short	0.5s
Thumbs up 👍 hold	Toggle like	1.5s
Open palm hold	Pause / Resume	0.7s
Three fingers 🤟 hold (index+middle+ring)	Mute / Unmute	0.7s

Feedback appears in the camera preview after each action fires (⬆️ ⬇️ ❤️ ⏸️), plus a ghost trail follows your index fingertip.

Install

1. Open chrome://extensions
2. Enable Developer mode (top right)
3. Click Load unpacked → select this folder

Use

1. Go to instagram.com/reels or youtube.com/shorts
2. Click the 👋 Hands-Free floating button (bottom-right) — or the extension's toolbar icon
3. Allow camera access on first use (one-time, granted to the extension, not the site)
4. Camera preview appears top-right — gesture away
5. Click the button again to turn off (camera stops immediately)

Files

• manifest.json — MV3 manifest
• content.js / content.css — floating button, camera iframe, site adapters (YouTube/Instagram selectors live at the top of content.js — patch there when sites change their DOM)
• camera.html / camera.css / camera.js — extension-origin iframe: webcam, MediaPipe inference loop, fingertip trail
• gestures.js — pure gesture classification + state machines (no DOM)
• test_gestures.mjs — logic self-check: node test_gestures.mjs
• background.js — toolbar icon → toggle message
• vendor/ — MediaPipe tasks-vision bundle, WASM, and hand_landmarker.task model (fully offline)

Requirements

• Chrome / Edge (Manifest V3)
• A webcam