Skip to content

Feat/sharpa state verifier #52

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
rebecca-wu-applovin wants to merge 14 commits into from
Closed

Feat/sharpa state verifier #52

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
14 commits
Select commit Hold shift + click to select a range
ec77582
Add the Sharpa EEF policy code and assets used by the sim eval
rebecca-wu-applovin Oct 9, 2026
cb5fb60
Add closed-loop WebXR sim eval for GWP-0.5 Sharpa checkpoints
rebecca-wu-applovin Oct 9, 2026
e77e3fe
Add the sim eval results notebook
rebecca-wu-applovin Oct 9, 2026
54a5bb0
Split the sim eval into a model-agnostic env, policy adapters and a g…
rebecca-wu-applovin Oct 9, 2026
9808889
Add score.py: VLM scoring of every rollout under a folder
rebecca-wu-applovin Oct 9, 2026
b3da930
Validate scene manifest paths and archive members unconditionally
rebecca-wu-applovin Oct 9, 2026
16536ef
Propagate eval failures; mark checkpoints done only when complete
rebecca-wu-applovin Oct 9, 2026
30655b5
Add the SharpaHand stats generator the reader's error message points to
rebecca-wu-applovin Oct 9, 2026
dcec4d8
Cap episodes at 20 s; stricter judge with full-resolution frames
rebecca-wu-applovin Oct 9, 2026
cc113d9
Unify on the policy-server contract: model-specific I/O in the server…
rebecca-wu-applovin Oct 10, 2026
fc6b384
watch_run.sh: rate each finished tag with the VLM judge
rebecca-wu-applovin Oct 10, 2026
434795f
Policy server API docs, reference server, conformance check; judge fr…
rebecca-wu-applovin Oct 13, 2026
3d1004b
Generic eval watcher: watch_ckpts.sh
rebecca-wu-applovin Oct 13, 2026
205e3ca
Sharpa sim benchmark: state-based task verifier calibrated on labelle…
rebecca-wu-applovin Oct 16, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 5 additions & 0 deletions .gitignore
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -219,3 +219,8 @@ assets/*

# Local Labtasker state and attempt journals
.labtasker/

# Sharpa WebXR sim eval outputs and venv
.sharpa_sim_eval/
.venv_webxr/
MUJOCO_LOG.TXT
6 changes: 6 additions & 0 deletions .gitmodules
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,3 +1,9 @@
[submodule "third_party/cosmos-predict2.5"]
path = third_party/cosmos-predict2.5
url = https://github.com/nvidia-cosmos/cosmos-predict2.5.git
[submodule "third_party/giga-world-policy"]
path = third_party/giga-world-policy
url = https://github.com/open-gigaai/giga-world-policy.git
[submodule "third_party/WebXR-Teleop"]
path = third_party/WebXR-Teleop
url = git@github.com:chengyuan-qian-applovin/WebXR-Teleop.git
Loading