Skip to content

Latest commit

 

History

History
32 lines (21 loc) · 477 Bytes

File metadata and controls

32 lines (21 loc) · 477 Bytes

Triton Inference Sever Sandbox

Triton Inference Server

PyTriton

Setup

# for CPU devce
make init

# for GPU device
make init-gpu

Launch Monitoring Tools

# Launch Prometheus and Grafana
make up-monitor

# Stop monitoring services
make stop-monitor

# Stop and remove monitoring services
make down-monitor