Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

Appearance settings

Latest commit

 

History

History
History

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

README.md

Outline

FlashRT Examples

Quick Start (Hardware-Agnostic)

# Set $CHECKPOINT_DIR to the directory holding your model weights
# (Pi0 / Pi0.5 / GROOT format; the library auto-detects config).
export CHECKPOINT_DIR=/path/to/your/pi05_checkpoint
python examples/quickstart.py --checkpoint "$CHECKPOINT_DIR"

Auto-detects GPU (SM110 → Thor backend, SM120 → Blackwell backend) and runs one inference pass with precision check.

Hardware-Specific Examples

Thor (Jetson AGX Thor, SM110)

Run inside Docker container (<your_container>):

# Precision check: cosine similarity vs PyTorch reference
python examples/thor/eval_precision.py \
    --checkpoint_dir $CHECKPOINT_DIR

# LIBERO benchmark (full evaluation)
python examples/thor/eval_libero.py \
    --checkpoint_dir $CHECKPOINT_DIR \
    --task_suite libero_spatial
Metric Value
E2E Latency 44.3 ms
Cosine vs PyTorch 0.9998
LIBERO Spatial 98.2% (491/500)

Blackwell (RTX 5090, SM120)

# Precision check
python examples/blackwell/eval_precision.py \
    --checkpoint /path/to/checkpoint

# LIBERO benchmark
python examples/blackwell/eval_libero.py \
    --checkpoint /path/to/checkpoint \
    --task_suite libero_spatial
Metric Value
Latency (2-view) 17.88 ms
Cosine vs PyTorch 0.999638
LIBERO Spatial 100% (50/50)

Adding a New Hardware Target

  1. Create examples/<hardware>/ directory
  2. Copy an existing example and adjust engine/FMHA paths
  3. The library auto-detects SM version; you may also force backend:
    model = flash_rt.load_model("pi05", ckpt, backend="thor")
Morty Proxy This is a proxified and sanitized view of the page, visit original site.