Back to List
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
C++flashrt-project/FlashRT

FlashRT

FlashRT is a high-performance realtime inference engine for small-batch, latency-sensitive AI workloads. The flagship integration is production VLA control for Pi0, Pi0.5, GROOT N1.6, and Pi0-FAST. Also support llm e.g, qwen3.6-27B

67.0/100
553Forks: 74
View on GitHub
Loading report...

Similar Projects

lucebox

73

LLM speculative inference server for heterogeneous hardware & consumer GPUs

C++2.8K

surogate

78

Training/Fine-tuning at the speed of light

C++813

lemonade

85

Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk

C++5.7K

xllm

82

A high-performance inference engine for LLM, VLM, DiT and REC models, optimized for diverse AI accelerators. It is hosted in OpenAtom Foundation.

C++1.6K
Back to List