runanywhere-sdks

Quantization, kernels, inference engine for mobiles, wearables, smart home and robots.

React Native binding of llama.cpp

Speech-to-text, text-to-speech, speaker diarization, speech enhancement, source separation, and VAD using next-gen Kaldi with onnxruntime without Internet connection. Support embedded systems, Android, iOS, HarmonyOS, Raspberry Pi, RISC-V, RK NPU, Axera NPU, Ascend NPU, x86_64 servers, websocket server/client, support 12 programming languages

Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.