vllm-mlx

LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar

Control Any Computer Using LLMs.

MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.

Data Infrastructure providing a declarative, incremental approach for multimodal AI workloads.