Sign Up
OverviewAPI
Mistral.rs introduces a lightning-fast LLM inference platform with device support, quantization, and compatibility with Open-AI API. This new platform enhances inference efficiency across various devices through quantization and advanced model architectures.

Ask a question