An open-source tool for running LLMs locally on consumer hardware with a simple CLI, handling model downloading, quantization, and serving behind a local API.
An open-source tool for running LLMs locally with a simple CLI and local API.
An open-source tool for running LLMs locally on consumer hardware with a simple CLI, handling model downloading, quantization, and serving behind a local API.