Soup CLI
Fine-tune LLMs in one command, optimizing for efficiency and performance.
Soup CLI is a command-line tool for fine-tuning Large Language Models (LLMs). It enables training models that are larger than available VRAM by streaming layers from CPU RAM or NVMe. Soup CLI supports various fine-tuning techniques like LoRA, DPO, and QLoRA, and offers features for data preparation, model evaluation, and deployment.
Free
How to use Soup CLI?
Install via pip: `pip install soup-cli`. Use commands like `soup train` for fine-tuning, `soup draft measure` to evaluate speculative decoding, and `soup ship` for model deployment. The CLI offers extensive options for configuring training parameters, data handling, and model optimization, making LLM fine-tuning accessible on consumer hardware.
Soup CLI 's Core Features
Soup CLI 's Use Cases
Soup CLI 's FAQ
Most impacted jobs
Machine Learning Engineer
AI Researcher
Data Scientist
Software Developer
MLOps Engineer
