
- Category: AI - LLM
- Start Date: February 2024 (Dey 1402)
- Article URL: Medium - Github - Huggingface
Fine-tuning LLMs
This is my first article on Medium - Fine-tuning Mistral 7b in Google Colab with QLoRA (complete guide). The resulting fine-tuned model with synthetic data will outperform Openai’s GPT-4 on a domain-specific benchmark.
This project is also on my Github and the models are on Huggingface.