Fine-tuning LLMs

  • Category: AI - LLM
  • Start Date: February 2024 (Dey 1402)
  • Article URL: Medium - Github - Huggingface

This is my first article on Medium - Fine-tuning Mistral 7b in Google Colab with QLoRA (complete guide). The resulting fine-tuned model with synthetic data will outperform Openai’s GPT-4 on a domain-specific benchmark.
This project is also on my Github and the models are on Huggingface.