Original upload date: Tue, 24 Oct 2023 00:00:00 GMT
Archive date: Mon, 25 Dec 2023 10:20:25 GMT
Hi! Harper Carroll from Brev.dev here. In this tutorial video, I walk you through how to fine-tune Mistral 7B, which outperforms Llama 2 13B on all tested benchmarks, on your own data.... like how I d
...
o with my journal entries from over the years, teen angst and all.
Notebook: https://github.com/brevdev/notebooks/blob/main/mistral-finetune-own-data.ipynb
Notebook to fine-tune on a HF dataset: https://github.com/brevdev/notebooks/blob/main/mistral-finetune.ipynb
My explanation on how QLoRA works: https://brev.dev/blog/how-qlora-works
Join the Discord: https://discord.com/invite/NVDyv7TUgJ
Find me on 𝕏: https://x.com/HarperSCarroll