Hellow guys, Welcome to my website, and you are watching Fine-tuning Llama 2 on Your Own Dataset | Train an LLM for Your Use Case with QLoRA on a Single GPU. and this vIdeo is uploaded by Venelin Valkov at 2023-09-04T08:30:09-07:00. We are pramote this video only for entertainment and educational perpose only. So, I hop you like our website.
| Name | Fine-tuning Llama 2 on Your Own Dataset | Train an LLM for Your Use Case with QLoRA on a Single GPU |
| Video Uploader | Video From Venelin Valkov |
| Upload Date | This Video Uploaded At 04-09-2023 15:30:09 |
| Video Discription | Full text tutorial (requires MLExpert Pro): https://www.mlexpert.io/prompt-engineering/fine-tuning-llama-2-on-custom-dataset Learn how to fine-tune the Llama 2 7B base model on a custom dataset (using a single T4 GPU). We'll use the QLoRa technique to train an LLM for text summarization of conversations between support agents and customers over Twitter. Discord: https://discord.gg/UaNPxVD6tv Prepare for the Machine Learning interview: https://mlexpert.io Subscribe: http://bit.ly/venelin-subscribe GitHub repository: https://github.com/curiousily/Get-Things-Done-with-Prompt-Engineering-and-LangChain Join this channel to get access to the perks and support my work: https://www.youtube.com/channel/UCoW_WzQNJVAjxo4osNAxd_g/join 00:00 - When to Fine-tune an LLM? 00:30 - Fine-tune vs Retrieval Augmented Generation (Custom Knowledge Base) 03:38 - Text Summarization (our example) 04:14 - Text Tutorial on MLExpert.io 04:47 - Dataset Selection 05:36 - Choose a Model (Llama 2) 06:22 - Google Colab Setup 07:26 - Process data 10:08 - Load Llama 2 Model & Tokenizer 11:18 - Training 14:49 - Compare Base Model with Fine-tuned Model 18:08 - Conclusion #llama2 #llm #promptengineering #chatgpt #chatbot #langchain #gpt4 #summarization |
| Category | Education |
| Tags | Machine Learning | Artificial Intelligence | Data Science | Deep Learning |
