Hellow guys, Welcome to my website, and you are watching Fine-tuning LLMs with PEFT and LoRA. and this vIdeo is uploaded by Sam Witteveen at 2023-04-24T06:40:16-07:00. We are pramote this video only for entertainment and educational perpose only. So, I hop you like our website.
| Name | Fine-tuning LLMs with PEFT and LoRA |
| Video Uploader | Video From Sam Witteveen |
| Upload Date | This Video Uploaded At 24-04-2023 13:40:16 |
| Video Discription | LoRA Colab : https://colab.research.google.com/drive/14xo6sj4dARk8lXZbOifHEn1f_70qNAwy?usp=sharing Blog Post: https://huggingface.co/blog/peft LoRa Paper: https://arxiv.org/abs/2106.09685 In this video I look at how to use PEFT to fine tune any decoder style GPT model. This goes through the basics LoRa fine-tuning and how to upload it to HuggingFace Hub. My Links: Twitter - https://twitter.com/Sam_Witteveen Linkedin - https://www.linkedin.com/in/samwitteveen/ Github: https://github.com/samwit/langchain-tutorials https://github.com/samwit/llm-tutorials 00:00 Intro 00:04 - Problems with fine-tuning 00:48 - Introducing PEFT 01:11 - PEFT other cool techniques 01:51 - LoRA Diagram 03:25 - Hugging Face PEFT Library 04:06 - Code Walkthrough |
| Category | Science & Technology |
| Tags | hugging face | PEFT | LoRa | fine-tuning | lora finetuning | LLM |
