Hellow guys, Welcome to my website, and you are watching Deploy FULLY PRIVATE & FAST LLM Chatbots! (Local + Production). and this vIdeo is uploaded by Abhishek Thakur at 2023-07-14T05:26:29-07:00. We are pramote this video only for entertainment and educational perpose only. So, I hop you like our website.
| Name | Deploy FULLY PRIVATE & FAST LLM Chatbots! (Local + Production) |
| Video Uploader | Video From Abhishek Thakur |
| Upload Date | This Video Uploaded At 14-07-2023 12:26:29 |
| Video Discription | In this video, I'll show you how you can deploy and run large language model (LLM) chatbots locally. The steps followed are also valid for production environment and the tutorial is also production ready! By the end of the tutorial, you will be running an LLM like Falcon-7B (or 40B or any LLM) locally and you would have also deployed a chat interface to use the local llm and chat with it! For the video, we will be using text-generation-inference: https://github.com/huggingface/text-generation-inference And chat-ui: https://github.com/huggingface/chat-ui Please subscribe and like the video to help me keep motivated to make awesome videos like this one. :) My book, Approaching (Almost) Any Machine Learning problem, is available for free here: https://bit.ly/approachingml Follow me on: Twitter: https://twitter.com/abhi1thakur LinkedIn: https://www.linkedin.com/in/abhi1thakur/ Kaggle: https://kaggle.com/abhishek |
| Category | Education |
| Tags | machine learning | deep learning | artificial intelligence | kaggle | abhishek thakur | how to deploy llm | local llm chatbot | private llm chatbot | llm bot | local llm | run llm locally | run falcon locally | falcon 7b local | falcon 40b | how to deploy falcon | falcon docker container | huggingface chat | text generation inference | using tgi | deploy tgi | deploy local llm | how to run llms locally | train llm | finetune llm | run llm | llm quantization |
