Hellow guys, Welcome to my website, and you are watching NLP Cloud course: Deploy Mistral 7b on an NVIDIA A10 GPU on AWS. and this vIdeo is uploaded by NLP Cloud: Advanced AI Platform at 2023-09-29T13:27:32-07:00. We are pramote this video only for entertainment and educational perpose only. So, I hop you like our website.
| Name | NLP Cloud course: Deploy Mistral 7b on an NVIDIA A10 GPU on AWS |
| Video Uploader | Video From NLP Cloud: Advanced AI Platform |
| Upload Date | This Video Uploaded At 29-09-2023 20:27:32 |
| Video Discription | This NLP cloud course shows how to deploy and use the Mistral 7b generative AI model on an NVIDIA A10 GPU on AWS. NLP Cloud is a privacy-focused OpenAI competitor. Learn more about NLP Cloud at https://nlpcloud.com. The Mistral 7b model beats LLaMA 2 7b on all benchmarks and LLaMA 2 13b in many benchmarks. It is actually even on par with the LLaMA 1 34b model. Deploying it and using it requires at least 15GB of VRAM which is why we need an A10 GPU with 24GB of VRAM at least. Here is the structure of the course: 00:00 - Intro 01:33 - Creating the right AWS EC2 machine 05:38 - Checking that the A10 GPU is detected 07:13 - Writing a short script that downloads Mistral 7b, converts it to fp16, and performs inference 11:17 - Conclusion Useful links: - Our website: https://nlpcloud.com - Our Linkedin: https://linkedin.com/company/cloud-nlp - Our Twitter: https://twitter.com/cloud_nlp - Julien Salinas' Linkedin: https://www.linkedin.com/in/julien-salinas-673b3811/ |
| Category | Science & Technology |
| Tags | Science & Technology Download MP4 | Science & Technology Download MP3 | Science & Technology Download MP4 360p | Science & Technology Download MP4 480p | Science & Technology Download MP4 720p | Science & Technology Download MP4 1080p |
