Hellow guys, Welcome to my website, and you are watching Model Merging and Mixtures of Experts // Maxime Labonne // AI in Production Conference. and this vIdeo is uploaded by MLOps.community at 2024-03-16T13:32:17-07:00. We are pramote this video only for entertainment and educational perpose only. So, I hop you like our website.
| Name | Model Merging and Mixtures of Experts // Maxime Labonne // AI in Production Conference |
| Video Uploader | Video From MLOps.community |
| Upload Date | This Video Uploaded At 16-03-2024 20:32:17 |
| Video Discription | // Abstract Model merging has recently become extremely popular in the open-source community. The idea of merging several fine-tuned models, or combining them into a Mixture of Experts (MoE), led to new state-of-the-art LLMs. This talk introduces the main concepts around model merging and how to implement it using the mergekit library. It provides a notebook to create your own models and directly upload them on the Hugging Face Hub. // Bio Maxime Labonne is a seasoned Machine Learning Scientist and a thought leader in the LLM (Large Language Models) community. He is currently working at J.P. Morgan in London and holds a Ph.D. in Machine Learning from the Polytechnic Institute of Paris. An active blogger, he has made numerous contributions to the open-source community, including the LLM Course on GitHub, automated tools such as LLM AutoEval, and many state-of-the-art models and architectures like Phixtral. He is the author of the best-selling book "Hands-On Graph Neural Networks using Python," published by Packt. Connect with him on LinkedIn and Twitter @maximelabonne. A big thank you to our Premium Sponsors, @Databricks and @baseten for their generous support! // Sign up for our Newsletter to never miss an event: https://mlops.community/join/ // Watch all the conference videos here: https://home.mlops.community/home/collections // Check out the MLOps Community podcast: https://open.spotify.com/show/7wZygk3mUUqBaRbBGB1lgh?si=242d3b9675654a69 // Read our blog: mlops.community/blog // Join an in-person local meetup near you: https://mlops.community/meetups/ // MLOps Swag/Merch: https://mlops-community.myshopify.com/ // Follow us on Twitter: https://twitter.com/mlopscommunity //Follow us on Linkedin: https://www.linkedin.com/company/mlopscommunity/ |
| Category | Science & Technology |
| Tags | Mixture of experts | LLM | Model merging |
