Reinforcement Learning from Human Feedback: From Zero to chatGPT

Hellow guys, Welcome to my website, and you are watching Reinforcement Learning from Human Feedback: From Zero to chatGPT. and this vIdeo is uploaded by HuggingFace at 2022-12-13T09:34:48-08:00. We are pramote this video only for entertainment and educational perpose only. So, I hop you like our website.

Info About This Video

Name

Video Uploader

Video From HuggingFace

Upload Date

This Video Uploaded At 13-12-2022 17:34:48

Video Discription

In this talk, we will cover the basics of Reinforcement Learning from Human Feedback (RLHF) and how this technology is being used to enable state-of-the-art ML tools like ChatGPT. Most of the talk will be an overview of the interconnected ML models and cover the basics of Natural Language Processing and RL that one needs to understand how RLHF is used on large language models. It will conclude with open question in RLHF.

RLHF Blogpost: https://huggingface.co/blog/rlhf
The Deep RL Course: https://hf.co/deep-rl-course
Slides from this talk: https://docs.google.com/presentation/d/1eI9PqRJTCFOIVihkig1voRM4MHDpLpCicX9lX1J2fqk/edit?usp=sharing
Nathan Twitter: https://twitter.com/natolambert
Thomas Twitter: https://twitter.com/thomassimonini

Nathan Lambert is a Research Scientist at HuggingFace. He received his PhD from the University of California, Berkeley working at the intersection of machine learning and robotics. He was advised by Professor Kristofer Pister in the Berkeley Autonomous Microsystems Lab and Roberto Calandra at Meta AI Research. He was lucky to intern at Facebook AI and DeepMind during his Ph.D. Nathan was was awarded the UC Berkeley EECS Demetri Angelakos Memorial Achievement Award for Altruism for his efforts to better community norms.

Info About This Video

More Videos

Reinforcement Learning through Human Feedback - EXPLAINED! | RLHF

RLHF+CHATGPT: What you must know

Stanford CS224N | 2023 | Lecture 10 - Prompting, Reinforcement Learning from Human Feedback

New course with Google Cloud: Reinforcement Learning from Human Feedback (RLHF)

Reinforcement Learning from Human Feedback explained with math derivations and the PyTorch code.

Reinforcement Learning from Human Feedback (RLHF)

Reinforcement Learning: ChatGPT and RLHF

Reinforcement Learning from Human Feedback (Natural Language Processing at UT Austin)

Direct Preference Optimization: Your Language Model is Secretly a Reward Model | DPO paper explained

Reinforcement Learning with Human Feedback - How to train and fine-tune Transformer Models

RLHF - Reinforcement Learning with Human Feedback

RLAIF vs. RLHF: the technology behind Anthropic’s Claude (Constitutional AI Explained)

Reinforcement Learning with Human Feedback (RLHF)

Direct Preference Optimization: Forget RLHF (PPO)

Mastering RLHF with AWS: A Hands-on Workshop on Reinforcement Learning from Human Feedback

RLHF: How to Learn from Human Feedback with Reinforcement Learning

John Schulman - Reinforcement Learning from Human Feedback: Progress and Challenges

Reinforcement Learning from Human Feedback Explained (and RLAIF)