Snorkel AI logo png black
Webinar series
Register now

Instruction Tuning LLMs with Weak Supervision: A Case Study with RedPajama

August 10, 2023 | 12:30 PM - 1:00 PM Eastern Time

Register now

By submitting this form, I agree to the Terms of Use and acknowledge that my information will be used in accordance with the Privacy Policy.

In partnership with Together AI, Snorkel researchers recently demonstrated a 24% improvement in response win-rate against ChatGPT by programmatically categorizing, scoring, and filtering the original corpus of prompt/response training examples for the open source RedPajama chat LLM—with less than one day of work.

Join this open discussion with Snorkel AI co-founder and head of technology Braden Hancock and Snorkel AI staff researcher Chris Glaze to learn more about our groundbreaking results. Get a first-hand look at how instruction tuning—and careful curation of training data with weak supervision—can improve the performance of open source LLMs like Llama 2 and RedPajama.

In advance of the webinar, you can read our blog post for more detail, including the complete results of our research, and please bring your questions to ask live during the event.

About the Presenters

Image

Braden Hancock

Co-founder and Head of Technology
Snorkel AI

Braden is a co-founder and Head of Technology at Snorkel AI. Before Snorkel, Braden spent four years developing new programmatic approaches for efficiently labeling, augmenting, and structuring training data with the Stanford AI Lab, Facebook, and Google. Prior to that, he performed NLP and ML research at Johns Hopkins University and MIT Lincoln Laboratory and earned a B.S. in Mechanical Engineering from Brigham Young University.
Image

Chris Glaze

Staff Research Scientist
Snorkel AI

Chris Glaze is a Staff Research Scientist at Snorkel AI. Before Snorkel, Chris was a lead data scientist at Chubb Insurance, where he led a team to develop artificial intelligence and help automate parts of the underwriting process. Prior to industry, Chris was in academia for 15 years writing math models in neuroscience, most recently as research faculty at The University of Pennsylvania, Perelman School of Medicine.
Image

We look forward to seeing you!

Register now