Tag

Evaluation

AI evaluation systematically measures a model’s performance on tasks. Classically, this applied metrics like accuracy or precision to clear and discrete numerical or categorical targets. Moden evaluation also assesses the output of generative models to ensure they create content within an organization’s standards and guidelines.

All articles on Evaluation

Forager: Rapid Data Exploration for Rapid Model Development
Machine Learning Whiteboard (MLW) Open-source Series We started our machine learning whiteboard (MLW) series earlier this year as an open-invite space to brainstorm ideas and discuss the latest papers, techniques, and workflows in the AI space. We emphasize an informal and open environment to everyone interested in learning about machine learning.In this episode, Fait Poms, a Ph.D. student at Stanford
October 14, 2021
Team Snorkel
Building Malleable Machine Learning (ML) Systems
Defining and Building Malleable ML Systems – Machine Learning Whiteboard (MLW) Open-Source Series As you may know, earlier this year, we started our machine learning whiteboard (MLW) series, an open-invite space to brainstorm ideas and discuss the latest papers, techniques, and workflows in the AI space. We emphasize an informal and open environment to everyone interested in learning about machine learning. In this
September 22, 2021
Team Snorkel
Applying Weak Supervision Research
ScienceTalks with Paroma Varma In this episode of Science Talks, Snorkel AI’s Braden Hancock chats with Paroma Varma – a co-founder of Snorkel AI and one of the first and leading contributors to the Snorkel project. We discuss Paroma’s path into machine learning, her work in optimization and signal processing during her undergrad, weak supervision and image data during her
September 13, 2021
Team Snorkel
Sliceline: Fast, Linear-Algebra-Based Slice Finding for ML Model Debugging
Diving Into SliceLine – Machine Learning Whiteboard (MLW) Open-source Series Earlier this year, we started our machine learning whiteboard (MLW) series, an open-invite space to brainstorm ideas and discuss the latest papers, techniques, and workflows in the AI space. We emphasize an informal and open environment to everyone interested in learning about machine learning.In this episode, Kaushik Shivakumar dives into
September 8, 2021
Team Snorkel
Multi-Resolution Weak Supervision for Sequential Data
Machine Learning Whiteboard (MLW) Open-source Series Our machine learning whiteboard (MLW) is an open-invite space to brainstorm ideas and discuss the latest papers, techniques, and workflows in the AI space. We emphasize an informal and open environment to everyone interested in discovering more about machine learning.In this episode, Hiromu Hota, Vincent Sunn Chen, Daniel Y. Fu, and Frederic Sala dive
June 25, 2021
Team Snorkel
Applying Information Theory to ML With Fred Sala
In this episode of Science Talks, Frederic Sala – an assistant professor of Computer Science at the University of Wisconsin Madison and a research scientist at Snorkel discusses his path into machine learning, the central thesis that ties together his multidisciplinary research, his thoughts on the future of weak supervision, as well as his decision to go into academia.
May 19, 2021
Team Snorkel
Measuring NLP Progress With Sebastian Ruder
In this episode of Science Talks, Sebastian Ruder, Research Scientist at DeepMind, shares his thoughts on making AI practical with Snorkel AI’s Braden Hancock. This conversation covers progress made in the NLP domain with emerging research, new benchmarks like SuperGLUE, rich repositories and news sources that keep you in the loop and on top of what’s new in NLP, and more.
March 10, 2021
Team Snorkel
Machine Learning Production Myths
Takeaways from MLSys Seminars with Chip HuyenIn November, I had the opportunity to come back to Stanford to participate in MLSys Seminars, a series about Machine Learning Systems. It was great to see the growing interest of the academic community in building practical AI applications. Here is a recording of the talk.The talk was originally about the principles of good
December 23, 2020
Chip Huyen
How to Overcome Practical Challenges for AI in Healthcare
There’s a lot of excitement about the potential for AI to improve healthcare. This is driven by compelling advances across a wide range of applications including drug discovery, radiology, pathology, electronic medical record (EMR) intelligence, clinical trials, and more. There are also many challenges for development and deployment of AI for healthcare.
November 9, 2020
Brandon Yang