Tag

Fine-Tuning

Fine-tuning adapts a pre-trained machine learning model to perform well on new tasks. Data scientists call these "foundation models." Foundation model providers train these enormous neural networks on millions of documents. This diversity of training data allows foundation models to perform many tasks that they were not specifically trained for—though at low accuracy.

Instead of starting from scratch, fine-tuning allows data scientists to build upon these foundations. They feed the models additional input and output examples to adapt them to specific business use cases.

This approach reduces the time and resources needed to deploy AI solutions while maintaining high performance.

All articles on Fine-Tuning

Image1
LLMs high priority for enterprise data science, but concerns remain
Enterprises—especially the world’s largest—are excited to use large language models, but they want to fine-tune them on proprietary data.
June 23, 2023
Matt Casey
SambaNova logo
Sambanova on using LLMs to squeeze value from business data
Stefano Lindt presents “Leveraging NLP to Extract Value From Business Data” at Snorkel AI’s The Future of Data-Centric AI Summit in 2022.
June 20, 2023
Team Snorkel
Book floating in space—a rough illustration of large language models.
Large language models: their history, capabilities and limitations
Large language models have enormous potential. But what are they? Where did they come from? And how can you make them work better?
May 25, 2023
Matt Casey
Image
Stanford professor on data-centric AI for healthcare and medicine
Stanford assistant professor James Zou, presents “Responsible Data-Centric AI for Healthcare and Medicine” at The Future of Data-Centric AI.
May 18, 2023
Team Snorkel
Image
Out of distribution blindness: why to fix it and how energy can help
Sharon Li is an assistant professor at the University of Wisconsin-Madison. She presented “Detecting Data Distributional Shift: Challenges and Opportunities” at Snorkel AI’s The Future of Data-Centric AI Summit in 2022. The talk covered a novel approach for handling out-of-distribution objects.
May 3, 2023
Team Snorkel
Aditya-vyas-7ygsbeajog0-unsplash
AI for banking in the era of ChatGPT
Forward-looking companies in finance, including banks, have looked to technology to meet challenges and are reaping the rewards of doing so.
April 20, 2023
Harshini Jayaram
Image
Snorkel AI x Hugging Face: unlock foundation models for enterprises
Snorkel AI teamed up with Hugging Face to provide enterprises with even more flexibility and choice as they develop AI applications.
April 6, 2023
Friea Berg
Ananya Kumar, standfor student
Boost foundation model results with linear probing and fine-tuning
Ananya Kumar, Stanford Ph.D. student, explains methods to improve foundation model performance, including linear probing and fine-tuning.
April 5, 2023
Team Snorkel
Jimmy Lin SambaNova Systems FM Summit
Practical solutions: enterprise value from foundation models
Jimmy Lin is an NLP product lead at SambaNova Systems. He presented “A Practical Approach to Delivering Enterprise Value with Foundation Models” at Snorkel AI’s 2023 Foundation Model Virtual Summit.
March 31, 2023
Team Snorkel
Snorkel Flow Spring 2023 key features
Snorkel Flow Spring 2023: warm starts and foundation models
Snorkel Flow’s Spring 2023 release focuses on adapting foundation models for enterprise use—including fine-tuning and additional features.
March 30, 2023
Nick Harvey
Image
Adverse drug events: how to spot them with machine learning
Physician notes and other sources of unstructured data can offer insight into drugs’ negative side effects. Here’s how modern machine learning tools can help turn all that data into a useful resource.
March 29, 2023
Nazanin Makkinejad
Image
Research roundup: dive into the latest foundation model research
Snorkel AI CEO and co-founder Alex Ratner recently spoke with five Snorkel researchers about their foundation model research.
March 23, 2023
Matt Casey
Image
McKinsey QuantumBlack experts: exciting foundation model future
McKinsey’s Carlo Giovine and David Harvey present “Trends in Enterprise ML and the potential impact of Foundation Models” at Snorkel’s Foundation Model Summit.
March 21, 2023
Team Snorkel
Image
Foundation Model Summit Sessions Show Challenges and Promise
Twelve speakers shared their insights into the present and future of foundation models January event; see what they had to say.
March 7, 2023
Matt Casey
Image
Google’s Dr. Arsanjani on Enterprise Foundation Model Promise and Challenges
Ali Arsanjani, director of cloud partner engineering at Google Cloud, presented a talk entitled “Challenges and Ethics of DLM and LLM Adoption in the Enterprise” at Snorkel AI’s recent Foundation Model Virtual Summit.
March 2, 2023
Team Snorkel
Scrabble tiles spelling "foundation." Relevant to Foundation Models, no?
Foundation Models 101: a guide with essential FAQs
Foundation Models (FMs), such as GPT-3 and Stable Diffusion, mark the beginning of a new era in machine learning and artificial intelligence. What are they and how will they impact your business? Find out in our guide.
March 1, 2023
Matt Casey
Image
Operationalizing knowledge for data-centric AI
Snorkel AI CEO and Co-Founder Alex Ratner’s introduction to data-centric AI from the 2022 Future of Data-Centric AI virtual conference.
February 27, 2023
Team Snorkel
Image
Aspect-based sentiment analysis in Snorkel Flow
Understanding and quantifying people’s opinions has become increasingly important to businesses, but the way people can express multiple thoughts in the same sentence has frustrated practitioners’ efforts to extract those opinions cleanly—a problem we can solve through aspect-based sentiment analysis (ABSA).
February 15, 2023
Lia Chin-Purcell
Image
Meta research manager talks speech and search
Meta senior applied research manager Anoop Sinha and Snorkel AI co-founder Braden Hancock discuss mastering speech and search with TWIML host Sam Charrington.
February 10, 2023
Team Snorkel
Image
NASA ML Lead on its WorldView citizen scientist no-code tool
Anirudh Koul is Machine Learning Lead for the NASA Frontier Development Lab and the Head of Machine Learning Sciences at Pinterest. He presented at Snorkel AI’s 2022 Future of Data Centric AI (FDCAI) Conference.
February 6, 2023
Team Snorkel
Image
Building better datasets with Snorkel Flow error analysis
As machine learning practitioners, few of us would expect the first version of a new model to achieve our objective. We plan for multiple rounds of iteration to address errors and improve performance, and the Snorkel Flow platform provides tools to enable this kind of iteration within the data-centric AI framework.
February 2, 2023
Josh McGrath
Liger: Fusing foundation model embeddings & weak supervision blog image
How Foundation Models bolster programmatic labeling
Snorkel CEO Alex Ratner interviews Mayee Chen about how Liger improves the effectiveness of programmatic labeling through foundation model embeddings.
January 26, 2023
Team Snorkel
Image
FM Summit shows Foundation Model hurdles and potential
Snorkel AI held its Foundation Model Summit Jan 17, bringing together 12 presenters and over 600 attendees at 10 virtual sessions. The event drew registrants from across many sectors, including the tech industry, healthcare, and financial services.
January 18, 2023
Matt Casey
Image
Contrastive Learning boosts Foundation Model specialization
Snorkel AI co-founder and CEO Alex Ratner talks with Ananya Kumar about the work he did on improving the effectiveness of foundation models by using contrastive learning, image augmentations, and labeled subsamples.
January 13, 2023
Team Snorkel
Image
Adapting language-based models beyond English
While a majority of Natural Language Processing (NLP) models focus on English, the real world requires solutions that work with languages across the globe. This demo shows how effectively users can build cross-language models in Snorkel Flow.
January 12, 2023
Anastassia Kornilova
,
April Guo
Image
Speech AI Demystified | FDCAI Lightning Talk
Sirisha Rella, Technical Product Marketing Manager at Nvidia, recently gave a Lightning Talk presentation on “demystifying” speech AI at Snorkel AI’s Future of Data-Centric AI virtual conference.
January 10, 2023
Team Snorkel
Image
Snorkel AI to host Foundation Model Virtual Summit, registration now open
Snorkel AI will hold a free Foundation Model Virtual Summit on Tuesday, January 17 where speakers from across the technology industry, including some from Google and Stanford University, will discuss the enterprise use of Foundation Models.
January 5, 2023
Team Snorkel
Image
Demo: Using Snorkel Flow to train Microsoft Azure Form Recognizer models
Snorkel Flow debuts a new integration with Microsoft Azure Form Recognizer to help organizations leverage Azure AI services.
January 5, 2023
Team Snorkel
Ask Me Anything approach bolsters foundation models banner image
Ask Me Anything approach bolsters foundation models
Researcher Simran Arora tells Snorkel CEO Alex Ratner how she improved foundation model effectiveness by using “Ask Me Anything”-style questions.
January 4, 2023
Team Snorkel
Image
Deepening Snorkel AI’s partnership with Microsoft Azure AI
Snorkel AI is excited to build on our partnership with Microsoft Azure to help enterprises and government agencies solve their most impactful problems and unlock value from their data using AI. Learn how Azure customers can easily deploy Snorkel Flow on their Azure cloud infrastructure to accelerate AI application development with data-centric workflows and programmatic labeling.
November 22, 2022
Henry Ehrenberg