Tag

Data Development

Data development encompasses the processes of curating, organizing, and preparing datasets for use in machine learning and AI projects. This includes data sourcing, cleaning, labeling, and augmenting, ensuring that the data used is high-quality and relevant. Data-centric approaches prioritize the value of data itself, often leading to more reliable and efficient model outcomes.

All articles on Data Development

Image
Why enterprises should embrace LLM distillation
Unlock possibilities for your enterprise with LLM distillation. Learn how distilled, task-specific models boost performance and shrink costs.
February 18, 2025
Shane Johnson
databricks plus snorkel
Databricks + Snorkel Flow: integrated, streamlined AI development
Discover the power of integrating Databricks and Snorkel Flow for efficient data ingestion, labeling, model development, and AI deployment.
January 8, 2025
Bryan Wood
Image
LLM evaluation in enterprise applications: a new era in ML
Learn about the obstacles faced by data scientists in LLM evaluation and discover effective strategies for overcoming them.
November 25, 2024
Matt Casey
Image
AI data development: a guide for data science projects
What is AI data development? AI data development includes any action taken to convert raw information into a format useful to AI.
November 13, 2024
Matt Casey
Image1
SnorkelCon 2024: Inaugural Snorkel AI user conference gathers leaders from 30+ Fortune 500 companies
Discover highlights of Snorkel AI’s first annual SnorkelCon user conference. Explore Snorkel’s programmatic AI data development achievements.
October 22, 2024
Matt Casey
Image
Snorkel Flow 2024.R3: Supercharge your AI development with enhanced data-centric workflows
Snorkel AI has made building production-ready, high-value enterprise AI applications faster and easier than ever. The 2024.R3 update to our Snorkel Flow AI data development platform streamlines data-centric workflows, from easier-than-ever generative AI evaluation to multi-schema annotation.
October 9, 2024
Matt Casey
Image
Task Me Anything: innovating multimodal model benchmarks
“Task Me Anything” empowers data scientists to generate bespoke benchmarks to assess and choose the right multimodal model for their needs.
September 4, 2024
Jieyu Zhang
Image
Alfred: Data labeling with foundation models and weak supervision
Introducing Alfred: an open-source tool for combining foundation models with weak supervision for faster development of academic data sets.
August 27, 2024
Peilin Yu
Image
RAG: LLM performance boost with retrieval-augmented generation
Retrieval-augmented generation (RAG) enables LLMs to produce more accurate responses by finding and injecting relevant context. Learn how.
August 15, 2024
Matt Casey
Image
How data slices transform enterprise LLM evaluation
Enterprises must evaluate LLM performance for production deployment. Custom, automated eval + data slices present the best path to production.
August 1, 2024
Vincent Sunn Chen
Image
Data-centric AI with Snorkel and MinIO
High-performing AI systems require more than a well-designed model. They also require properly constructed training and testing data.
July 12, 2024
Keith Pijanowski (Guest blogger)
Image
Snorkel AI signs strategic collaboration agreement with AWS to help enterprises cross the demo-to-production chasm
To tackle generative AI use cases, Snorkel AI + AWS launched an accelerator program to address the biggest blocker: unstructured data.
June 27, 2024
Team Snorkel
Image
AI alignment made simple: innovative solutions for businesses
AI alignment ensures that AI systems align with human values, ethics, and policies. Here’s a primer on how developers can build safer AI.
June 27, 2024
Fred Sala
Image3
How does the Snorkel Flow label model work?
The Snorkel Flow label model plays an instrumental role in driving the enterprise value we create. Here’s a peek at how it works.
June 18, 2024
Chris Glaze
Image
Vision language models: how LLMs boost image classification
Vision language models demonstrate impressive image classification capabilities, but LLMs can help improve their performance. Learn how.
June 12, 2024
Reza Esfandiarpoor
Image
How to build production-grade RAG retrieval with Snorkel Flow
See a walkthrough of how Snorkel Flow users build applications with production-grade RAG retrieval components.
June 4, 2024
Marty Moesta
Image
Walking safely before building flying saucer seatbelts: introducing Enterprise Alignment
Snorkel takes a step on the path to enterprise superalignment with new data development workflows for enterprise alignment
May 20, 2024
Alex Ratner
,
Chris Glaze
,
Tom Walshe
,
Fred Sala
,
Paroma Varma
,
Hoang Tran
Image
Role-based access controls in Snorkel Flow secure enterprise data
Snorkel Flow’s 2024.R1 release includes new role-based access control tools to further safeguard valuable enterprise data.
May 14, 2024
Daniel Xu
AWS service sagemaker icon
Accelerating AI development in manufacturing with Snorkel Flow and AWS SageMaker
The manufacturing industry has experienced a massive influx of data. Snorkel AI and AWS Sage Maker can make that data actionable.
May 1, 2024
Ryan Gooch (Guest Blogger)
Image
How ROBOSHOT boosts zero-shot foundation model performance
ROBOSHOT acts like a lens on foundation models and improves their zero-shot performance without additional fine-tuning.
April 30, 2024
Dyah Adila
Image
Discover what’s new in Snorkel Flow: Flexible data and LLM connectivity, secure data controls, and more!
Unlock advanced LLM customization with Snorkel Flow’s new release! Explore flexible data integrations, secure controls, and multimodal support to fine-tune language models for enterprise use. Discover how to leverage images and diverse data types for AI-driven insights.
April 24, 2024
Nick Harvey
Image
Faster than ever document intelligence with new Snorkel Flow FM-first workflow
Snorkel Flow’s new FM-first workflow for building document intelligence applications will get you from demo to production faster than ever.
April 24, 2024
Kristina Liapchin
Image
The art of data development for Enterprise LLMs
Snorkel’s Paroma Varma and Google’s Ali Arsenjani discus the role of data in the development and implementation of LLMs.
April 16, 2024
Team Snorkel
Image
Crossing the demo-to-production chasm with Snorkel Custom
We’re excited to announce Snorkel Custom to help enterprises cross the chasm from flashy chatbot demos to real production AI value.
April 11, 2024
Alex Ratner
Image
How we achieved 89% accuracy on contract question answering
A customer wanted an llm system for complex contract question answering tasks. We helped them build it—beating the baseline by 64 points.
April 2, 2024
Minhajul Hoque
Image
Five sessions not to miss at Google Cloud Next 24
Snorkel AI will be at Google Cloud Next. The event will feature more than 700 sessions, so we picked five that we think you shouldn’t miss.
March 27, 2024
Friea Berg
Image
Content filtering breakthrough: Snorkel client reaches 96% recall in 3 days
Snorkel AI helped a client solve the challenge of social media content filtering quickly and sustainably. Here’s how.
March 26, 2024
Gabe Smith
Image
Here’s how Snorkel Flow + Google AI built an enterprise-ready model in a day
Google and Snorkel AI customized PaLM 2 using domain expertise and data development to improve performance by 38 F1 points in a matter of hours.
March 19, 2024
Paroma Varma
,
Ali Arsanjani
Snorkel teams with Microsoft to showcase new AI research at NVIDIA image
Snorkel teams with Microsoft to showcase new AI research at NVIDIA GTC
Microsoft infrastructure facilitates Snorkel AI research experiments, including our recent high rank on the AlpacaEval 2.0 LLM leaderboard.
March 18, 2024
Snorkel Team
Image2
Fine-tuned representation models boost LLM systems. Here’s how
Fine-tuned representation models are often the most effective way to boost the performance of AI applications. Learn why.
March 5, 2024
Trung Nguyen