Tag

Data Development

Data development encompasses the processes of curating, organizing, and preparing datasets for use in machine learning and AI projects. This includes data sourcing, cleaning, labeling, and augmenting, ensuring that the data used is high-quality and relevant. Data-centric approaches prioritize the value of data itself, often leading to more reliable and efficient model outcomes.

All articles on Data Development

Image2
Enterprise GenAI to surge in 2024: survey results
Enterprise GenAI 2024: applications will likely surge toward production, according to Snorkel AI Enterprise LLM Summit survey results .
February 29, 2024
•
Matt Casey
LLM distillation demystified: a complete guide
LLM distillation isolates task-specific LLM performance and mirrors it in a smaller format—creating faster and cheaper performance.
February 13, 2024
•
Matt Casey
Image1
Enterprises must shift their focus from models to data in AI development
Snorkel AI CEO Alex Ratner explains his view on the importance of AI in data development and illustrates his position with two case studies.
February 9, 2024
•
Alex Ratner
Image1
Insurance’s GenAI revolution: a business perspective
Snorkel CEO Alex Ratner talks with QBE Ventures’ Alex Taylor about the future of AI, LLMs and multimodal models in the insurance industry.
February 6, 2024
•
Team Snorkel
Image1
Scaling human preferences in AI: Snorkel’s programmatic approach
We’ve developed new approaches to scale human preferences and align LLM output to enterprise users’ expectations by magnifying SME impact.
January 31, 2024
•
Hoang Tran
Building better enterprise AI: incorporating expert feedback in system development banner
Building better enterprise AI: incorporating expert feedback in system development
Enterprises that aim to build valuable GenAI applications must view them from a systems-level. LLMs are just one part of an ecosystem.
January 30, 2024
•
Chris Glaze
Image
“Fall in love with your data”—Snorkel AI’s Enterprise LLM Summit
Snorkel AI’s Jan. 25 Enterprise LLM Summit focused on one theme: AI data development drives enterprise AI success.
January 26, 2024
•
Snorkel Team
Image1
Why QBE Ventures invested in Snorkel AI
QBE Ventures made a strategic investment in Snorkel AI because it provides what Insurers need: scalable and affordable ways to customize AI.
January 25, 2024
•
Alex Taylor
,
Lynn Thompson
,
Daniel Wypler
Image
New benchmark results demonstrate value of Snorkel AI approach to LLM alignment
Snorkel researchers’ state-of-the-art methods created a 7B LLM that ranked 2nd, behind only GPT-4 Turbo, on AlpacaEval 2.0 leaderboard.
January 24, 2024
•
Cate Lochead
Image
Retrieval augmented generation (RAG): a conversation with its creator
Snorkel CEO Alex Ratner spoke with Douwe Keila, an author of the original paper about retrieval augmented generation (RAG).
January 16, 2024
•
Team Snorkel
Image2
Snorkel Flow 2023.R4: enhanced UI + PDF and Databricks tools
New unified prompting UI + RAG features, PDF annotation, Databricks MLflow integration, Snorkel Flow Studio, and datasets load 2x faster!
January 9, 2024
•
Nick Harvey
How Snorkel Flow users can register custom models to Databricks
How Snorkel Flow users can register custom models to Databricks
The Databricks Model Registry integration equips Snorkel Flow users to automatically register custom, use case-specific models.
January 9, 2024
•
Hiromu Hota
Image
Stanford professor discusses exciting advances in foundation model evaluation
Snorkel CEO Alex Ratner chatted with Stanford Professor Percy Liang about evaluation in machine learning and in AI generally.
January 2, 2024
•
Team Snorkel
Image2
First cohort of Snorkel GenAI customers sees gains up to 54 points
In its first six months, Snorkel Foundry collaborated on high-value projects with notable companies and produced impressive results.
December 20, 2023
•
Marty Moesta
Image
How to tackle advanced classification challenges using Snorkel Flow
When done right, advanced classification applications cultivate business value and automation, unlock new business lines, and reduce costs.
December 14, 2023
•
Vincent Sunn Chen
Image
How to scale chatbot development with Google Dialogflow and Snorkel Flow
A brief guide on how financial institutions could use Google Dialogflow with Snorkel Flow to build better chatbots for retail banking
December 12, 2023
•
Sean Earley
Image
How predictive AI + generative AI build amazing document understanding
A proof-of-concept project that combines predictive AI + generative AI to minimize LLM’s risks while keeping their advantages.
December 5, 2023
•
Shahebaz Mohammad
Image
How to fine-tune Llama 2 in Snorkel Flow
Data scientists can fine-tune Llama 2 to adapt it to specific tasks. The Snorkel Flow data development platform makes it easy to do so.
November 28, 2023
•
Hoang Tran
Image1
Enterprise LLM challenges and how to overcome them
Large language models open many new opportunities for data science teams, but enterprise LLM challenges persist—and customization is key.
November 16, 2023
•
Hoang Tran
Image6
Snorkel Flow 2023.R3 release: PaLM integration, streamlined onboarding, and enhanced user experience
The 2023.R3 Snorkel Flow release is packed with improvements that amplify user experience, streamline workflows, and enhance performance, ensuring our users derive unparalleled value from our platform.
November 1, 2023
•
Nick Harvey
Image1
Navigating Biden’s AI executive order with AI data development
The Biden administration issued an executive order that creates new AI standards and challenges. AI data development can help.
October 31, 2023
•
Vinny Corsi
Image1
Snorkel AI researchers present 18 papers at NeurIPS 2023
The Snorkel AI team will present 18 research papers and talks at the 2023 Neural Information Processing Systems (NeurIPS) conference from December 10-16. The Snorkel papers cover a broad range of topics including fairness, semi-supervised learning, large language models (LLMs), and domain-specific models. Snorkel AI is proud of its roots in the research community and endeavors to remain at the forefront
October 31, 2023
•
Team Snorkel
Image1
Two approaches to distill LLMs for better enterprise value
Distillation techniques allow enterprises to access the full predictive power of large language models at a tiny fraction of their cost.
October 31, 2023
•
Jason Fries
Image1
Enterprise LLM Summit highlights the importance of data development
Snorkel AI’s Enterprise LLM Virtual Summit drew 1,000 attendees with speakers from Contextual AI, Google, Meta, Stanford, and Together AI.
October 27, 2023
•
Matt Casey
Image
How AI-powered claims processing creates new efficiencies in insurance
Insurance claims processing has long required a lot of tedious and expensive human labor, but artificial intelligence (AI) can help.
October 18, 2023
•
Team Snorkel
Image
How to fine-tune GPT-3.5 Turbo in Snorkel Flow
Snorkel Flow makes it easy to fine tune LLMs like GPT-3.5 Turbo to work better for specific domain and enterprise requirements.
October 13, 2023
•
Hoang Tran
Image
Watch all Future of Data-Centric AI 2023 videos now!
Sessions at the Future of Data-Centric AI covered LLMs, gen AI, and more. All recordings are now publicly available. See them here!
October 12, 2023
•
Team Snorkel
Image1
Standard LLMs are not enough. How to make them work for your business
Most data science leaders expect to customize LLMS, but the process of making LLMs work for your business is still a fresh challenge.
October 6, 2023
•
Kristina Liapchin
Image1
How AI facilitates more fair and accurate credit scoring
Ai and ML offer new avenues for credit scoring solutions and could usher in a new era of fairness, efficiency, and risk management.
October 4, 2023
•
Team Snorkel
data labeling image
Data labeling: a practical guide (2024)
Data labeling remains a core requirement for machine learning projects—especially in the age of genAI and LLMs. Here’s a handy guide.
September 29, 2023
•
Matt Casey