Tag

NLP

Natural Language Processing (NLP) is the branch of AI that enables machines to understand, interpret, and generate human language. NLP applications include chatbots, virtual assistants, sentiment analysis, document processing, and more. Effective NLP models rely on high-quality text data and annotations.

All articles on NLP

Image
Snorkel Flow 2024.R3: Supercharge your AI development with enhanced data-centric workflows
Snorkel AI has made building production-ready, high-value enterprise AI applications faster and easier than ever. The 2024.R3 update to our Snorkel Flow AI data development platform streamlines data-centric workflows, from easier-than-ever generative AI evaluation to multi-schema annotation.
October 9, 2024
Matt Casey
Image
New NLP features in Snorkel Flow 2024.R3
Discover new NLP features in Snorkel Flow\’s 2024.R3 release, including named entity recognition for PDFs + advanced sequence tagging tools.
October 9, 2024
Jennifer Lei
Image
Call center AI for customer experience management: a case study
How one large financial institution used call center AI to inform customer experience management with real-time data.
August 14, 2024
Maxwell Williams
Image
Data-centric AI with Snorkel and MinIO
High-performing AI systems require more than a well-designed model. They also require properly constructed training and testing data.
July 12, 2024
Keith Pijanowski (Guest blogger)
Image
Weak supervision for non-categorical applications + superalignment
We need more labeled data than ever, so we have explored weak supervision for non-categorical applications—with notable results.
July 2, 2024
Changho Shin
Image
AI alignment made simple: innovative solutions for businesses
AI alignment ensures that AI systems align with human values, ethics, and policies. Here’s a primer on how developers can build safer AI.
June 27, 2024
Fred Sala
Image
Vision language models: how LLMs boost image classification
Vision language models demonstrate impressive image classification capabilities, but LLMs can help improve their performance. Learn how.
June 12, 2024
Reza Esfandiarpoor
Image1
Long context models in the enterprise: benchmarks and beyond
Snorkel researchers devised a new way to evaluate long context models and address their “lost-in-the-middle” challenges with mediod voting.
June 6, 2024
Amanda Dsouza
Image
How to build production-grade RAG retrieval with Snorkel Flow
See a walkthrough of how Snorkel Flow users build applications with production-grade RAG retrieval components.
June 4, 2024
Marty Moesta
Image
How Bonito helps fine-tune specialized LLMs faster than ever
Fine-tuning specialized LLMs demands a lot of time and cost We developed Bonito to make this process faster, cheaper, and easier.
May 28, 2024
Nihal Nayak
Image
Walking safely before building flying saucer seatbelts: introducing Enterprise Alignment
Snorkel takes a step on the path to enterprise superalignment with new data development workflows for enterprise alignment
May 20, 2024
Alex Ratner
,
Chris Glaze
,
Tom Walshe
,
Fred Sala
,
Paroma Varma
,
Hoang Tran
Image
How ROBOSHOT boosts zero-shot foundation model performance
ROBOSHOT acts like a lens on foundation models and improves their zero-shot performance without additional fine-tuning.
April 30, 2024
Dyah Adila
Image
Faster than ever document intelligence with new Snorkel Flow FM-first workflow
Snorkel Flow’s new FM-first workflow for building document intelligence applications will get you from demo to production faster than ever.
April 24, 2024
Kristina Liapchin
Image
The art of data development for Enterprise LLMs
Snorkel’s Paroma Varma and Google’s Ali Arsenjani discus the role of data in the development and implementation of LLMs.
April 16, 2024
Team Snorkel
Image
Crossing the demo-to-production chasm with Snorkel Custom
We’re excited to announce Snorkel Custom to help enterprises cross the chasm from flashy chatbot demos to real production AI value.
April 11, 2024
Alex Ratner
Image1
How Snorkel topped the AlpacaEval leaderboard (and why we’re not there anymore)
Snorkel AI placed a model at the top of the AlpacaEval leaderboard. Here’s how we built it, and how it changed AlpacaEval’s metrics.
April 9, 2024
Hoang Tran
Image1
CRFM’s HELM and enterprise LLM evaluation beyond accuracy
As Snorkel AI prepares to build better enterprise LLM evaluations, we spoke with Yifan Mail from Stanford’s CRFM HELM project.
April 3, 2024
Vivek Krishnamurthy
Image
How we achieved 89% accuracy on contract question answering
A customer wanted an llm system for complex contract question answering tasks. We helped them build it—beating the baseline by 64 points.
April 2, 2024
Minhajul Hoque
Image
Content filtering breakthrough: Snorkel client reaches 96% recall in 3 days
Snorkel AI helped a client solve the challenge of social media content filtering quickly and sustainably. Here’s how.
March 26, 2024
Gabe Smith
Image
Here’s how Snorkel Flow + Google AI built an enterprise-ready model in a day
Google and Snorkel AI customized PaLM 2 using domain expertise and data development to improve performance by 38 F1 points in a matter of hours.
March 19, 2024
Paroma Varma
,
Ali Arsanjani
Image
How Skill-it! enables faster, better LLM training
Humans learn tasks better when taught in a logical order. So do LLMs. Researchers developed a way to exploit this tendency called “Skill-it!”
March 12, 2024
Fred Sala
Image2
Fine-tuned representation models boost LLM systems. Here’s how
Fine-tuned representation models are often the most effective way to boost the performance of AI applications. Learn why.
March 5, 2024
Trung Nguyen
Image2
Enterprise GenAI to surge in 2024: survey results
Enterprise GenAI 2024: applications will likely surge toward production, according to Snorkel AI Enterprise LLM Summit survey results .
February 29, 2024
Matt Casey
Image2
Large language model training: three phases that shape LLM training
Training large language models is a multi-layered stack of processes, each with its unique role and contribution to the model’s performance.
February 27, 2024
Stephen Bach
Image4
LoRA: Low-Rank Adaptation for LLMs
Low-rank adaptation (LoRA) lets data scientists customize GenAI models like LLMs faster than traditional full fine-tuning methods.
February 21, 2024
Matt Casey
LLM distillation demystified: a complete guide
LLM distillation isolates task-specific LLM performance and mirrors it in a smaller format—creating faster and cheaper performance.
February 13, 2024
Matt Casey
Image1
Enterprises must shift their focus from models to data in AI development
Snorkel AI CEO Alex Ratner explains his view on the importance of AI in data development and illustrates his position with two case studies.
February 9, 2024
Alex Ratner
Image1
Insurance’s GenAI revolution: a business perspective
Snorkel CEO Alex Ratner talks with QBE Ventures’ Alex Taylor about the future of AI, LLMs and multimodal models in the insurance industry.
February 6, 2024
Team Snorkel
Image1
Scaling human preferences in AI: Snorkel’s programmatic approach
We’ve developed new approaches to scale human preferences and align LLM output to enterprise users’ expectations by magnifying SME impact.
January 31, 2024
Hoang Tran
Building better enterprise AI: incorporating expert feedback in system development banner
Building better enterprise AI: incorporating expert feedback in system development
Enterprises that aim to build valuable GenAI applications must view them from a systems-level. LLMs are just one part of an ecosystem.
January 30, 2024
Chris Glaze