deepset’s Post

deepset reposted this

View profile for Bilge Yücel, graphic

Developer Relations Engineer at deepset

🚀 Benchmarking RAG Pipelines for Optimal Performance! The latest article by David S. Batista, PhD, breaks down step-by-step instructions to evaluate and optimize your RAG pipeline's performance using Haystack, complete with detailed benchmarking against the ARAGOG dataset. 🌟 Key Highlights: - Explore three different Haystack pipelines: indexing, RAG, and evaluation. - Gain insights from the “ARAGOG: Advanced RAG Output Grading” dataset. - Learn how to fine-tune parameters like top_k, embedding_model, and chunk_size. - Discover the best-performing combinations for context relevance, faithfulness, and semantic answer similarity - Detailed analysis and lessons learned to help you achieve the best performance for your use case Read the full article 👉 https://lnkd.in/d-2NmawF #rag #opensource #evaluation #haystack

  • No alternative text description for this image
Tom Aarsen

🤗 Sentence Transformers, SetFit & NLTK maintainer, MLE @ Hugging Face

3w

This is extremely useful, great job David S. Batista, PhD

Stefano Fiorucci

Contributing to Haystack, the LLM Framework 🏗️ | NLP Engineer, Craftsman and Explorer 🧭

3w

Sound and thorough work, but also pragmatic. Well done, David!

See more comments

To view or add a comment, sign in

Explore topics