PrimrIQ
GenAIOpenAdvanced

Build a RAG that refuses to hallucinate

900 pages, 60 questions, 12 with no answer in the corpus. Score points for saying "I don't know."

Time needed
2 weeks
Corpus
900 pages

The brief

Anyone can wire a retriever to a model. This challenge scores whether your system knows when to say it does not know. You get the corpus, an eval set with unanswerable questions planted in it, and a cost ceiling per query. Chunking strategy, reranking and refusal behaviour are where entries separate.

What you submit

  • A runnable RAG pipeline with your retrieval configuration documented
  • Eval results on the provided question set, including the unanswerable ones
  • A short note on cost per query and what you traded away for it

How to participate

  1. Register free: create your account and tell us a little about yourself.
  2. Clone the starter repo and download the corpus.
  3. Build, evaluate, and keep your cost per query under the ceiling.
  4. Submit the repo link; mentors run your eval script themselves.

How it’s judged

  • Refusal accuracy on unanswerable questions
  • Retrieval precision
  • Cost per query
  • Reproducibility

What you walk away with

Feedback for every entry · Top 3 win a full flagship seat

Resources

Everything you need, in one zipThe dataset, the full brief and the guides for this challenge.Register free to unlock

Want the full track behind this brief?

Generative AI Engineering — production-shaped projects.

Explore GenAI Engineering →

Build a RAG that refuses to hallucinate
Register to unlock the resources.