Title: How to Detect AI Hallucinations with CrewAI and Opik
URL: https://www.youtube.com/watch?v=IJ_Bb0Vmve8
Channel: Lorenze Jay (@Lorenze_Jay)
Summary: Check this out if you want to evaluate your AI agents in CrewAI and catch those annoying hallucinations: the trick is to use CrewAI’s event listeners along with Comet’s Opik library. Basically, you set up a listener that kicks in whenever a task finishes, grabbing all the details – like the description, output, context, and even the tool calls. Then, you feed that data into Opik, which gives you a quality score and suggestions for improvement. And the coolest part? It’ll tell you if any hallucinations popped up by comparing the agent’s response against the context it was given. It’s super flexible and open-source, so you can tweak it for whatever task or workflow you’re running.
4 Likes
Great content as usual from Lorenze 
1 Like