:Poll What is your preferred LLM to use in your crews?

Hi everyone,

Being able to track what LLMs are preferred by the crewAI users allow us to understand where our focus should potentially be. Hence there is a poll!

Preferred LLM
  • GPT4o
  • GPT4o-Mini
  • Gemini 1.5 Pro
  • Claude Sonnet 3.5
  • Llama 3.5 8B
  • Llama 3.5 70B
  • Llama 3.5 405B
  • Other
0 voters

I assume you mean Llama 3.1 and not 3.5

1 Like

Great catch but unfortunately we cannot change after it has been up for 5 minutes

1 Like

This is additional work but I think it would be informative to ask about llm’s for what purpose. I use gpt4omini
for general inference a lot but have to use gpt4o for a planning llm because I can never get a decent plan out of gpt4omini. For vision rag, etc I always use gemini 1.5 flash because it has a 1M token context and is of course multimodal and not too expensive. Even there though I use gemini 1.5 pro to do planning llm work as it does a better job.

When considering such as hierachichal/planned processes I have found that Phi3-medium & to some extent Phi3-mini have far greater reasoning skills than other LLMs.
While still relatively new to CrewAI I find that choosing the right LLM for the Agent within a multi agent system as apposed to defaulting to one provides far better results. E.G: manger_llm == Phi3, general agent default to GTP4omini, etc.

I use multiple. Each best per task in the same crew