:Poll What is your preferred LLM to use in your crews?

General
1

Hi everyone,

Being able to track what LLMs are preferred by the crewAI users allow us to understand where our focus should potentially be. Hence there is a poll!

Preferred LLM
  • GPT4o
  • GPT4o-Mini
  • Gemini 1.5 Pro
  • Claude Sonnet 3.5
  • Llama 3.5 8B
  • Llama 3.5 70B
  • Llama 3.5 405B
  • Other
0 voters
2

I assume you mean Llama 3.1 and not 3.5

1 Like
3

Great catch but unfortunately we cannot change after it has been up for 5 minutes

1 Like
4

This is additional work but I think it would be informative to ask about llm’s for what purpose. I use gpt4omini
for general inference a lot but have to use gpt4o for a planning llm because I can never get a decent plan out of gpt4omini. For vision rag, etc I always use gemini 1.5 flash because it has a 1M token context and is of course multimodal and not too expensive. Even there though I use gemini 1.5 pro to do planning llm work as it does a better job.

5

When considering such as hierachichal/planned processes I have found that Phi3-medium & to some extent Phi3-mini have far greater reasoning skills than other LLMs.
While still relatively new to CrewAI I find that choosing the right LLM for the Agent within a multi agent system as apposed to defaulting to one provides far better results. E.G: manger_llm == Phi3, general agent default to GTP4omini, etc.

6

I use multiple. Each best per task in the same crew