New Model just dropped, Dolphin3.0-R1-Mistral!
And you can use it with CrewAI! and its FREE! we like free and LOCAL, we like local too!
Its in GGUF format so
You run it using Ollama or LM Studio!
Command
ollama run hf.co/bartowski/cognitivecomputations_Dolphin3.0-R1-Mistral-24B-GGUF:Q5_K_S
Its a large model, 24B should work very well if you have a beefy machine!
bartowski
/
cognitivecomputations_Dolphin3.0-R1-Mistral-24B-GGUF