Hi, I am trying to use a local knowledge source like the TextFileKnowledgeSource together with an Agent using the llama3.2 model. llm = LLM(model="ollama/llama3.2", base_url="http://localhost:11434") ks = TextFileKnowledgeSource( file_path="user_preference.txt", metadata={"foo": "bar"}…

I think I found a solution. I need to do two things: Configure the LLM with the pretty low temperature. Not sure why this is the reason, but I guess with higher temperature the model tends to be more creative on its own model. Actually tell the agent in his configuration (goal) to make use of his …

Hey Torsten! As you’ve experienced, lower temperature should be better on embedding/RAG related projects where we need the information correctly. Here’s the explanation of temperature from OpenAI’s documents: “What sampling temperature to use, between 0 and 2. Higher values like 0.8 will make the …

Hey Ali, Thank you for your answer. Since crewai uses chroma as application db to make knowledge available to the LLM I found Chroma Docs useful for a start. At least I was able to find the configuration there.

Hi, Do you have a sample code on how you got the embedding working using ollama model? I have a custom knowledge source that I have created in my application. On creating the crew, like this crew = Crew( agents=[json_analyst, summarizer_agent], tasks=[ analysis_task, summary_task], verbose=Tru…

Hi @Anusha09 Did you managed to solve your issue? Regards,

Yes, using newer version of crewai helped.

Embedder allows you to use your choice of embedding models. The default is OPENAI. Here’s an example for Ollama: from crewai import Agent, Task, Crew, Process, LLM from crewai.knowledge.source.string_knowledge_source import StringKnowledgeSource # Create a knowledge source content = "Users name …

[image] tonykipkemboi: embedder={ "provider": "ollama", "config": { "model": "nomic-embed-text", "api_key": "" } I tried implementing this and I got an error. from crewai import Crew, Process embedder_config_ollama={ "provider": "ollama…

Issue: Trouble Using Knowledge Feature with Google Gemini Free Tier in CrewAI Hi everyone, I’m trying to use the Knowledge feature in CrewAI with the Google Gemini free-tier model as the embedder. However, I’m encountering a couple of issues: Initially, when running my crew via uv run --active …

How to embed knowledge source with ollama2

CrewAI Community Support

kapenge January 15, 2025, 5:06pm 8

Without any code adjustment?

Failing to embed knowledge source using ollama

Topic		Replies	Views
Failing to embed knowledge source using ollama CrewAI Community Support	4	742	June 12, 2025
Custom knowledge source embedding failing for local Ollama model General	3	698	January 8, 2025
Problem with Ollama and knowledge usage Crews memory	3	184	August 12, 2025
Custom knowledge source not working for Crew and Agents CrewAI Community Support agent , crewai	2	384	February 24, 2025
CrewAI is not allowing the use of a knowledge source when using an Ollama-based LLM. It defaults to requiring an OpenAI API key, even though Ollama is correctly configure General openai , agent , crewai	6	978	February 6, 2025

How to embed knowledge source with ollama2

Related topics