I am using my local Ollama server hosted in my premises. How can we use MDXSearchTool without using OPEN API KEY.
@rajuvs1974 OpenAI API key is needed because OpenAI’s models are used by default.
But you can customize the MDXSearchTool
as follows:
tool = MDXSearchTool(
config=dict(
llm=dict(
provider="ollama", # Options include google, openai, anthropic, llama2, etc.
config=dict(
model="llama2",
# Optional parameters can be included here.
# temperature=0.5,
# top_p=1,
# stream=true,
),
),
embedder=dict(
provider="google", # or openai, ollama, ...
config=dict(
model="models/embedding-001",
task_type="retrieval_document",
# Optional title for the embeddings can be added here.
# title="Embeddings",
),
),
)
)
See the official docs.
1 Like
@rokbenko hello, how can we use MDXSearchTool with AZURE OPENAI.
I’ve tried many methods but none of them seem to work very well.
So I have been doing this too often that maybe someone else is too. If you cut and paste it’s great. But when I was typing I was doing:
MDXSearchTool(config=…, embedder=…) instead of having the embedder in the config. doh
This topic was automatically closed 24 hours after the last reply. New replies are no longer allowed.