Unable to run MDXSearchTool without OpenAI API key

I am using my local Ollama server hosted in my premises. How can we use MDXSearchTool without using OPEN API KEY.

@rajuvs1974 OpenAI API key is needed because OpenAI’s models are used by default.

But you can customize the MDXSearchTool as follows:

tool = MDXSearchTool(
    config=dict(
        llm=dict(
            provider="ollama", # Options include google, openai, anthropic, llama2, etc.
            config=dict(
                model="llama2",
                # Optional parameters can be included here.
                # temperature=0.5,
                # top_p=1,
                # stream=true,
            ),
        ),
        embedder=dict(
            provider="google", # or openai, ollama, ...
            config=dict(
                model="models/embedding-001",
                task_type="retrieval_document",
                # Optional title for the embeddings can be added here.
                # title="Embeddings",
            ),
        ),
    )
)

See the official docs.

1 Like

@rokbenko hello, how can we use MDXSearchTool with AZURE OPENAI.
I’ve tried many methods but none of them seem to work very well.

So I have been doing this too often that maybe someone else is too. If you cut and paste it’s great. But when I was typing I was doing:

MDXSearchTool(config=…, embedder=…) instead of having the embedder in the config. doh

This topic was automatically closed 24 hours after the last reply. New replies are no longer allowed.