We are going to deploy multi-agents, One of them is the image classficiation using our model. Is it possible?
@Russell_Johnson CrewAI LLM
class leverages LiteLLM in the background. Whatever LiteLLM supports, you can use with CrewAI. See the full list of LLM providers that LiteLLM supports. So, if you can run your LLM through any of the LiteLLM listed providers, you’re good to go.
Here’s an example from the CrewAI docs on how to use the LLM
class:
from crewai import LLM
my_llm = LLM(
model="custom-model-name",
base_url="https://api.your-provider.com/v1",
api_key="your-api-key"
)
my_agent = Agent(
...,
llm=my_llm,
)