Use Case: Configuring LLM with Azure API Management

Crews
, ,
1

Hi,

My current LLM configuration with azure open ai is:

llm = AzureChatOpenAI(  
    openai_api_version=os.environ.get('AZURE_OPENAI_API_VERSION'),  
    azure_deployment=os.environ.get('azure_deployment'),  
    azure_endpoint=os.environ.get('azure_endpoint'),  
    api_key=openai_api_key,  
    max_tokens=4096,  
    temperature=0.6,  
)

I want to use Azure API Management to orchestrate between multiple Azure endpoints. I have already tested it in Postman, and it works with the API Management URL and the Ocp-Apim-Subscription-Key .

I need help configuring this with crewai . Pls help me. Thx

2

Sound like you would need to create a custom tools to connect to azure API

1 Like