# CrewAI multimodal Capability

**URL:** <https://community.crewai.com/t/crewai-multimodal-capability/5481>\
**Category:** CrewAI Community Support\
**Created:** [April 24, 2025, 10:53am UTC](https://community.crewai.com/t/crewai-multimodal-capability/5481 "2025-04-24T10:53:49Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![Aashay\_Kulkarni](https://sea1.discourse-cdn.com/flex025/user_avatar/community.crewai.com/aashay_kulkarni/32/3486_2.png) [@Aashay\_Kulkarni](https://community.crewai.com/u/Aashay_Kulkarni)\
**Post date:** [April 24, 2025, 10:53am UTC](https://community.crewai.com/t/crewai-multimodal-capability/5481/1 "2025-04-24T10:53:49Z")

</div>

Hello Everyone!

I wanted to analyze screenshots for its visual cues and elements, can the vision tool help in this or is it just a kind of OCR that can extract only text from images. Also, does the multimodal mode work now with image links? Did someone try it? If yes, with which llm did it work? I saw some people commenting that it doesn’t work. I want to replicate how when we put an image in Chatgpt and ask it to analyze image, It can do it to a detail of which buttons are there what color is used.

Please let me know.

Thanks!

---

<div class="post-metadata">

**Author:** ![tonykipkemboi](https://sea1.discourse-cdn.com/flex025/user_avatar/community.crewai.com/tonykipkemboi/32/4070_2.png) [@tonykipkemboi](https://community.crewai.com/u/tonykipkemboi)\
**Post date:** [April 24, 2025, 3:46pm UTC](https://community.crewai.com/t/crewai-multimodal-capability/5481/2 "2025-04-24T15:46:39Z")

</div>

Hi @Aashay_Kulkarni,

Thank you for joining the CrewAI community and for asking the question.

You can use the **multimodal=True** parameter in your agent class definition like this example:

```python
from crewai import Agent, Task, Crew, Process, LLM
from crewai.tasks.task_output import TaskOutput
import os, json
import datetime

llm = LLM(model="gemini/gemini-1.5-flash", temperature=0)

# Define a multimodal agent with vision capabilities
researcher = Agent(
    role="Product Quality Inspector",
    goal="Analyze product {image} and report on quality attributes",
    backstory="Senior visual inspector with extensive industry knowledge in product quality inspection",
    llm=llm,
    multimodal=True,
    verbose=True
)

# Create a task that involves image analysis
task = Task(
    description="Analyze the product image at {image} and provide a detailed report",
    expected_output="A detailed report on quality assessment with today's {date}.",
    agent=researcher
)

# Assemble the crew and execute tasks sequentially
crew = Crew(
    agents=[researcher],
    tasks=[task],
    process=Process.sequential,
    verbose=True
)

inputs = {
    'image': 'https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhL0ZIm6wh06croVC6i2mo_vWm6MDYZPgd5h0jXQGB13-4Z1ugRQD5OuF9HnZEOfe6mC_62S_bPiOIocO1ljytrOfwxNsOynJO8TYzJw31NkfG4cVwOJ-kKnrTBtZ_wC2A3YuAdaVOO7YA/s1600/broken+cup+2.jpg',
    'date': datetime.datetime.now().strftime("%Y-%m-%d")
}

result = crew.kickoff(inputs=inputs)
print(result)

```

You can try it here in colab: [Google Colab](https://colab.research.google.com/drive/12F44BfxZJ-822aqNKoeY0HIENkUwYS5q?usp=sharing)

---

<div class="post-metadata">

**Author:** ![Aashay\_Kulkarni](https://sea1.discourse-cdn.com/flex025/user_avatar/community.crewai.com/aashay_kulkarni/32/3486_2.png) [@Aashay\_Kulkarni](https://community.crewai.com/u/Aashay_Kulkarni)\
**Post date:** [April 25, 2025, 7:17am UTC](https://community.crewai.com/t/crewai-multimodal-capability/5481/3 "2025-04-25T07:17:58Z")

</div>

Hi @tonykipkemboi ! Does it work with every multimodal llm or just with gemini?

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/flex025/uploads/crewai/original/1X/ecda97e72f77c7100e0a761444b1c991925cc789.png) [@system](https://community.crewai.com/u/system)\
**Post date:** [April 26, 2025, 7:18am UTC](https://community.crewai.com/t/crewai-multimodal-capability/5481/4 "2025-04-26T07:18:35Z")

</div>

This topic was automatically closed 24 hours after the last reply. New replies are no longer allowed.

---

<div class="post-metadata">

**Author:** ![tonykipkemboi](https://sea1.discourse-cdn.com/flex025/user_avatar/community.crewai.com/tonykipkemboi/32/4070_2.png) [@tonykipkemboi](https://community.crewai.com/u/tonykipkemboi)\
**Post date:** [April 26, 2025, 10:39pm UTC](https://community.crewai.com/t/crewai-multimodal-capability/5481/5 "2025-04-26T22:39:49Z")

</div>

it should work with any multimodal llm. haven’t tried all though.