I managed to solve it as follows:
claude_llm = LLM( model="claude-3-5-sonnet-20240620", base_url="https://api.anthropic.com", max_tokens=4000, api_key=os.environ["ANTHROPIC_API_KEY"]
However, after running the crew I got:
Traceback (most recent call last): File "<string>", line 1, in <module> File "/Users/gerasimosplegas/tierly/src/tierly/main.py", line 17, in run TierlyCrew().crew().kickoff(inputs=inputs) File "/Users/gerasimosplegas/Library/Caches/pypoetry/virtualenvs/tierly-eXmYQ2Lr-py3.11/lib/python3.11/site-packages/crewai/crew.py", line 490, in kickoff result = self._run_sequential_process() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/gerasimosplegas/Library/Caches/pypoetry/virtualenvs/tierly-eXmYQ2Lr-py3.11/lib/python3.11/site-packages/crewai/crew.py", line 594, in _run_sequential_process return self._execute_tasks(self.tasks) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/gerasimosplegas/Library/Caches/pypoetry/virtualenvs/tierly-eXmYQ2Lr-py3.11/lib/python3.11/site-packages/crewai/crew.py", line 692, in _execute_tasks task_output = task.execute_sync( ^^^^^^^^^^^^^^^^^^ File "/Users/gerasimosplegas/Library/Caches/pypoetry/virtualenvs/tierly-eXmYQ2Lr-py3.11/lib/python3.11/site-packages/crewai/task.py", line 191, in execute_sync return self._execute_core(agent, context, tools) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/gerasimosplegas/Library/Caches/pypoetry/virtualenvs/tierly-eXmYQ2Lr-py3.11/lib/python3.11/site-packages/crewai/task.py", line 255, in _execute_core task_output = TaskOutput( ^^^^^^^^^^^ File "/Users/gerasimosplegas/Library/Caches/pypoetry/virtualenvs/tierly-eXmYQ2Lr-py3.11/lib/python3.11/site-packages/pydantic/main.py", line 212, in __init__ validated_self = self.__pydantic_validator__.validate_python(data, self_instance=self) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ pydantic_core._pydantic_core.ValidationError: 1 validation error for TaskOutput json_dict Input should be a valid dictionary [type=dict_type, input_value="The JSON you provided is...ready to be used as is.", input_type=str] For further information visit https://errors.pydantic.dev/2.9/v/dict_type
This is not the case with other OAI models.