# Nineteenai doesnt work with the usual llm setup code

**URL:** <https://community.crewai.com/t/nineteenai-doesnt-work-with-the-usual-llm-setup-code/3892>\
**Category:** LLMs\
**Tags:** llama-31-8b\
**Created:** [February 16, 2025, 6:20pm UTC](https://community.crewai.com/t/nineteenai-doesnt-work-with-the-usual-llm-setup-code/3892 "2025-02-16T18:20:23Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![Ren\_Kaizel](https://sea1.discourse-cdn.com/flex025/user_avatar/community.crewai.com/ren_kaizel/32/2609_2.png) [@Ren\_Kaizel](https://community.crewai.com/u/Ren_Kaizel)\
**Post date:** [February 16, 2025, 6:20pm UTC](https://community.crewai.com/t/nineteenai-doesnt-work-with-the-usual-llm-setup-code/3892/1 "2025-02-16T18:20:23Z")

</div>

NineteenAI gives free access to Lllama 70B which is what im trying to use. The api and stuff can be found here:

[NineteenAI | Decentralised Inference.](https://nineteen.ai/app/model/chat-llama-3-1-70b)

(I have given the specific error below, but its basically that i cannot set up the llm)

This is what i was trying to do:

```
@CrewBase
class AiNews():
	"""AiNews crew"""
	agents_config = 'config/agents.yaml'
	tasks_config = 'config/tasks.yaml'
	llm = LLM(
		api_key="rayon_ ****** 643iy5YauprMqfjJM9tbV",
    	base_url="https://api.nineteen.ai/v1",
		model = "hugging-quants/Meta-Llama-3.1-70B-Instruct-AWQ-INT4",
		)

@agent
def retrieve_news(self) -> Agent:
	return Agent(
		config=self.agents_config['retrieve_news'],
		tools = [SerperDevTool()],
		verbose=True,
		llm = self.llm
	)

@agent
def website_scraper(self) -> Agent:
	return Agent(
		config=self.agents_config['website_scraper'],
		tools=[ScrapeWebsiteTool()],
		verbose=True,
		llm= self.llm
	)

```

The rest of the code is like the usual default poem crew from crewai.

The error being recieved is basically this:

```
litellm.exceptions.BadRequestError: litellm.BadRequestError: LLM Provider NOT provided. Pass in the LLM provider you are trying to call. You passed model=hugging-quants/Meta-Llama-3.1-70B-Instruct-AWQ-INT4

```

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/flex025/uploads/crewai/original/1X/ecda97e72f77c7100e0a761444b1c991925cc789.png) [@system](https://community.crewai.com/u/system)\
**Post date:** [March 18, 2025, 6:20pm UTC](https://community.crewai.com/t/nineteenai-doesnt-work-with-the-usual-llm-setup-code/3892/2 "2025-03-18T18:20:31Z")

</div>

This topic was automatically closed after 30 days. New replies are no longer allowed.