Amazon Nova Lite vs Mistral Small 3.1 (25.03)

Amazon just launched Nova 2 Lite models on Bedrock.

Now, you can use those models directly with Claude Code, and set automatic preferences on when to invoke the model for specific coding scenarios. Sample config below. This way you can mix/match different models based on coding use cases. Details in the demo folder here: [https://github.com/katanemo/archgw/tree/main/demos/use\_cases/claude\_code\_router](https://github.com/katanemo/archgw/tree/main/demos/use_cases/claude_code_router)

if you think this is useful, then don't forget to the star the project 🙏

# Anthropic Models
- model: anthropic/claude-sonnet-4-5
access_key: $ANTHROPIC_API_KEY
routing_preferences:
- name: code understanding
description: understand and explain existing code snippets, functions, or libraries

- model: amazon_bedrock/us.amazon.nova-2-lite-v1:0
default: true
access_key: $AWS_BEARER_TOKEN_BEDROCK
base_url: https://bedrock-runtime.us-west-2.amazonaws.com
routing_preferences:
- name: code generation
description: generating new code snippets, functions, or boilerplate based on user prompts or requirements

- model: anthropic/claude-haiku-4-5
access_key: $ANTHROPIC_API_KEY

None of the MS models seem to be working for me. I get an error like:

`[API Error: 404 litellm.NotFoundError: NotFoundError: OpenrouterException - {"error":{"message":"No endpoints found that support tool use. To learn more about provider routing, visit:`
`https://openrouter.ai/docs/guides/routing/provider-selection","code":404}}. Received Model Group=blackboxai/microsoft/phi-4Available Model Group Fallbacks=None]`

Separately, the amazon/nova-lite-v1 model is s\*\*t... Offers vague recommendations and no specific fix for any code.

Amazon just launched Nova 2 Lite models on Bedrock.

Now, you can use those models directly with Claude Code, and set automatic preferences on when to invoke the model for specific coding scenarios. Sample config below. This way you can mix/match different models based on coding use cases. Details in the demo folder here: [https://github.com/katanemo/archgw/tree/main/demos/use\_cases/claude\_code\_router](https://github.com/katanemo/archgw/tree/main/demos/use_cases/claude_code_router)

# Anthropic Models
- model: anthropic/claude-sonnet-4-5
access_key: $ANTHROPIC_API_KEY
routing_preferences:
- name: code understanding
description: understand and explain existing code snippets, functions, or libraries

- model: amazon_bedrock/us.amazon.nova-2-lite-v1:0
default: true
access_key: $AWS_BEARER_TOKEN_BEDROCK
base_url: https://bedrock-runtime.us-west-2.amazonaws.com
routing_preferences:
- name: code generation
description: generating new code snippets, functions, or boilerplate based on user prompts or requirements

- model: anthropic/claude-haiku-4-5
access_key: $ANTHROPIC_API_KEY

if you think this is useful, then don't forget to the star the project 🙏

Amazon just launched Nova 2 Lite models on Bedrock.

Now, you can use those models directly with Claude Code, and set automatic preferences on when to invoke the model for specific coding scenarios. Sample config below. This way you can mix/match different models based on coding use cases. Details in the demo folder here: [https://github.com/katanemo/archgw/tree/main/demos/use\_cases/claude\_code\_router](https://github.com/katanemo/archgw/tree/main/demos/use_cases/claude_code_router)

if you think this is useful, then don't forget to the star the project 🙏

# Anthropic Models
- model: anthropic/claude-sonnet-4-5
access_key: $ANTHROPIC_API_KEY
routing_preferences:
- name: code understanding
description: understand and explain existing code snippets, functions, or libraries

- model: amazon_bedrock/us.amazon.nova-2-lite-v1:0
default: true
access_key: $AWS_BEARER_TOKEN_BEDROCK
base_url: https://bedrock-runtime.us-west-2.amazonaws.com
routing_preferences:
- name: code generation
description: generating new code snippets, functions, or boilerplate based on user prompts or requirements

- model: anthropic/claude-haiku-4-5
access_key: $ANTHROPIC_API_KEY

I’ve been working on integrating Amazon Bedrock’s Nova Lite model into my application and have encountered an issue. According to the documentation, cross-region inference should allow my Lambda function running in us-west-2 to access amazon.nova-lite-v1:0, but my API calls are failing with the following error:

jsonCopy code{
"statusCode": 500,
"body": {
"error": "Bedrock API request failed: An error occurred (ValidationException) when calling the InvokeModel operation: Invocation of model ID amazon.nova-lite-v1:0 with on-demand throughput isn’t supported. Retry your request with the ID or ARN of an inference profile that contains this model."
}
}

From my understanding, Nova Lite is supposed to support both on-demand and provisioned throughput according to the user guide. However, this error makes it seem like provisioned throughput is a mandatory requirement for this model.

I've already:

* Verified that my Lambda function and Bedrock client are correctly configured for us-west-2.
* Ensured that the IAM role has the necessary permissions (bedrock:InvokeModel, etc.).
* Checked the documentation, but it doesn’t explicitly mention that provisioned throughput is required for basic inference with Nova Lite.

Can anyone confirm if provisioned throughput is a hard requirement for Nova Lite, or am I missing a key configuration step? Any insights would be greatly appreciated!