Skip to main content
Cynative supports Amazon Bedrock through two Bifrost providers: bedrock (the standard Bedrock Converse API) and bedrock_mantle (the newer Bedrock Mantle endpoint at bedrock-mantle.<region>.api.aws, which exposes Claude via the native Anthropic Messages API and OpenAI/Gemma models via an OpenAI-compatible API). Neither provider requires a separate API key — they authenticate using the standard AWS credential chain. This makes Bedrock a natural fit for Cynative running inside AWS (EC2, ECS, Lambda) with an IAM role, or locally with a named profile.

Bedrock

Quick start

No ~/.cynative/config.yaml file is required.

YAML configuration

Flat form (equivalent to the env-var quick start):
Full keys[] form (for explicit static credentials, role ARN, or multi-key routing):

Authentication

Bifrost picks up AWS credentials from the standard chain — in order:
  1. AWS_ACCESS_KEY_ID / AWS_SECRET_ACCESS_KEY environment variables.
  2. Named profile (AWS_PROFILE or the default profile in ~/.aws/credentials).
  3. IAM role attached to the running instance or task (instance metadata / ECS task role).
No api_key field or CYNATIVE_LLM_API_KEY is used for Bedrock.

Environment variable reference


Bedrock Mantle

Bedrock Mantle is Amazon’s newer inference surface served at bedrock-mantle.<region>.api.aws. It exposes:
  • Claude models via the native Anthropic Messages API.
  • OpenAI-family (gpt-*) and Gemma models via the OpenAI-compatible API.
Bifrost selects the correct API path automatically based on the model id. The model id is sent verbatim to the endpoint, with support for an optional leading region/ addressing prefix.

Quick start

No ~/.cynative/config.yaml file is required. With no api_key set, requests are SigV4-signed using credentials from the standard AWS chain.

YAML configuration

Flat form (equivalent to the env-var quick start):
Full keys[] form:

Authentication

Bedrock Mantle supports two authentication modes:
  • AWS credentials (SigV4). Leave api_key unset. Bifrost signs each request for the bedrock-mantle service using the standard AWS credential chain.
  • Bedrock Mantle API key. Set api_key (or CYNATIVE_LLM_API_KEY) to a Bedrock Mantle API key. It is sent as Authorization: Bearer and SigV4 signing is skipped.
The region is resolved from (in order): a region/ prefix on the model id, the bedrock_mantle.region config field, or falls back to us-east-1.

Environment variable reference

Prompt caching

Claude models served through both bedrock and bedrock_mantle participate in Cynative’s automatic prompt-caching. Cache breakpoints are injected on the tool schemas, system prompt, and recent conversation turns. See the prompt caching section in the overview for details.