Mistral AI Provider

The Mistral AI provider contains language model, embedding model, speech model, and transcription model support for Mistral APIs.

Setup

The Mistral provider is available in the @ai-sdk/mistral module. You can install it with

pnpm add @ai-sdk/mistral

Provider Instance

You can import the default provider instance mistral from @ai-sdk/mistral:

import { mistral } from '@ai-sdk/mistral';

If you need a customized setup, you can import createMistral from @ai-sdk/mistral and create a provider instance with your settings:

import { createMistral } from '@ai-sdk/mistral';
const mistral = createMistral({
// custom settings
});

You can use the following optional settings to customize the Mistral provider instance:

  • baseURL string

    Use a different URL prefix for API calls, e.g. to use proxy servers. The default prefix is https://api.mistral.ai/v1.

  • apiKey string

    API key that is being sent using the Authorization header. It defaults to the MISTRAL_API_KEY environment variable.

  • headers Record<string,string>

    Custom headers to include in the requests.

  • fetch (input: RequestInfo, init?: RequestInit) => Promise<Response>

    Custom fetch implementation. Defaults to the global fetch function. You can use it as a middleware to intercept requests, or to provide a custom fetch implementation for e.g. testing.

Language Models

You can create models that call the Mistral chat API using a provider instance. The first argument is the model id, e.g. mistral-large-latest. Some Mistral chat models support tool calls.

const model = mistral('mistral-large-latest');

Mistral chat models also support additional model settings that are not part of the standard call settings. You can pass them as an options argument and utilize MistralLanguageModelChatOptions for typing:

import { mistral, type MistralLanguageModelChatOptions } from '@ai-sdk/mistral';
const model = mistral('mistral-large-latest');
await generateText({
model,
providerOptions: {
mistral: {
safePrompt: true, // optional safety prompt injection
parallelToolCalls: false, // disable parallel tool calls (one tool per response)
} satisfies MistralLanguageModelChatOptions,
},
});

The following optional provider options are available for Mistral models:

  • safePrompt boolean

    Whether to inject a safety prompt before all conversations.

    Defaults to false.

  • documentImageLimit number

    Maximum number of images to process in a document.

  • documentPageLimit number

    Maximum number of pages to process in a document.

  • strictJsonSchema boolean

    Whether to use strict JSON schema validation for structured outputs. Only applies when a schema is provided and only sets the strict flag in addition to using Custom Structured Outputs, which is used by default if a schema is provided.

    Defaults to false.

  • structuredOutputs boolean

    Whether to use structured outputs. When enabled, tool calls and object generation will be strict and follow the provided schema.

    Defaults to true.

  • parallelToolCalls boolean

    Whether to enable parallel function calling during tool use. When set to false, the model will use at most one tool per response.

    Defaults to true.

Document OCR

Mistral chat models support document OCR for PDF files. You can optionally set image and page limits using the provider options.

import { mistral, type MistralLanguageModelChatOptions } from '@ai-sdk/mistral';
import { generateText } from 'ai';
const result = await generateText({
model: mistral('mistral-small-latest'),
messages: [
{
role: 'user',
content: [
{
type: 'text',
text: 'What is an embedding model according to this document?',
},
{
type: 'file',
data: new URL(
'https://github.com/vercel/ai/blob/main/examples/ai-functions/data/ai.pdf?raw=true',
),
mediaType: 'application/pdf',
},
],
},
],
// optional settings:
providerOptions: {
mistral: {
documentImageLimit: 8,
documentPageLimit: 64,
} satisfies MistralLanguageModelChatOptions,
},
});

Reasoning Models

Mistral offers reasoning models that provide step-by-step thinking capabilities:

  • magistral-small-2507: Smaller reasoning model for efficient step-by-step thinking
  • magistral-medium-2507: More powerful reasoning model balancing performance and cost

These models return structured reasoning content that the AI SDK extracts automatically. The reasoning is available via the reasoningText property in the result:

import { mistral } from '@ai-sdk/mistral';
import { generateText } from 'ai';
const result = await generateText({
model: mistral('magistral-small-2507'),
prompt: 'What is 15 * 24?',
});
console.log('REASONING:', result.reasoningText);
// Output: "Let me calculate this step by step..."
console.log('ANSWER:', result.text);
// Output: "360"

The SDK automatically parses Mistral's native reasoning format and provides separate reasoningText and text properties in the result. No middleware is needed.

Configurable Reasoning

Some Mistral models support configurable reasoning, which you can control via the reasoning parameter. You can use the AI SDK's top-level reasoning setting to control reasoning effort:

import { mistral } from '@ai-sdk/mistral';
import { generateText } from 'ai';
const result = await generateText({
model: mistral('mistral-small-latest'),
reasoning: 'high',
prompt: 'What is 15 * 24?',
});
console.log('REASONING:', result.reasoningText);
console.log('ANSWER:', result.text);

So far, Mistral only supports 'high' and 'none' as effort levels.

Example

You can use Mistral language models to generate text with the generateText function:

import { mistral } from '@ai-sdk/mistral';
import { generateText } from 'ai';
const { text } = await generateText({
model: mistral('mistral-large-latest'),
prompt: 'Write a vegetarian lasagna recipe for 4 people.',
});

Mistral language models can also be used in the streamText function and support structured data generation with Output (see AI SDK Core).

Structured Outputs

Mistral chat models support structured outputs using JSON Schema. You can use generateText or streamText with Output and Zod, Valibot, or raw JSON Schema. The SDK sends your schema via Mistral's response_format: { type: 'json_schema' }.

import { mistral } from '@ai-sdk/mistral';
import { generateText, Output } from 'ai';
import { z } from 'zod';
const result = await generateText({
model: mistral('mistral-large-latest'),
output: Output.object({
schema: z.object({
recipe: z.object({
name: z.string(),
ingredients: z.array(z.string()),
instructions: z.array(z.string()),
}),
}),
}),
prompt: 'Generate a simple pasta recipe.',
});
console.log(JSON.stringify(result.output, null, 2));

You can enable strict JSON Schema validation using a provider option:

import { mistral, type MistralLanguageModelChatOptions } from '@ai-sdk/mistral';
import { generateText, Output } from 'ai';
import { z } from 'zod';
const result = await generateText({
model: mistral('mistral-large-latest'),
providerOptions: {
mistral: {
strictJsonSchema: true,
} satisfies MistralLanguageModelChatOptions,
},
output: Output.object({
schema: z.object({
title: z.string(),
items: z.array(
z.object({ id: z.string(), qty: z.number().int().min(1) }),
),
}),
}),
prompt: 'Generate a small shopping list.',
});

When using structured outputs, the SDK no longer injects an extra "answer with JSON" instruction. It relies on Mistral's native json_schema/json_object response formats instead. You can customize the schema name/description via the standard structured-output APIs.

Model Capabilities

ModelImage InputObject GenerationTool UsageTool Streaming
pixtral-large-latest
mistral-large-latest
mistral-medium-latest
mistral-medium-3
mistral-medium-2508
mistral-medium-2505
mistral-medium-3.5
mistral-small-latest
magistral-small-2507
magistral-medium-2507
magistral-small-2506
magistral-medium-2506
ministral-3b-latest
ministral-8b-latest
pixtral-12b-2409
open-mistral-7b
open-mixtral-8x7b
open-mixtral-8x22b

The table above lists popular models. Please see the Mistral docs for a full list of available models. The table above lists popular models. You can also pass any available provider model ID as a string if needed.

Transcription Models

You can create models that call the Mistral audio transcription API using the .transcription() factory method:

const model = mistral.transcription('voxtral-mini-latest');

Use Mistral transcription models with transcribe:

import { mistral } from '@ai-sdk/mistral';
import { transcribe } from 'ai';
import { readFile } from 'node:fs/promises';
const result = await transcribe({
model: mistral.transcription('voxtral-mini-latest'),
audio: await readFile('audio.mp3'),
});

Mistral transcription models support additional provider options. Pass them through providerOptions.mistral and use MistralTranscriptionModelOptions for type checking:

import {
mistral,
type MistralTranscriptionModelOptions,
} from '@ai-sdk/mistral';
import { transcribe } from 'ai';
import { readFile } from 'node:fs/promises';
const result = await transcribe({
model: mistral.transcription('voxtral-mini-latest'),
audio: await readFile('audio.mp3'),
providerOptions: {
mistral: {
timestampGranularities: ['segment'],
diarize: true,
contextBias: ['Vercel', 'AI_SDK'],
} satisfies MistralTranscriptionModelOptions,
},
});

The following optional provider options are available:

  • language string

    The language of the audio, such as en. Providing it can improve accuracy.

  • temperature number

    The sampling temperature for the transcription.

  • timestampGranularities Array<'segment' | 'word'>

    Timestamp granularities to include in the response. Mistral does not support combining this option with language; the SDK throws an InvalidArgumentError when both are provided.

  • diarize boolean

    Whether to identify speakers in the transcription.

  • contextBias string[]

    Up to 100 words or phrases that guide spelling for names, technical terms, or domain-specific vocabulary. Items cannot contain commas or whitespace; use underscores for multi-word phrases.

The normalized result includes transcript text, language, timed segments, and duration when returned by Mistral. Mistral token and prompt-audio usage is available under result.providerMetadata.mistral.usage. Segment scores and speaker IDs from diarization are available under result.providerMetadata.mistral.segments.

Audio is uploaded to Mistral for processing. This integration supports batch transcription only; Mistral realtime transcription is not exposed by this model.

Model Capabilities

ModelTimestampsDiarizationContext Bias
voxtral-mini-latest

Speech Models

You can create models that call the Mistral speech API using the .speech() factory method:

const model = mistral.speech('voxtral-mini-tts-2603');

Use a preset or saved voice ID with generateSpeech:

import { mistral } from '@ai-sdk/mistral';
import { generateSpeech } from 'ai';
const result = await generateSpeech({
model: mistral.speech('voxtral-mini-tts-2603'),
text: 'Hello from the AI SDK!',
voice: 'en_paul_neutral',
outputFormat: 'mp3',
});
const audio = result.audio.uint8Array;

The Mistral speech model maps voice to Mistral's voice_id. It supports mp3, wav, pcm, flac, and opus output formats and defaults to mp3. The instructions, speed, and language settings are not supported and produce warnings when provided.

Mistral also supports one-off voice cloning with base64-encoded reference audio. Pass it through providerOptions.mistral.refAudio and use MistralSpeechModelOptions for type checking:

import { readFile } from 'node:fs/promises';
import { mistral, type MistralSpeechModelOptions } from '@ai-sdk/mistral';
import { generateSpeech } from 'ai';
const referenceAudio = await readFile('./reference.mp3');
const result = await generateSpeech({
model: mistral.speech('voxtral-mini-tts-2603'),
text: 'Hello from the AI SDK!',
providerOptions: {
mistral: {
refAudio: referenceAudio.toString('base64'),
} satisfies MistralSpeechModelOptions,
},
});

When refAudio is provided, it takes precedence over voice. Reference audio is redacted from request metadata and API call errors returned by the provider.

Only use reference audio with the speaker's explicit consent. Follow Mistral's voice cloning usage policy and disclose AI-generated audio when required. This provider integration supports non-streaming speech generation; Mistral's streaming speech API is not exposed through SpeechModelV4.

Model Capabilities

ModelSaved VoicesReference AudioNon-Streaming
voxtral-mini-tts-2603

Embedding Models

You can create models that call the Mistral embeddings API using the .embedding() factory method.

const model = mistral.embedding('mistral-embed');

You can use Mistral embedding models to generate embeddings with the embed function:

import { mistral } from '@ai-sdk/mistral';
import { embed } from 'ai';
const { embedding } = await embed({
model: mistral.embedding('codestral-embed-2505'),
value: 'function add(a: number, b: number) { return a + b; }',
});

Mistral embedding models support additional provider options through providerOptions.mistral. You can validate them with MistralEmbeddingModelOptions:

import { mistral, type MistralEmbeddingModelOptions } from '@ai-sdk/mistral';
import { embed } from 'ai';
const { embedding } = await embed({
model: mistral.embedding('mistral-embed'),
value: 'sunny day at the beach',
providerOptions: {
mistral: {
metadata: { source: 'knowledge-base' },
outputDimension: 1024,
outputDtype: 'float',
} satisfies MistralEmbeddingModelOptions,
},
});

The following optional provider options are available for Mistral embedding models:

  • metadata Record<string, unknown>

    Additional metadata to attach to the embedding request.

  • outputDimension number

    The dimension of the output embeddings when supported by the model.

  • outputDtype string

    The data type of the output embeddings when supported by the model. Accepts 'float', 'int8', 'uint8', 'binary', or 'ubinary'.

Model Capabilities

ModelDefault Dimensions
mistral-embed1024