Inference
Provider ID: inference
Details
SDK package@ai-sdk/openai-compatible
Models9
APIhttps://inference.net/v1
Links
Documentation
Auth: INFERENCE_API_KEY
Models (9)
Google Gemma 3
Open Gemma instruction model for efficient chat and self-hosted deployments
125,000 ctx
Llama 3.1 8B Instruct
Open Llama instruction model for multilingual chat, reasoning, and coding
16,000 ctx
Llama 3.2 11B Vision Instruct
Open Llama multimodal model for image understanding and text reasoning
16,000 ctx
Llama 3.2 1B Instruct
Open Llama instruction model for multilingual chat, reasoning, and coding
16,000 ctx
Llama 3.2 3B Instruct
Open Llama instruction model for multilingual chat, reasoning, and coding
16,000 ctx
Mistral Nemo 12B Instruct
Mistral model for multilingual chat, reasoning, and tool-assisted workflows
16,000 ctx
Osmosis Structure 0.6B
Open-weight instruction model for adaptable chat and self-hosted production workloads
4,000 ctx
Qwen 2.5 7B Vision Instruct
Qwen vision-language model for visual reasoning, documents, and agent tasks
125,000 ctx
Qwen 3 Embedding 4B
Embedding model for semantic search, retrieval, clustering, and ranking pipelines
32,000 ctx
Community Rating
—
No ratings yet
Sign in to rate