TL;DR

Baseten is now available through Hugging Face Inference Providers for conversational and text-generation workloads. Developers can route requests through Hugging Face or use a Baseten API key, but performance, availability and the schedule for more task types remain unspecified.

Hugging Face has added Baseten as a supported Inference Provider, allowing developers to send conversational and text-generation requests to Baseten-hosted models from the Hugging Face Hub and compatible software. The integration adds another infrastructure option for accessing open-weight language models without building a separate connection to each model-serving platform.

The initial release covers chat and text generation. Hugging Face identified Kimi K3, DeepSeek V4 Flash and GLM-5.2 among the models available through Baseten, while directing users to Baseten’s Hub profile for the current catalog. These model names and their availability reflect Hugging Face’s announcement; the company did not publish independent performance comparisons in the post.

Users can access Baseten through two billing and authentication paths. A developer who supplies a Baseten API key sends requests directly to the provider and receives charges on the Baseten account. A developer using a Hugging Face token can have the request routed through the Hugging Face infrastructure, with provider costs charged to the user’s Hugging Face account.

Baseten is also exposed through huggingface_hub version 1.26.1 or later for Python and through @huggingface/inference for JavaScript. Hugging Face said its provider router works with an OpenAI-compatible chat-completions interface, and named Pi, OpenCode, Hermes Agents and OpenClaw among the agent tools that can use Inference Providers.

At a glance
announcementWhen: Integration live when announced by Hugg…
The developmentHugging Face has added Baseten to its Inference Providers network, giving developers another route to run supported open-weight language models from Hub pages, SDKs and compatible agent tools.
Baseten on Hugging Face Inference Providers
Inference infrastructure / August 2026

Baseten joins Hugging Face Inference Providers

Developers can now route conversational and text-generation workloads to Baseten-hosted models from Hugging Face Hub pages, supported SDKs and compatible agent tools.

Integration live

One model interface. Two billing paths. More serving choice.

The launch expands infrastructure options for open-weight models, while performance benchmarks and the timetable for additional tasks remain unspecified.

Python SDK ≥ 1.26.1
2 Initial task types
3 Named model examples
2 Authentication paths
$0 Added HF markup stated
01 / What launched

Baseten is now selectable inside the Hugging Face ecosystem

The first release focuses on language-model inference. Availability is surfaced through compatible model pages, client libraries and the Hugging Face provider router.

Supported workload

Conversational

OpenAI-compatible chat-completions requests can be routed to supported Baseten-hosted models.

Chat and agent workflows
Supported workload

Text generation

Developers can generate text through Hub integrations without writing a separate provider-specific connection.

Prompt-to-text requests
Named examples

Initial model set

Hugging Face highlighted Kimi K3, DeepSeek V4 Flash and GLM-5.2. The live catalog remains the current reference.

Catalog may change
02 / Request path

How a routed request moves

Teams select Baseten in a supported model identifier while retaining a familiar Hugging Face entry point.

01

Choose a model

Start on a supported Hub page or specify the model in code.

02

Select Baseten

Use provider ordering or identify Baseten in the request.

03

Authenticate

Supply either a Hugging Face token or a Baseten API key.

04

Run inference

The supported workload is served through Baseten infrastructure.

03 / Billing choice

Two ways to authenticate and pay

Architecture and billing ownership depend on which credential is supplied with the request.

Path A / Centralized

Hugging Face token

Hugging Face routes the request and charges the provider cost to the developer’s Hugging Face account.

APP → HF ROUTER → BASETEN → HF BILLING
Path B / Direct

Baseten API key

The request uses the developer’s provider credential, with usage charged directly to the Baseten account.

APP → HF INTERFACE → BASETEN → BASETEN BILLING
04 / Integration matrix

Where developers can use it

The integration spans official client libraries, model-page experiences and software using the compatible chat-completions interface.

Access surface Baseten support Credential choice Key detail
Hugging Face Hub pages ✓ Available HF token or provider key Provider appears on compatible models
Python: huggingface_hub ✓ Available HF token or Baseten key Version 1.26.1 or later
JavaScript: @huggingface/inference ✓ Available HF token or Baseten key Supported inference client
OpenAI-compatible agent tools ✓ Compatible Typically HF router token Pi, OpenCode, Hermes Agents, OpenClaw
Tasks beyond chat and text ~ Planned Not specified No published rollout calendar
Published performance comparison ✗ Not provided Not applicable Production teams must benchmark directly
05 / Evidence check

What the announcement says—and what it does not

The integration is confirmed, but the launch post is not an independent performance study or a production service-level guarantee.

“Baseten is now a supported Inference Provider on the Hugging Face Hub.”

Hugging Face announcement

“There’s no additional markup from us; we just pass through the provider costs directly.”

Hugging Face billing statement

Still unspecified

  • Latency, throughput and reliability comparisons
  • Regional availability and capacity constraints
  • Model-by-model service levels
  • Sequence and release dates for additional task types
  • Long-term pricing or commercial arrangements
06 / Readiness view

Confirmed capability versus missing detail

These bars visualize disclosure completeness in the announcement—not measured product performance.

Integration availability
Confirmed
Auth and billing paths
Documented
Initial task scope
Documented
Performance evidence
Not published
Expansion schedule
“Soon” only
Model page Choose a supported model
Provider router Select or prioritize Baseten
Credential HF token or Baseten key
Inference Chat or text generation
Validate Check cost, limits and performance

Bottom line for production teams

Baseten adds meaningful routing choice and a flexible billing decision. Before deployment, verify the live model catalog, current pricing, quotas, regional coverage and workload-specific latency and reliability.

More Choice for Model Routing

The addition gives Hugging Face users another serving provider without requiring them to leave a model page or create provider-specific application logic. Teams can arrange providers by preference and use the same Hugging Face routing endpoint while selecting Baseten in the model identifier. That may make it easier to compare infrastructure options or change providers when a model is supported by more than one service.

The billing paths also give teams a choice between centralized Hugging Face charges and a direct Baseten relationship. Hugging Face said routed requests carry the provider’s standard API rates with no added markup. That statement describes the platform’s current billing policy, not a guarantee that provider prices or commercial arrangements will remain unchanged.

Amazon

AI model hosting platform

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

How Hugging Face Routing Works

Inference Providers is Hugging Face’s system for connecting model pages and client libraries to third-party inference services. Account settings allow users to save provider keys and rank providers by preference. Compatible providers then appear in model-page widgets and code examples, based on the selected model and the user’s ordering.

Baseten describes itself as an AI infrastructure platform spanning serverless inference, model training and other deployment services. Hugging Face said the platform supports model categories ranging from large language models to text-to-speech systems, although the first Hugging Face release is limited to conversational and text-generation tasks.

Hugging Face also offers $2 in monthly inference credits to PRO subscribers for use across providers. Signed-in free users receive a small free inference quota, according to the announcement. Actual usage depends on model pricing, token volume and the provider selected for a request.

“Baseten is now a supported Inference Provider on the Hugging Face Hub.”

— Hugging Face

Amazon

API key management software

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

Performance and Rollout Details Missing

Hugging Face did not provide latency, throughput or reliability measurements for Baseten-backed requests, so the announcement does not establish how the service compares with other providers. It also did not specify regional availability, capacity limits or model-by-model service levels. Developers evaluating production use will need current documentation and their own workload tests.

The companies have not given a date for supporting more inference tasks. The announcement says more task types will arrive soon, but does not identify which capabilities will be added first. The precise model catalog may also change, and pricing remains provider-dependent.

Amazon

open-weight language model API

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

More Baseten Tasks Planned

Hugging Face and Baseten are expected to expand the supported task list beyond chat and text generation, though no release calendar has been published. Near-term signals will include changes to Baseten’s supported-model catalog, updates to the SDK documentation and new task options appearing on compatible Hub pages.

Developers can now test the integration by selecting Baseten on a supported model page or by making authenticated requests through the Hugging Face router. Production users will need to check current model availability, pricing and usage limits before choosing between direct Baseten billing and Hugging Face-routed access.

Amazon

Hugging Face compatible SDK

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

Key Questions

What did Hugging Face announce about Baseten?

Baseten is now a supported Hugging Face Inference Provider. The first release lets users run conversational and text-generation models through Baseten from supported Hub pages, client libraries and compatible agent software.

Which models are available through the integration?

Hugging Face named Kimi K3, DeepSeek V4 Flash and GLM-5.2 as examples. The live Baseten catalog on Hugging Face is the better reference for current availability because supported models can change.

Do users need a Baseten API key?

No Baseten key is required when a request is authenticated with a Hugging Face token and routed through Hugging Face. Users can instead provide their own Baseten key for direct requests billed to a Baseten account.

Does Hugging Face add a fee to routed requests?

Hugging Face said it currently passes through standard provider API rates without an added markup. Charges depend on the selected model and provider pricing, which may change over time.

When will Baseten support more task types?

No rollout date has been announced. Hugging Face said more tasks are planned, but the sequence and scope remain unspecified.

Source: Hugging Face

Source: Hugging Face

You May Also Like

When AI Companionship Crosses the Line Between Tool and Relationship

The line between AI companionship as a helpful tool and an emotional relationship can blur, prompting important questions about boundaries and well-being.

Kimi K3 Debuts at #3 on VigilSAR’s Public LLM Leaderboard

The public benchmark page — aggregate results public, task set private. Source:…

Disk Is the Contract: Inside Threlmark’s Local-First Architecture

Discover how Threlmark’s local-first architecture treats disk as the single source of truth, enabling offline use, portability, and seamless sync without a database.

3 Google Updates From Galaxy Unpacked 2026

Google expanded Gemini automation, added Gemini Notebook to Samsung foldables, and detailed Galaxy Watch 9 and smart-glasses features.