WORKLOAD GUIDE

Explore my options

You do not need to know a GPU model yet. Decide what you want to build and how much of its infrastructure you want to manage.

Four checks before you commit.

Start with your requirements. A memory figure alone does not prove a workload will run well.

The task
Describe the output you need: answers, generated media, an adapted model or a compute environment.
The responsibility
Decide whether you want to call a hosted model, configure a managed endpoint or operate a runtime.
The usage
Estimate whether the project runs occasionally, during working hours or continuously.
The constraints
Record must-have locations, data handling requirements and a budget range before comparing prices.

Choose how much you want to manage.

These routes explain model serving. Check support for your exact model and requirements.

LESS INFRASTRUCTURE TO MANAGE

Hosted model API

Your app sends requests to a provider that already serves the model.

Responsibilities and costs
You manage
Connect the API and handle responses.
Control
Choose from the provider’s supported models and settings.
Billed for
Often tokens, requests or another usage unit.
Check first
Model availability, rate limits and data terms.
Find a suitable route for Hosted model API →

CHOOSE A MODEL AND A SERVICE

Managed endpoint

Deploy a model to a managed serving environment.

Responsibilities and costs
You manage
Configure the model, hardware and scaling.
Control
More deployment choices; access varies by service.
Billed for
Often provisioned compute time; check idle billing.
Check first
Supported runtimes, cold starts and minimum capacity.
Find a suitable route for Managed endpoint →

MORE CONTROL, MORE OPERATIONS

Self-managed runtime

Run your serving software on cloud compute you configure.

Responsibilities and costs
You manage
Deploy, secure, monitor and maintain the runtime.
Control
Choose compatible software and instance settings.
Billed for
Compute, storage, transfer and related services.
Check first
Memory fit, reliability and maintenance effort.
Find a suitable route for Self-managed runtime →
What makes a complete configuration?
01
Model

Name, revision, licence and intended task.

02
Runtime

Serving software, dependencies and deployment support.

03
Compute

Enough usable memory, suitable hardware and capacity.

04
Service

Region, access, storage, monitoring and availability.

Turn your goal into a next step.

The Finder explains the routes. Confirm exact model and workflow support before choosing a product.

OFFICIAL DOCUMENTATION / FURTHER READING

Hugging Face: endpoint configuration (opens in a new tab)Hugging Face: repository licences (opens in a new tab)Hugging Face: endpoint billing (opens in a new tab)

Editorial references checked 11 October 2026. Product features and terms can change; confirm the current documentation before purchasing.