surfra
Connect your cloud accounts and your own machines. Surfra runs the queue, the replicas, and the failover. Each cloud bills you directly at its own price.
Salad
RunPod
Vast.ai
Yotta
DigitalOcean
Your machines
Surfra queues requests, starts replicas on the machines you rank, moves to the next provider when one is full, and stops replicas when they go idle.
Load your model once in a warmup. Return JSON from a handler. Or skip the handler and run vLLM, SGLang, TGI, or Ollama as they are.
import surfra model = None @surfra.warmup def load(): global model model = load_my_model() @surfra.handler def predict(request): return {"text": model.generate( request.input["prompt"])}
List GPUs in priority order. A new replica takes the first row that can place it, so a full provider falls through to the next.
SaladRTX 4090FullRunPodRTX 4090PlacingYour machineRTX 3090ReadyEvery call goes through the queue. It starts replicas when none are running and is retried if a worker fails.
import surfra app = surfra.App("my-model") print(app.run({"prompt": "Say hi"})) # {'text': 'Hi!'} # or any OpenAI client client = OpenAI( base_url="https://api.surfra.io/openai/my-llm/v1", api_key=SURFRA_API_KEY, )
Queued work starts replicas. When the first provider is full, the next one takes the overflow. Idle replicas stop after the idle timeout, so a quiet app scales to zero.
Queued work starts replicas. Idle replicas stop after the idle timeout. Set a minimum to keep some warm.
A full or missing provider falls through to the next row. A request that fails on one worker is retried on another.
Per-provider limits keep a base on one provider and send bursts to another.
Write a handler, or run a server you already have. An HTTP app also answers OpenAI-compatible calls.
Chain apps into steps that pass their output forward. Each step's app scales on its own, so a GPU model and a CPU post-processor share one workflow.
Register a workstation or a spare server. It shows up as a row in any app's priority list, next to the clouds.
Each app has metrics, a request log with inputs and outputs, live logs, worker states, and a release history.
Invite people to an organization. Apps, credentials, and cloud accounts are shared. Everyone keeps their own API keys.
Machines start in your own accounts and each provider bills you at its own price. Keys are encrypted with your team's own key and never shown again.
Compute is always billed by your cloud, at its price. Surfra charges for machines you register yourself and for the team features on top.
Bring your own cloud and never pay Surfra for it.
For teams that run in production and want to know when something breaks.
For organizations with their own retention, security, and seat needs.
Surfra runs your model on GPUs and CPUs from your own cloud accounts as one serverless app. You bring a container image. Surfra queues requests, starts replicas on the machines you rank, moves to the next provider when one is full, and stops replicas when they go idle.
No. Add a small handler with the surfra Python package, or run the server you already use, such as vLLM, SGLang, TGI, or Ollama, behind the Surfra supervisor.
Salad, RunPod, Vast.ai, Yotta, and DigitalOcean today, plus machines you register yourself. Connect the accounts you already have, choose the order, and Surfra falls through the list when a provider has no room.
Each cloud bills you directly for the machines Surfra starts in your account, at that cloud's own price. Surfra adds no markup. The Free Forever plan stays free. Machines you register yourself are free for 3 months, then $2 per machine a month.
No. A key is checked with the provider, then encrypted with a key that belongs to your team, which is itself encrypted with Surfra's master key. The dashboard and the API never show it again, not even to you. Surfra decrypts it only to start and stop your machines.
Yes. An organization shares apps, credentials, and cloud accounts. Owners and admins invite people, connect clouds, and remove members. Each person has their own API keys.
Surfra is invite only while we test it. Email hello@surfra.io and tell us what you want to run.