Skip to main content

AI infrastructure

AstroPulse builds AI infrastructure in your own cloud account from features you combine: GPU clusters, add-ons that serve and scale models, access policies, and cost and GPU metrics. Each use case below is a blueprint: which features to combine, in what order, and why. Every feature has its own page with its steps and settings.

Use cases​

Use caseWhat you build
Serve models behind an APIOpen models on your own GPUs, as an OpenAI-compatible API on your domain, for callers holding your API keys. Replicas and GPU nodes grow with demand.

Building blocks every use case shares​

Building blockWhat it doesPage
A GPU clusterGPU nodes in your cloud account, fixed or launched on demandCreate a cluster, GPU node groups
Node AutoscalingLaunches a GPU node for pending work and removes empty onesNode Autoscaling
Model ServingRuns models from Hugging Face or your own storageModel Serving, Serve a model
Workload QueueingA GPU quota per teamWorkload Queueing
Gateway, Certificates, DNS AutomationServe models on your domain over TLSExpose a model
Access policiesDecide who may call a modelAccess policies
Cost Visibility, Accelerator MetricsSpend and GPU use per model and teamCost and metrics
NovaInvestigates a failing model or clusterNova

Next​