Skip to main content
Manage Serverless endpoints, including creating, listing, updating, and deleting endpoints.

​
Alias

You can use sls as a shorthand for serverless:

​
Subcommands

​
List endpoints

List all your Serverless endpoints:

​
List flags

​
bool
Include template information in the output.
​
bool
Include workers information in the output.

​
Get endpoint details

Get detailed information about a specific endpoint:

​
Get flags

​
bool
Include template information in the output.
​
bool
Include workers information in the output.

​
Create an endpoint

Create a new Serverless endpoint from a template or from a Hub repo:
When using --hub-id, GPU IDs and container disk size are automatically pulled from the Hub release config. You can override the GPU type with --gpu-id. Environment variables from the Hub release are included automatically, and you can override or add to them with --env.
Serverless templates vs Pod templates: Serverless endpoints require a Serverless-specific template. Pod templates (like runpod-torch-v21) cannot be used because they include configuration, which Serverless does not support. When creating a template with runpodctl template create, use the --serverless flag to create a Serverless template.Each Serverless template can only be bound to one endpoint at a time. To create multiple endpoints with the same configuration, create separate templates for each.

​
Create flags

​
string
Name for the endpoint. Must be at least 3 characters. If omitted, a name is auto-generated in the format endpoint-XXXXXXXX.
​
string
Template ID to use (required if --hub-id is not specified). Use runpodctl template search to find templates.
​
string
Hub listing ID to deploy from (alternative to --template-id). Use runpodctl hub search to find repos.
​
string
GPU type for workers. Accepts either a GPU type ID (e.g., NVIDIA A40, NVIDIA GeForce RTX 4090) or a GPU pool ID (e.g., ADA_24, AMPERE_48). Use runpodctl gpu list to see available GPUs.
​
int
default:"1"
Number of GPUs per worker.
​
string
default:"GPU"
Compute type (GPU or CPU). For CPU endpoints, use --instance-id to specify the CPU instance type.
​
string
default:"cpu3g-4-16"
CPU instance ID when using --compute-type CPU. If omitted, defaults to cpu3g-4-16. Only valid with --compute-type CPU.
​
int
default:"0"
Minimum number of workers.
​
int
default:"3"
Maximum number of workers.
​
string
Comma-separated list of preferred datacenter IDs. Use runpodctl datacenter list to see available datacenters.
​
string
Network volume ID to attach for single-region deployments. Use runpodctl network-volume list to see available network volumes. Mutually exclusive with --network-volume-ids.
​
string
Comma-separated list of network volume IDs for multi-region deployments. Mutually exclusive with --network-volume-id.
​
string
Minimum CUDA version required for workers (e.g., 12.4). Workers will only be scheduled on machines that meet this CUDA version requirement.
​
string
Autoscaling strategy: delay (scales based on queue wait time in seconds) or requests (scales based on pending request count).
​
int
Trigger point for the autoscaler. For delay, this is the target queue wait time in seconds. For requests, this is the pending request count that triggers scaling.
​
int
Idle timeout in seconds. Workers shut down after being idle for this duration. Valid range: 1-3600 seconds.
​
bool
Enable or disable flash boot for faster worker startup. When enabled, workers start from cached container images.
​
int
Execution timeout in seconds. Jobs that exceed this duration are terminated. The CLI accepts seconds but converts to milliseconds internally.
​
string
Environment variable in KEY=VALUE format. Use multiple --env flags to set multiple variables. These values only apply when deploying from --hub-id, where they override the Hub release defaults. With --template-id, environment variables come from the template, so --env is ignored and the CLI prints a note to that effect.
​
string
Model reference URL to attach to the endpoint. Use multiple --model-reference flags to attach multiple models. Works with both --template-id and --hub-id, and requires GPU compute type.

​
Update an endpoint

Update endpoint configuration:

​
Update flags

​
string
New name for the endpoint.
​
string
New template ID to swap to. Use this to change the template attached to an existing endpoint without recreating it.
​
int
New minimum number of workers.
​
int
New maximum number of workers.
​
int
New idle timeout in seconds.
​
string
Scaler type (QUEUE_DELAY or REQUEST_COUNT).
​
int
Scaler value.
​
bool
Enable or disable flash boot for faster worker startup.
​
int
Execution timeout in seconds. Jobs that exceed this duration are terminated.

​
Delete an endpoint

Delete an endpoint:

​
Serverless URLs

Access your Serverless endpoint using these URL patterns: