How to Deploy a Standalone Container¶
Before deploying, review the conceptual guide for the Standalone Container deployment option.
Prerequisites¶
- Use the LangGraph CLI to test your application locally.
- Use the LangGraph CLI to build a Docker image (i.e.
langgraph build
). -
The following environment variables are needed for a standalone container deployment.
-
REDIS_URI
: Connection details to a Redis instance. Redis will be used as a pub-sub broker to enable streaming real time output from background runs. The value ofREDIS_URI
must be a valid Redis connection URI.Shared Redis Instance
Multiple self-hosted deployments can share the same Redis instance. For example, for
Deployment A
,REDIS_URI
can be set toredis://<hostname_1>:<port>/1
and forDeployment B
,REDIS_URI
can be set toredis://<hostname_1>:<port>/2
.1
and2
are different database numbers within the same instance, but<hostname_1>
is shared. The same database number cannot be used for separate deployments. -
DATABASE_URI
: Postgres connection details. Postgres will be used to store assistants, threads, runs, persist thread state and long term memory, and to manage the state of the background task queue with 'exactly once' semantics. The value ofDATABASE_URI
must be a valid Postgres connection URI.Shared Postgres Instance
Multiple self-hosted deployments can share the same Postgres instance. For example, for
Deployment A
,DATABASE_URI
can be set topostgres://<user>:<password>@/<database_name_1>?host=<hostname_1>
and forDeployment B
,DATABASE_URI
can be set topostgres://<user>:<password>@/<database_name_2>?host=<hostname_1>
.<database_name_1>
anddatabase_name_2
are different databases within the same instance, but<hostname_1>
is shared. The same database cannot be used for separate deployments. -
LANGSMITH_API_KEY
: (if using Lite) LangSmith API key. This will be used to authenticate ONCE at server start up. LANGGRAPH_CLOUD_LICENSE_KEY
: (if using Enterprise) LangGraph Platform license key. This will be used to authenticate ONCE at server start up.LANGSMITH_ENDPOINT
: To send traces to a self-hosted LangSmith instance, setLANGSMITH_ENDPOINT
to the hostname of the self-hosted LangSmith instance.
-
Kubernetes (Helm)¶
Use this Helm chart to deploy a LangGraph Server to a Kubernetes cluster.
Docker¶
Run the following docker
command:
docker run \
--env-file .env \
-p 8123:8000 \
-e REDIS_URI="foo" \
-e DATABASE_URI="bar" \
-e LANGSMITH_API_KEY="baz" \
my-image
Note
- You need to replace
my-image
with the name of the image you built in the prerequisite steps (fromlanggraph build
) and you should provide appropriate values forREDIS_URI
,DATABASE_URI
, andLANGSMITH_API_KEY
. - If your application requires additional environment variables, you can pass them in a similar way.
Docker Compose¶
Docker Compose YAML file:
volumes:
langgraph-data:
driver: local
services:
langgraph-redis:
image: redis:6
healthcheck:
test: redis-cli ping
interval: 5s
timeout: 1s
retries: 5
langgraph-postgres:
image: postgres:16
ports:
- "5433:5432"
environment:
POSTGRES_DB: postgres
POSTGRES_USER: postgres
POSTGRES_PASSWORD: postgres
volumes:
- langgraph-data:/var/lib/postgresql/data
healthcheck:
test: pg_isready -U postgres
start_period: 10s
timeout: 1s
retries: 5
interval: 5s
langgraph-api:
image: ${IMAGE_NAME}
ports:
- "8123:8000"
depends_on:
langgraph-redis:
condition: service_healthy
langgraph-postgres:
condition: service_healthy
env_file:
- .env
environment:
REDIS_URI: redis://langgraph-redis:6379
LANGSMITH_API_KEY: ${LANGSMITH_API_KEY}
POSTGRES_URI: postgres://postgres:postgres@langgraph-postgres:5432/postgres?sslmode=disable
You can run the command docker compose up
with this Docker Compose file in the same folder.
This will launch a LangGraph Server on port 8123
(if you want to change this, you can change this by changing the ports in the langgraph-api
volume). You can test if the application is healthy by running: