Skip to content

How to Deploy Self-Hosted Data Plane (Beta)

Before deploying, review the conceptual guide for the Self-Hosted Data Plane deployment option.

Prerequisites

  1. Use the LangGraph CLI to test your application locally.
  2. Use the LangGraph CLI to build a Docker image (i.e. langgraph build) and push it to a registry your Kubernetes cluster or Amazon ECS cluster has access to.

Kubernetes

Prerequisites

  1. KEDA is installed on your cluster.

    helm repo add kedacore https://kedacore.github.io/charts 
helm install keda kedacore/keda --namespace keda --create-namespace

  2. A valid Ingress controller is install on your cluster.

  3. You have slack space in your cluster for multiple deployments. Cluster-Autoscaler is recommended to automatically provision new nodes.

Setup

  1. You give us your LangSmith organization ID. We will enable the Self-Hosted Data Plane for your organization.
  2. We provide you a Helm chart which you run to setup your Kubernetes cluster. This chart contains a few important components.
    1. langgraph-listener: This is a service that listens to LangChain's control plane for changes to your deployments and creates/updates downstream CRDs.
    2. LangGraphPlatform CRD: A CRD for LangGraph Platform deployments. This contains the spec for managing an instance of a LangGraph Platform deployment.
    3. langgraph-platform-operator: This operator handles changes to your LangGraph Platform CRDs.

  3. Configure your langgraph-dataplane-values.yaml file.

    config:
  langgraphPlatformLicenseKey: "" # Your LangGraph Platform license key
  langsmithApiKey: "" # API Key of your Workspace
  langsmithWorkspaceId: "" # Workspace ID
  hostBackendUrl: "https://api.host.langchain.com" # Only override this if on EU
  smithBackendUrl: "https://api.smith.langchain.com" # Only override this if on EU

  4. Deploy langgraph-dataplane Helm chart.

    helm repo add langchain https://langchain-ai.github.io/helm/
helm repo update
helm upgrade -i langgraph-dataplane langchain/langgraph-dataplane --values langgraph-dataplane-values.yaml

  5. If successful, you will see two services start up in your namespace.

    NAME                                          READY   STATUS              RESTARTS   AGE
langgraph-dataplane-listener-7fccd788-wn2dx   0/1     Running             0          9s
langgraph-dataplane-redis-0                   0/1     ContainerCreating   0          9s

  6. You create a deployment from the Control Plane UI.

Amazon ECS

Coming soon!

Comments