Host peer relays in Kubernetes with PeerRelay

Last validated:

A PeerRelay is a Custom Resource Definition (CRD) provided by the Tailscale Kubernetes Operator. It lets you deploy one or more peer relay devices inside your cluster that other tailnet devices can use to relay traffic when direct connections aren't possible.

Because a PeerRelay is fronted by a Kubernetes type: LoadBalancer Service, the underlying peer relay pods are reachable at a stable public UDP endpoint even when they restart or reschedule.

Prerequisites

Complete the following before deploying a PeerRelay:

Example PeerRelay configuration

Apply the following manifest to create a PeerRelay with a single replica:

apiVersion: tailscale.com/v1alpha1
kind: PeerRelay
metadata:
  name: my-relay
spec:
  replicas: 1

Configure a grant policy

Before other tailnet devices can use the peer relay, you must create a grant policy that gives them permission to use it. The policy uses the tailscale.com/cap/relay application capability.

By default, the operator tags peer relay devices with tag:k8s. If you use a custom tag, update spec.tags and make sure the operator's tag is an owner of the tag you choose.

Add a grant that lets the intended source devices use the tag your peer relay uses:

{
	"grants": [
		{
			"src": ["tag:private-workloads"],
			"dst": ["tag:k8s"],
			"app": {
				"tailscale.com/cap/relay": []
			}
		}
	]
}

Deploy a PeerRelay

  1. (Optional) Set the tag of the peer relay devices so they are automatically approved. If you set a custom tag, make sure the operator is an owner of that tag.

  2. Create a PeerRelay resource:

    apiVersion: tailscale.com/v1alpha1
    kind: PeerRelay
    metadata:
      name: my-relay
    spec:
      replicas: 1
    

    On AWS/EKS, this manifest is all you need. The operator reads the address of the Network Load Balancer the AWS Load Balancer Controller provisions and advertises it for you. Configure Elastic IPs only if the peer relay must be reachable on addresses you control.

  3. Wait for the PeerRelay to become ready:

    kubectl wait --for=condition=PeerRelayReady=true peerrelay my-relay
    
  4. Inspect the PeerRelay to verify the public endpoints each replica advertises:

    kubectl get peerrelay my-relay
    
    NAME       AGE   STATUS            ENDPOINTS
    my-relay   2m    PeerRelayReady    203.0.113.10
    

Once at least one replica is ready, tailnet devices with the relay grant automatically discover the peer relay and use it for traffic they can't send directly.

High availability for a peer relay

To improve resilience, run more than one replica of a PeerRelay. Each replica joins the tailnet as its own device with its own public UDP endpoint. If one replica becomes unreachable, tailnet devices with the relay grant fall back to the remaining replicas.

Apply the following manifest to run a PeerRelay with three replicas:

apiVersion: tailscale.com/v1alpha1
kind: PeerRelay
metadata:
  name: my-relay
spec:
  replicas: 3

Each replica of a PeerRelay is fronted by its own LoadBalancer Service, which provisions a separate cloud load balancer (and, on AWS, a separate Elastic IP). Scaling replicas up increases your cloud provider bill accordingly, so pick the replica count that matches your resilience needs rather than the maximum.

On GCP, Azure, and AWS, you only need spec.replicas. Each replica's Service gets its own load balancer with a distinct public address, and the operator advertises that address as the replica's endpoint.

Customize the LoadBalancer Service

The operator applies default annotations to every LoadBalancer Service it creates so the Service is provisioned with a public IP address on GCP, AWS, and Azure. If you're targeting a different cloud provider or an in-cluster load balancer controller, use spec.service.annotations to supply the annotations your controller expects. These annotations apply uniformly to every replica.

For example, to steer MetalLB to a specific address pool:

apiVersion: tailscale.com/v1alpha1
kind: PeerRelay
metadata:
  name: my-relay
spec:
  replicas: 1
  service:
    annotations:
      metallb.io/address-pool: peer-relays

Deploy on AWS

The AWS Load Balancer Controller provisions a Network Load Balancer (NLB) for each LoadBalancer Service the operator creates. By default the operator does not pin any subnets, so the controller places the load balancer in every availability zone it discovers and gives it an address in each. The operator turns on cross-zone load balancing, which lets any of those addresses reach the replica's pod whichever zone Kubernetes schedules it into. AWS NLBs are exposed as DNS names rather than IP addresses, so the operator resolves the name and advertises the resulting addresses as the replica's endpoint.

This means no AWS-specific configuration is required. Deploy a PeerRelay on EKS the same way you would on any other cluster.

Pin replicas to Elastic IPs

Use spec.aws.elasticIPs when the peer relay must be reachable on addresses you control, such as when the addresses are referenced by a firewall rule elsewhere. Each entry pairs an Elastic IP (EIP) allocation ID with the subnet its load balancer is provisioned in, and replica N uses entry N.

Pinning a subnet enables only that subnet's availability zone on the replica's load balancer, and a Network Load Balancer only forwards to targets in a zone enabled on it. Otherwise, nothing else constrains where Kubernetes schedules the replica's pod, so you must also keep the pods in that zone with a ProxyClass.

  1. Allocate one EIP per intended replica.

  2. Create a ProxyClass that pins pods to the zone where your subnets are located:

    apiVersion: tailscale.com/v1alpha1
    kind: ProxyClass
    metadata:
      name: relay-zone
    spec:
      statefulSet:
        pod:
          nodeSelector:
            topology.kubernetes.io/zone: us-east-1a
    
  3. Create the PeerRelay resource referencing that ProxyClass, with a paired list of allocations and subnets. The list must be at least as long as spec.replicas, and every subnet must be a public subnet in the zone the ProxyClass pins:

    apiVersion: tailscale.com/v1alpha1
    kind: PeerRelay
    metadata:
      name: my-relay
    spec:
      replicas: 3
      proxyClass: relay-zone
      aws:
        elasticIPs:
          - allocationID: eipalloc-0aaaaaaaaaaaaaaaa
            subnetID: subnet-0aaaaaaaaaaaaaaaa
          - allocationID: eipalloc-0bbbbbbbbbbbbbbbb
            subnetID: subnet-0bbbbbbbbbbbbbbbb
          - allocationID: eipalloc-0cccccccccccccccc
            subnetID: subnet-0cccccccccccccccc
    

Each replica has its own load balancer, so several replicas can name subnets in the same zone, each with its own Elastic IP. A standard VPC Elastic IP is regional rather than zonal, so it takes the zone of whichever subnet you pair it with.

Every replica of a PeerRelay shares one pod template, so a ProxyClass can hold the pods in a single zone but cannot place different replicas in different zones. Therefore, pinning Elastic IPs confines the whole PeerRelay to one availability zone, which gives up the zone redundancy that running several replicas otherwise provides. Omit spec.aws if you want replicas spread across zones.

spec.aws.elasticIPs overrides any service.beta.kubernetes.io/aws-load-balancer-eip-allocations or service.beta.kubernetes.io/aws-load-balancer-subnets annotations supplied via spec.service.annotations. If both are set the per-replica values in spec.aws.elasticIPs take precedence.

Customization

You can customize the resources the operator creates for a PeerRelay with a ProxyClass. Reference the ProxyClass by name using spec.proxyClass:

apiVersion: tailscale.com/v1alpha1
kind: PeerRelay
metadata:
  name: my-relay
spec:
  replicas: 3
  proxyClass: my-proxy-class

You can find the full list of configuration options in the PeerRelay API reference.

Static endpoints

Peer relays advertise one or more static endpoints so that other tailnet devices can reach them at a stable ip:port even when the device is behind a load balancer or NAT. Outside Kubernetes you configure static endpoints yourself with tailscale set --relay-server-static-endpoints.

The PeerRelay CRD handles this for you: for each replica, the operator reads the public address the cloud has assigned to the replica's LoadBalancer Service and writes it into the replica's tailscaled configuration as the static endpoint. You don't need to run tailscale set on the pods and you don't need to know the public IPs in advance.

Use the CLI approach for peer relays running on standalone devices where you manage the network configuration yourself. Use the PeerRelay CRD for peer relays running inside a Kubernetes cluster.

Verify the peer relay

To verify that peer relay traffic is flowing, generate traffic between two tailnet devices that can't reach each other directly and run tailscale status. When a device uses a peer relay, its connection type is reported as peer-relay:

tailscale status | grep peer-relay

You can also list the peer relays the local device knows about:

tailscale debug peer-relay-servers

Refer to the peer relay documentation for more detail on how peer relay connections are established and verified.

Troubleshooting

If you encounter issues, refer to Troubleshooting the Tailscale Kubernetes Operator.