Documentation for Jetty

Multi-Agent Load Balancing

Status: Implemented

Overview

Multi-agent load balancing allows multiple CLI agents to connect to the same tunnel simultaneously. The edge server distributes incoming requests across connected agents using round-robin selection.

Design

  • When a second agent registers for an already-active subdomain, the edge server adds it to the session pool rather than replacing the existing agent.
  • Requests are dispatched round-robin across healthy agents in the pool.
  • If an agent disconnects, it is removed from the pool. The tunnel stays online as long as at least one agent remains connected.

Use Cases

  • Horizontal scaling of local development servers across multiple machines.
  • Zero-downtime agent restarts (connect a new agent before stopping the old one).

Send feedback

Found an issue or have a suggestion? Let us know.