Disable stream compression and encryption overhead for high throughput
use_encryption = false Using pure type = tcp mode instead of type = http bypasses FRP’s internal layer-7 HTTP parsing proxy entirely, converting the tunnel into a raw layer-4 TCP stream. This eliminates HTTP header re-parsing delays. Transport & OS Layer: TCP_NODELAY & Nagle’s Algorithm At the OS network socket layer, Nagle’s Algorithm aggregates small outgoing TCP packets into single consolidated frames to minimize network overhead. While useful for file transfers, Nagle's Algorithm causes latency issues for LLM streaming, where individual tokens are emitted as tiny (10–50 byte) TCP payloads.
This is an AI-generated summary. ShortSingh links to the original source for the complete article.


Discussion (0)
Log in to join the discussion and vote.
Log in