llmbox
—
requests in flight
queued —

decode

—
served —

prefill

—
cache hit —

first token

—
p95 —

whole request

—
p95 —

finished

—
by reason

kv cache

—
tokens —

runningqueued last 90 s

Dashboard token

This page shows your live box. Enter the dashboard token to see it.