Llama Server Monitor

Tokens Decoded

Generation progress per slot

Generation Speed

Per slot live avg (log tg)

Prompt Tokens

Total, processed, and cached

Context Usage

% of n_ctx filled

Throughput

Prompt from /metrics · predict = sum of slot tg

Slots