System Dashboard

Queue Depth

--

Pending requests

Requests Processed

--

Last hour

Avg Response Time

--

Milliseconds

Models Used

--

Last hour

Worker Performance
Model Usage
Recent Requests
ID Type Model Request Time Processing Time Tokens Actions
Loading...

Request History

ID Type Model Prompt Request Time Processing Time Tokens Actions
Loading...

Worker Management

Worker Performance Stats
Worker ID Requests Processed Avg Processing Time Avg Tokens Tokens Per Second Actions
Loading...
Live Worker Status
Worker ID Status Uptime Memory Usage Active Models Actions
Loading...

Model Management

Available Models
Model ID AiProvider Name Description Status Actions
Loading...