Console screens
The console is at proxium.tech/app. Each screen shows one project. The screens that show traffic have a Time window: today, 7d or 30d.
| Screen | Use it to | Explained in |
|---|---|---|
| Overview | See the spend, and cap an app | Track spend |
| Endpoints | Get a base URL and a key for your apps | Create endpoints and keys |
| Requests | See each attempt, and why calls failed | Debug a failed call |
| Memory | Review what the project learned | Use project memory |
| Routing | Set the models of each tier | Route requests to models |
| Keys | Make a plain virtual key | Create endpoints and keys |
| Providers | Add vendors and their keys | Add vendors and your own keys |
| Improve | Find what to change to spend less | Lower your costs |
| Team | Add and remove people | Invite your team |
| Settings | Set what Proxium stores, export or erase the project | Data handling |
| Billing | See your plan | — |
Settings and Billing open from the top bar. The other screens are in the side strip.
Overview
| Element | Shows | You can |
|---|---|---|
| Spent | The cost of the window | |
| Remaining | ∞ during the open beta | |
| Saved by cache | What the cache saved, less what you charged for hits | |
| Requests, Tokens | The calls and the tokens of the window | |
| Spend over time | The cost for each time bucket | |
| Model split | The cost of each model | |
| Per-app burn | The spend, share, tokens and calls of each x-proxium-source | Set Calls per hour and Dollars per day for one app |
| Per-key burn | The spend of each key | Select a key to see its apps |
Endpoints
| Element | Shows | You can |
|---|---|---|
| Endpoints, With own routing, Expired | The counts of your endpoints | |
| Base URL | https://proxium.tech/v1 | Copy it |
| The table Endpoints | Each endpoint: name, routing, last use | Routing, Revoke |
| New endpoint | Create an endpoint, with its own routing |
Requests
| Element | Shows | You can |
|---|---|---|
| The app bar | The calls of each app | Show one app only |
| Attempts over time, Failures over time | The attempts and failures for each time bucket | |
| Attempt log | Each attempt: When, Model, Asked for, Try, Outcome, Took. The newest 200 | Select a row to read the prompt and the answer |
| What failed | Failed attempts by outcome, vendor and reason | |
| Who is unreliable | The share of failures of each vendor | |
| Model health | Each model: attempts, 429, Gone, other errors, average time | |
| Cache | The hits, what they saved, by layer and by model |
Memory
| Element | Shows | You can |
|---|---|---|
| Memory (top) | Memory on or off, and the memory cost of this month | Turn memory on, set Only these senders and Keep conversations for |
| Knowledge page | What the project knows, written from its memories | |
| Memories | The memories, to review first | Confirm, Pin, Edit, Remove, add a New memory |
| Recent conversations | The kept conversations, with title and summary | Search |
| Erase one user (bottom) | Erase one end user. Owners only |
Routing
| Element | Shows | You can |
|---|---|---|
| Which routing to show | The default chains, or the chains of the project | Switch the view |
| Text routing, and one section for each other type | Each tier, and Resolves to: its chain | Change, Use default |
| Scoped rules | The rules for one app or one key | Add a rule |
| Model catalog | Each model, with Cost, per Mtok | Filter the catalog |
Keys
| Element | Shows | You can |
|---|---|---|
| Keys | Each key: name, prefix, limits, status, last use | Limits, Revoke |
| Limits of a key | Calls per hour, Requests per minute, Tokens per minute, Dollars per day | Save limits. An empty field is no limit |
| Name this key | Create a key. Your new key shows it one time |
Providers
| Element | Shows | You can |
|---|---|---|
| Vendors | Each vendor: name, URL, type, models, key | Add a vendor, Models, Remove |
| Your own keys | Your keys for the platform providers and for your own vendors | Add a key, Remove. Without pooled keys, the form lists only your own vendors |
Improve
| Element | Shows |
|---|---|
| Findings, Worth doing first, Worth a look, Worth fixing | The counts and the estimated saving |
| What to change | Each finding, with its numbers |
Team
| Element | Shows | You can |
|---|---|---|
| Add a colleague | Add a person as Member or Owner. Owners only | |
| People | Each person, role and status | Remove. Owners only |
Settings
| Section | You can |
|---|---|
| Stored prompts and answers | Set What to store: off, errors or all |
| Spend alerts | Add Spend levels, set Warn at for the limits of keys, set the Webhook, Slack, Discord and Telegram channels, Send a test alert |
| Alerts that went out | Read each alert: when, what about, the channel, sent, failed or blocked |
| Export everything | Download the data of the project |
| Erase this project | Delete the project and all its data. Owners only |
Billing
Plan shows open beta · free. Proxium is free during the open beta.