Skip to main content

Console screens

The console is at proxium.tech/app. Each screen shows one project. The screens that show traffic have a Time window: today, 7d or 30d.

ScreenUse it toExplained in
OverviewSee the spend, and cap an appTrack spend
EndpointsGet a base URL and a key for your appsCreate endpoints and keys
RequestsSee each attempt, and why calls failedDebug a failed call
MemoryReview what the project learnedUse project memory
RoutingSet the models of each tierRoute requests to models
KeysMake a plain virtual keyCreate endpoints and keys
ProvidersAdd vendors and their keysAdd vendors and your own keys
ImproveFind what to change to spend lessLower your costs
TeamAdd and remove peopleInvite your team
SettingsSet what Proxium stores, export or erase the projectData handling
BillingSee your plan—

Settings and Billing open from the top bar. The other screens are in the side strip.

Overview​

ElementShowsYou can
SpentThe cost of the window
Remaining∞ during the open beta
Saved by cacheWhat the cache saved, less what you charged for hits
Requests, TokensThe calls and the tokens of the window
Spend over timeThe cost for each time bucket
Model splitThe cost of each model
Per-app burnThe spend, share, tokens and calls of each x-proxium-sourceSet Calls per hour and Dollars per day for one app
Per-key burnThe spend of each keySelect a key to see its apps

Endpoints​

ElementShowsYou can
Endpoints, With own routing, ExpiredThe counts of your endpoints
Base URLhttps://proxium.tech/v1Copy it
The table EndpointsEach endpoint: name, routing, last useRouting, Revoke
New endpointCreate an endpoint, with its own routing

Requests​

ElementShowsYou can
The app barThe calls of each appShow one app only
Attempts over time, Failures over timeThe attempts and failures for each time bucket
Attempt logEach attempt: When, Model, Asked for, Try, Outcome, Took. The newest 200Select a row to read the prompt and the answer
What failedFailed attempts by outcome, vendor and reason
Who is unreliableThe share of failures of each vendor
Model healthEach model: attempts, 429, Gone, other errors, average time
CacheThe hits, what they saved, by layer and by model

Memory​

ElementShowsYou can
Memory (top)Memory on or off, and the memory cost of this monthTurn memory on, set Only these senders and Keep conversations for
Knowledge pageWhat the project knows, written from its memories
MemoriesThe memories, to review firstConfirm, Pin, Edit, Remove, add a New memory
Recent conversationsThe kept conversations, with title and summarySearch
Erase one user (bottom)Erase one end user. Owners only

Routing​

ElementShowsYou can
Which routing to showThe default chains, or the chains of the projectSwitch the view
Text routing, and one section for each other typeEach tier, and Resolves to: its chainChange, Use default
Scoped rulesThe rules for one app or one keyAdd a rule
Model catalogEach model, with Cost, per MtokFilter the catalog

Keys​

ElementShowsYou can
KeysEach key: name, prefix, limits, status, last useLimits, Revoke
Limits of a keyCalls per hour, Requests per minute, Tokens per minute, Dollars per daySave limits. An empty field is no limit
Name this keyCreate a key. Your new key shows it one time

Providers​

ElementShowsYou can
VendorsEach vendor: name, URL, type, models, keyAdd a vendor, Models, Remove
Your own keysYour keys for the platform providers and for your own vendorsAdd a key, Remove. Without pooled keys, the form lists only your own vendors

Improve​

ElementShows
Findings, Worth doing first, Worth a look, Worth fixingThe counts and the estimated saving
What to changeEach finding, with its numbers

Team​

ElementShowsYou can
Add a colleagueAdd a person as Member or Owner. Owners only
PeopleEach person, role and statusRemove. Owners only

Settings​

SectionYou can
Stored prompts and answersSet What to store: off, errors or all
Spend alertsAdd Spend levels, set Warn at for the limits of keys, set the Webhook, Slack, Discord and Telegram channels, Send a test alert
Alerts that went outRead each alert: when, what about, the channel, sent, failed or blocked
Export everythingDownload the data of the project
Erase this projectDelete the project and all its data. Owners only

Billing​

Plan shows open beta · free. Proxium is free during the open beta.