Skip to main content

Together AI

proxium calls Together AI with your own Together AI key. Your applications send their requests to proxium with a proxium virtual key. They never hold the Together AI key.

SettingValue
Preset idtogether
Base URLhttps://api.together.xyz/v1
How proxium sends the keyan Authorization: Bearer header
Request formatthe OpenAI Chat Completions format
Request typechat

Add Together AI to a project​

  1. Get a key from Together AI at api.together.ai/settings/api-keys.
  2. In the console, open Providers and select Add a vendor.
  3. In What are you adding, select Together AI. proxium fills in the base URL and the models.
  4. Paste the key into API key, and select Add Together AI.

proxium stores the key encrypted with AES-256-GCM. The console does not show the key again.

Models​

A new Together AI vendor starts with these models. You can change the list on the Providers screen.

  • meta-llama/Llama-3.3-70B-Instruct-Turbo

Call a model​

A vendor that you add has the provider id t.<project>.together, where <project> is the project slug. Send GET /v1/models to get the exact ids that your key can use.

curl https://proxium.tech/v1/chat/completions \
-H "Authorization: Bearer $PROXIUM_KEY" \
-H "Content-Type: application/json" \
-d '{"model": "t.<project>.together/meta-llama/Llama-3.3-70B-Instruct-Turbo", "messages": [{"role": "user", "content": "Hello"}]}'

You can also send a tier name, such as trial, in model. proxium then picks the model from the routing policy of the project. Refer to Routing.