Skip to main content

Groq

proxium calls Groq with your own Groq key. Your applications send their requests to proxium with a proxium virtual key. They never hold the Groq key.

SettingValue
Preset idgroq
Base URLhttps://api.groq.com/openai/v1
How proxium sends the keyan Authorization: Bearer header
Request formatthe OpenAI Chat Completions format
Request typechat

Add Groq to a project​

  1. Get a key from Groq at console.groq.com/keys.
  2. In the console, open Providers and select Add a vendor.
  3. In What are you adding, select Groq. proxium fills in the base URL and the models.
  4. Paste the key into API key, and select Add Groq.

proxium stores the key encrypted with AES-256-GCM. The console does not show the key again.

Models​

A new Groq vendor starts with these models. You can change the list on the Providers screen.

  • llama-3.3-70b-versatile
  • llama-3.1-8b-instant

Call a model​

A vendor that you add has the provider id t.<project>.groq, where <project> is the project slug. Send GET /v1/models to get the exact ids that your key can use.

curl https://proxium.tech/v1/chat/completions \
  -H "Authorization: Bearer $PROXIUM_KEY" \
  -H "Content-Type: application/json" \
  -d '{"model": "t.<project>.groq/llama-3.3-70b-versatile", "messages": [{"role": "user", "content": "Hello"}]}'

You can also send a tier name, such as trial, in model. proxium then picks the model from the routing policy of the project. Refer to Routing.