Quickstart

Get up and running with the Groq API in a few minutes.

Create an API Key

Please visit here to create an API Key.

Set up your API Key (recommended)

Configure your API key as an environment variable. This approach streamlines your API usage by eliminating the need to include your API key in each request. Moreover, it enhances security by minimizing the risk of inadvertently including your API key in your codebase.

In your terminal of choice:

export GROQ_API_KEY=<your-api-key-here>

Requesting your first chat completion

curl

Execute this curl command in the terminal of your choice:

curl -X POST "https://api.groq.com/openai/v1/chat/completions" \
 -H "Authorization: Bearer $GROQ_API_KEY" \
 -H "Content-Type: application/json" \
 -d '{"messages": [{"role": "user", "content": "Explain the importance of fast language models"}], "model": "llama3-8b-8192"}'

Execute this curl command in the terminal of your choice:

curl -X POST "https://api.groq.com/openai/v1/chat/completions" \
 -H "Authorization: Bearer $GROQ_API_KEY" \
 -H "Content-Type: application/json" \
 -d '{"messages": [{"role": "user", "content": "Explain the importance of fast language models"}], "model": "llama3-8b-8192"}'

Install the Groq JavaScript library:

npm install --save groq-sdk

Performing a Chat Completion:

import Groq from "groq-sdk";

const groq = new Groq({ apiKey: process.env.GROQ_API_KEY });

export async function main() {
const chatCompletion = await getGroqChatCompletion();
// Print the completion returned by the LLM.
console.log(chatCompletion.choices[0]?.message?.content || "");
}

export async function getGroqChatCompletion() {
return groq.chat.completions.create({
messages: [
  {
    role: "user",
    content: "Explain the importance of fast language models",
  },
],
model: "llama3-8b-8192",
});
}

Now that you have successfully received a chat completion, you can try out the other endpoints in the API.

Install the Groq Python library::

pip install groq

Performing a Chat Completion:

import os

from groq import Groq

client = Groq(
api_key=os.environ.get("GROQ_API_KEY"),
)

chat_completion = client.chat.completions.create(
messages=[
    {
        "role": "user",
        "content": "Explain the importance of fast language models",
    }
],
model="llama3-8b-8192",
)

print(chat_completion.choices[0].message.content)

Now that you have successfully received a chat completion, you can try out the other endpoints in the API.

Pass the following as the request body:

{
"messages": [
{
  "role": "user",
  "content": "Explain the importance of fast language models"
}
],
"model": "mixtral-8x7b-32768"
}

Now that you have successfully received a chat completion, you can try out the other endpoints in the API.

Next Steps

• Check out the Playground to try out the Groq API in your browser
• Join our GroqCloud developer community on Discord
• Chat with our Docs at lightning speed using the Groq API!
• Add a how-to on your project to the Groq API Cookbook