Novelcrafter

Groq

Groq is an AI inference service with crazy fast speeds.

1 min read Last updated Dec 4, 2024

To connect to Groq, please make sure that you have a GroqCloud account (https://console.groq.com/).

While there is no native connection to Groq inside Novelcrafter, they support the “OpenAI” standard, so you just need to do the following:

  1. Create a new “OpenAI” connection
  2. Rename the connection to “Groq”
  3. Enter your API key from Groq (generate a new one here: https://console.groq.com/keys)
  4. Enter the following as the Base URL: https://api.groq.com/openai/v1

If everything works, you should see the models appear:

Groq connection details