Groq

Editor reviewed

Fast, OpenAI-compatible inference API for open models, running on custom LPU chips

Freemiumgroq.comUpdated 20 Oct 2026

About Groq

Groq runs an inference cloud, GroqCloud, that serves open-weight language, speech and safety models through an API that follows the OpenAI format. Requests run on Groq's own Language Processing Unit (LPU) chips instead of GPUs, and the company positions the service around low latency and high token throughput. Its model list includes OpenAI GPT-OSS 120B and 20B, Qwen3.8-27B, Whisper speech-to-text, Orpheus text-to-speech and Llama Prompt Guard.

Best for

Low-latency LLM API calls
Real-time voice and agent apps
Migrating OpenAI-style code to open models
Voice agents: Pair Whisper, a fast LLM and Orpheus for conversational voice applications.
Coding assistants: Connect tools such as Cline, Roo Code or OpenCode to Groq models.
Agent workflows: Run tool-calling agents using built-in code execution, browser search and MCP connectors.
Batch processing: Run large document or classification jobs through the batch tier.
Content moderation: Screen prompts with Llama Prompt Guard and safety models.

Not ideal for

Training or fine-tuning models
Users who need proprietary frontier models

Popular with

Software developers
AI application builders
Enterprise engineering teams
Voice and agent developers

Screenshots

Key features

LPU inference
OpenAI-compatible API
Open model catalog
Speech models
Built-in tools and MCP
Batch and Flex tiers
Structured outputs and reasoning
Spend limits and projects
LoRA inference

Pros and cons

Pros

Listed speeds of about 280 to 1,000 tokens per second on hosted models
OpenAI-compatible API and Responses API support, so migration is mostly a base URL change
Free tier with an API key, and pay-as-you-go pricing with no monthly fee
Low per-token prices, for example $0.15 input and $0.60 output per 1M tokens for GPT OSS 120B
Includes speech-to-text and text-to-speech models alongside text models

Cons

Only hosts a curated set of open models; no proprietary frontier models such as GPT or Claude
Some models, including Llama 3.3 70B, are enterprise-only and require contacting sales
Free tier rate limits are low for production use
No public pricing page on groq.com; prices sit in the developer docs
Preview models can be discontinued at short notice

Pricing

Plans as listed by the vendor on 20 Oct 2026. Check their site for current prices.

See groq.com

Free

Free API access with lower rate limits, for evaluation and small projects

API key from the console
Access to hosted open models
Playground
Lower rate limits than the Developer tier

Developer

Enterprise

Custom/custom

Contact sales for dedicated capacity and enterprise-only models

Custom rate limits
Models such as Llama 3.3 70B
Dedicated infrastructure
Enterprise controls

Our ratings

Scored out of 10 by the Finder Atlas editorial team.

8.6overall

Inference Speed: 9.5
Latency: 9.2
API Compatibility: 9.0
Cost Efficiency: 8.5
Model Selection: 7.0

Platforms and integrations

Available on

Works with

OpenAI SDK
Factory Droid
OpenCode
Kilo Code
Roo Code
Cline
Google Workspace
MCP connectors

Groq alternatives

Other tools people compare with Groq.

All 8 alternatives

BrowserbaseFreemium
Cloud browser infrastructure and APIs that let AI agents browse and act on the web
Compare
Browser UseFreemium
Open-source library and cloud platform for AI agents that control real web browsers
Compare
WarpFreemium
Open-source terminal with built-in AI agents and cloud infrastructure for coding workflows
Compare
GreptileFreemium
AI code review that checks every pull request against your full codebase context
Compare
LangfuseFreemium
Open-source platform to trace, evaluate and improve LLM applications and agents
Compare

Release history

Aug 17, 2026
Groq announced a $350 million Series A led by Disruptive at a $3.5 billion valuation, with planned participation from...
Groq announced a $350 million Series A led by Disruptive at a $3.5 billion valuation, with planned participation from Nvidia.

Reviews

No reviews yet

Used Groq? Help others decide by sharing your experience.

Frequently asked questions

What is Groq?

Groq is an AI inference company. Its GroqCloud service hosts open-weight models behind an OpenAI-compatible API and runs them on the company's own LPU chips.

Is Groq the same as Grok?

No. Groq (with a q) is the inference provider described here. Grok is the chatbot from xAI.

Is there a free plan?

Yes. You can get an API key and use hosted models on the Free tier, which has lower rate limits than the Developer tier. Upgrading to Developer needs a payment method, and you pay only for tokens used.

How is Groq billed?

Usage-based. Text models are priced per million input and output tokens, Whisper per hour of audio and Orpheus per million characters. The bill arrives at month end, or earlier when cumulative usage crosses the $1, $10, $100, $500 and $1,000 thresholds.

Can I use my existing OpenAI code with Groq?

Mostly. Groq documents OpenAI compatibility: set the base URL to https://api.groq.com/openai/v1, use a Groq API key and choose a Groq model ID. The Responses API is also supported.

Can I fine-tune or train models on Groq?

GroqCloud is an inference service. The docs describe LoRA inference for adapters, but it is not a training platform.

How did the Nvidia deal affect GroqCloud?

In December 2025 Groq and Nvidia signed a non-exclusive inference technology licensing agreement, and some Groq leaders joined Nvidia. Groq says it remains independent and that GroqCloud keeps running. Press reports mention some customers seeing a narrower model choice afterwards.

More Developer Tools tools

View all

DeepSeek

AI Assistants

Free AI chat app and low-cost API running DeepSeek's open-weights V4 models

Freemium

Claude Code

Coding AI

Anthropic's coding agent that edits code and runs commands from terminal, IDE or browser

Paid5.0

Cursor