/ Models

Language models

Meta: Llama 3.1 8B Instruct

Meta-llama · meta-llama/llama-3.1-8b-instruct

Runs in the cloud on our API and on your own machine — llama3.1:8b on the local shelf, free and offline.

open weights tools

Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 8B instruct-tuned version is fast and efficient. It has demonstrated strong performance compared to...

Install on 00

Get the 00 app

Free · macOS

Your agents, your models, your machine — this model installs with one click once the app is on board.

Download free →

What it costs

Input / 1M
$0.1
Output / 1M
$0.16
1M in + 1M out
$0.26
Cache read / 1M
$0.05

Final AI-token prices, per million tokens. Bring your own provider key in the app to pay provider rates directly.

What it can do

Takes
text
Returns
text
Tools
yes
Reasoning
no
Context window
131K tokens
Max output
118K tokens
Open weights
yes

Benchmarks

BenchmarkWhat it measuresScore
GPQA Diamondgraduate-level science questions27.0% ± 1.9
AIMEcompetition mathematics1.7% ± 0.9
MATH level 5the hardest tier of the MATH problem set22.9% ± 0.9

Scores by Epoch AI, CC BY 4.0. The ± is the margin of error: models inside each other's margins are tied, not ranked. Epoch's notes on this row: source “epoch”.

Dates

Released
2024-07-23
Knowledge cutoff
2023-12-31
Retires
—

Using it

In the 00 app — pick it per agent, and per tier, then build your own agents on it. Get 00.

As a drop-in API — the same model at an OpenAI-compatible endpoint. Two settings:

  1. Create a workspace API key in the Overblast console — usage bills that workspace's AI tokens, at the prices on this page.
  2. Point your base URL at https://brain.deployd.network/ai/v1. Chat completions with streaming, embeddings, /images, /audio/transcriptions and /videos.
curl https://brain.deployd.network/ai/v1/chat/completions \
  -H "Authorization: Bearer ob_live_YOUR_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "meta-llama/llama-3.1-8b-instruct",
    "messages": [{ "role": "user", "content": "Hello" }]
  }'

← all models · compare it with another · calling image, video and speech models