Back to Models

Meta Llama 3.1 70B Instruct


                        meta-llama/meta-llama-3.1-70b-instruct-reference

Meta Chat

Description

Meta Llama 3.1 70B Instruct by Meta. This model supports chat capabilities. Variant: Instruct.

Specifications

Context Length:: 8192
Variant:: Instruct
Parameters:: 70B

Pricing

Input Cost:: $1.80/1M tokens
Output Cost:: $1.80/1M tokens

Usage Example

import OpenAI from "openai";

const client = new OpenAI({
  baseURL: "https://api.yourproxy.com/v1",
  apiKey: process.env.PROXY_KEY,
});

const completion = await client.chat.completions.create({
  model: "meta-llama/meta-llama-3.1-70b-instruct-reference",
  messages: [{ role: "user", content: "Hello!" }],
});