Back to Models

Meta Llama 3 8B Instruct Lite

meta-llama/meta-llama-3-8b-instruct-lite
Meta Chat

Description

Meta Llama 3 8B Instruct Lite by Meta. This model supports chat capabilities. Main use: Chat, Small & Fast. Variant: Instruct.

Specifications

Context Length:
8192
Variant:
Instruct
Parameters:
8B
Input Modalities:
Text
Output Modalities:
Text
Main Use:
Chat, Small & Fast

Pricing

Input Cost:
0.20 Credits / 1M tokens
Output Cost:
0.20 Credits / 1M tokens

Usage Example

const { Client } = require('ai-proxy-sdk');

const client = new Client({
  consumerKey: process.env.BITMESH_CONSUMER_KEY,
  consumerSecret: process.env.BITMESH_CONSUMER_SECRET,
  baseUrl: process.env.BITMESH_API_BASE_URL || 'https://api.bitmesh.ai'
});

const response = await client.chat.completions.create({
  model: 'meta-llama/meta-llama-3-8b-instruct-lite',
  messages: [
    { role: 'system', content: 'You are a helpful assistant.' },
    { role: 'user', content: 'What are some fun things to do with AI?' }
  ],
  max_tokens: 1000
});