DBRX Instruct API

DBRX Instruct Description

• Model Type: Large Language Model (LLM)

Overview

DBRX Instruct is a powerful, open-source large language model (LLM) developed by Databricks. It utilizes a fine-grained mixture-of-experts (MoE) architecture with 132 billion total parameters, of which 36 billion are active for any given input.

Key Features

• Fine-grained MoE architecture with 16 experts and the ability to select 4, providing 65x more possible expert combinations than other open MoE models
• Trained on 12 trillion tokens of carefully curated text and code data
• Exceptional performance on benchmarks for general knowledge, commonsense reasoning, programming, and mathematical reasoning
• Outperforms leading open models like Mixtral Instruct and Code LLama (70B)

Intended Use

DBRX Instruct is a general-purpose LLM designed for a wide range of natural language processing tasks, including text generation, question answering, code generation, and more. It is particularly well-suited for applications requiring strong programming and mathematical reasoning capabilities.

Language Support

DBRX Instruct is a multilingual model, supporting a wide range of languages.

Architecture

DBRX Instruct is a transformer-based, decoder-only LLM that was trained using next-token prediction. It utilizes a fine-grained MoE architecture, with 16 experts and the ability to select 4 for any given input.

Use cases

• Conversational AI and chatbots
• Software development and programming assistance
• Educational tools for math and coding
• Research and development in NLP
• Large-scale knowledge retrieval and question answering
• Real-time inference and production deployment
• Open-source model experimentation and innovation

Capabilities

• Function calling
• Streaming
• Structured outputs
• Reasoning