Dolly v2 (3B) API

Basic Information

• Developer/Creator: Databricks, Inc.
• Model Type: Instruction-following Large Language Model

Overview:
Dolly v2 (3B) is an instruction-following large language model created by Databricks, designed to follow instructions and perform various language tasks. Based on the Pythia-2.8b model, Dolly v2 (3B) has been fine-tuned on a dataset of approximately 15k instruction/response pairs to enhance its ability to generate high-quality responses to prompts.

Key Features:

• Fine-tuned on ~15k instruction/response pairs
• Capable of performing tasks such as brainstorming, classification, closed QA, generation, information extraction, open QA, and summarization
• Available in larger sizes (dolly-v2-7b and dolly-v2-12b)

Intended Use:

Dolly v2 (3B) is designed for various natural language processing tasks including brainstorming, classification, closed and open question answering, generation, information extraction, and summarization. It is suitable for applications requiring high-quality instruction following, though it is not state-of-the-art.

Language Support:

Supports English. Other languages might be supported but with potentially less accuracy due to the training data being primarily in English.

Architecture:

Dolly v2 (3B) is based on the Pythia-2.8b model, a Transformer-based architecture.

Training Data:

The model was trained on a dataset of approximately 15,000 instruction/response pairs generated by Databricks employees. This dataset, named databricks-dolly-15k, covers various domains mentioned in the InstructGPT paper, including brainstorming, classification, QA, and summarization.

Use cases

• Chatbots and conversational assistants
• Automated content generation and summarization
• Educational tools and tutoring
• Text classification and information extraction
• Research and prototyping in NLP
• Commercial and open-source language model applications

Capabilities

• Function calling
• Streaming
• Structured outputs