Large Language Models
A guide to AutoML large language models
Overview
Hive AutoML offers training for two different types of large language models (LLMs): a general base LLM and chat LLM. The base LLM model can be used for a wide range of text generation tasks, while chat models are built specifically for interactions with the user (often in the format of asking questions and responding to questions). Chat models also have the added ability to incorporate conversation history into a prompt.
Which Base Model Should I Use?
| Base Model | Max Tokens | Use Case | Hive Classes | Dataset Requirements |
|---|---|---|---|---|
| LLM Instruct 8B v3 | 4096 | Best for highly complex classification tasks or classification of very long input. Also supports text generation and completion. | -- | Minimum 100 rows in snapshot |
| LLM Instruct 70B v3 | 4096 | Best for extremely complex classification tasks or classification of very long input. Also supports text generation and completion. | -- | Minimum 100 rows in snapshot |
Updated about 10 hours ago