Snowflake Cortex models have size limits to ensure smooth operation. These limits are measured in tokens, which are similar to words. However, some tokens aren't actual words, so the exact number of words you can use might be slightly less than the limit. If you try to enter more than the allowed amount, you'll get an error message.
| Function | Model | Context window (tokens) |
|---|---|---|
| COMPLETE | mistral-large |
32,000 |
mixtral-8x7b |
32,000 | |
llama-2-70b-chat |
4,096 | |
mistral-7b |
32,000 | |
gemma-7b |
8,000 | |
| EXTRACT_ANSWER | Snowflake managed model |
2,048 for text
64 for question
|
| SENTIMENT | Snowflake managed model | 512 |
| SUMMARIZE | Snowflake managed model | 32,000 |
| TRANSLATE | Snowflake managed model | 1,024 |
Daniel Steinhold Changed status to publish April 3, 2024
