mistral:7b - Ollama 框架

mistral:7b

28.2M 次下载更新于 9个月前

Mistral AI 发布，版本 0.3 的 7B 模型。

工具 7b

ollama run mistral:7b

curl https://:11434/api/chat \
  -d '{
    "model": "mistral:7b",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

from ollama import chat

response = chat(
    model='mistral:7b',
    messages=[{'role': 'user', 'content': 'Hello!'}],
)
print(response.message.content)

import ollama from 'ollama'

const response = await ollama.chat({
  model: 'mistral:7b',
  messages: [{role: 'user', content: 'Hello!'}],
})
console.log(response.message.content)

详情

9个月前更新

9个月前

6577803aa9a0 · 4.4GB ·

模型

架构llama

·

参数7.25B

·

量化Q4_K_M

4.4GB

参数

{ "stop": [ "[INST]", "[/INST]" ] }

30B

许可

Apache License Version 2.0, January 2004 https://apache.ac.cn/licenses/ TERMS AND CONDITIONS FOR US

11kB

模板

{{- if .Messages }} {{- range $index, $_ := .Messages }} {{- if eq .Role "user" }} {{- if and (eq (l

799B

自述文件

Mistral 是一个 7B 参数的模型，采用 Apache 许可证发布。它既有指令遵循（instruction following）版本，也有文本补全版本。

Mistral AI 团队指出 Mistral 7B

在所有基准测试中表现优于 Llama 2 13B
在许多基准测试中表现优于 Llama 1 34B
在代码方面接近 CodeLlama 7B 的性能，同时在英语任务方面表现良好

版本

标签	日期	备注
`v0.3` `latest`	05/22/2024	Mistral 7B 的新版本，支持函数调用。
`v0.2`	03/23/2024	Mistral 7B 的一个小版本发布
`v0.1`	09/27/2023	初始发布

函数调用

Mistral 0.3 支持使用 Ollama 的 原始模式 进行函数调用。

_{示例原始提示}

[AVAILABLE_TOOLS] [{"type": "function", "function": {"name": "get_current_weather", "description": "Get the current weather", "parameters": {"type": "object", "properties": {"location": {"type": "string", "description": "The city and state, e.g. San Francisco, CA"}, "format": {"type": "string", "enum": ["celsius", "fahrenheit"], "description": "The temperature unit to use. Infer this from the users location."}}, "required": ["location", "format"]}}}][/AVAILABLE_TOOLS][INST] What is the weather like today in San Francisco [/INST]

_示例回复

[TOOL_CALLS] [{"name": "get_current_weather", "arguments": {"location": "San Francisco, CA", "format": "celsius"}}]

有关原始模式的更多信息，请参阅 API 文档。

变体


`指令`	指令模型遵循指令
`文本`	文本模型是基础模型，未针对对话进行任何微调，最适合用于简单的文本补全。

用法

CLI

指令

ollama run mistral

API

示例

curl -X POST https://:11434/api/generate -d '{
  "model": "mistral",
  "prompt":"Here is a story about llamas eating grass"
 }'

参考文献

Mistral AI 新闻稿

<img src="https://github.com/jmorganca/ollama/assets/3325447/d6be0694-eb35-417b-8f08-47d3b6c2a171" width="200"/>

Mistral is a 7B parameter model, distributed with the Apache license. It is available in both instruct (instruction following) and text completion.

The Mistral AI team has noted that Mistral 7B:

- Outperforms Llama 2 13B on all benchmarks
- Outperforms Llama 1 34B on many benchmarks
- Approaches CodeLlama 7B performance on code, while remaining good at English tasks

### Versions

| Tag             | Date       | Notes                                                       |
| --------------- | ---------- | ----------------------------------------------------------- |
| `v0.3` `latest` | 05/22/2024 | A new version of Mistral 7B that supports function calling. |
| `v0.2`          | 03/23/2024 | A minor release of Mistral 7B                           |
| `v0.1`          | 09/27/2023 | Initial release                                             |

### Function calling

Mistral 0.3 supports function calling with Ollama's **raw mode**.

<sub>Example raw prompt</sub>
```
[AVAILABLE_TOOLS] [{"type": "function", "function": {"name": "get_current_weather", "description": "Get the current weather", "parameters": {"type": "object", "properties": {"location": {"type": "string", "description": "The city and state, e.g. San Francisco, CA"}, "format": {"type": "string", "enum": ["celsius", "fahrenheit"], "description": "The temperature unit to use. Infer this from the users location."}}, "required": ["location", "format"]}}}][/AVAILABLE_TOOLS][INST] What is the weather like today in San Francisco [/INST]
```

<sub>Example response</sub>

```
[TOOL_CALLS] [{"name": "get_current_weather", "arguments": {"location": "San Francisco, CA", "format": "celsius"}}]
```

For more information on raw mode, see the [API documentation](https://github.com/ollama/ollama/blob/main/docs/api.md#request-raw-mode).

### Variations

|            |                                                                                                                                    |
| ---------- | ---------------------------------------------------------------------------------------------------------------------------------- |
| `instruct` | Instruct models follow instructions                                                                                                |
| `text`     | Text models are the base foundation model without any fine-tuning for conversations, and are best used for simple text completion. |

## Usage

### CLI

Instruct:

```
ollama run mistral
```

### API

Example:

```
curl -X POST https://:11434/api/generate -d '{
  "model": "mistral",
  "prompt":"Here is a story about llamas eating grass"
 }'
```

## References

[HuggingFace](https://hugging-face.cn/mistralai/Mistral-7B-Instruct-v0.2)

[Mistral AI News Release](https://mistral.ai/news/announcing-mistral-7b/)

粘贴、拖放或单击以上传图像（.png、.jpeg、.jpg、.svg、.gif）