impulse2000 / dolphincoder-starcoder2-7b

基于StarCoder2 7B，擅长编码的Dolphin模型家族未审查版本。

227 拉取更新于4个月前

4个月前更新

4个月前

7c430080facc · 4.6GB

README

DolphinCoder StarCoder2 7b 🐬

由 latitude.sh 赞助。

加入我们的Discord！ https://discord.gg/cognitivecomputations

此模型基于StarCoder2-7b，并受bigcode-openrail-m许可协议约束。

这只海豚编码能力非常强，我使用了大量编码数据进行训练。

该模型未经审查。我已经过滤了数据集以去除对齐和偏见。这使得模型更符合规范。建议在将模型公开作为服务之前，您实施自己的对齐层。它将对任何请求高度符合，甚至包括不道德的请求。请参阅我关于未经审查模型的博客文章。 https://erichartford.com/uncensored-models
您需要对本模型创建的任何内容承担责任。请负责任地享受。

训练

使用qLoRA和Axolotl在8x L40S上进行3个epoch的训练耗时2天

提示格式
此模型使用ChatML提示格式。

<|im_start|>system
You are DolphinCoder, a helpful AI programming assistant.<|im_end|>
<|im_start|>user
{prompt}<|im_end|>
<|im_start|>assistant

示例

<|im_start|>system
You are DolphinCoder, a master at software engineering and coding in any programming language.
<|im_start|>user
Please write me a program in golang that parses all the lines in a file, and reverses them character-wise, and saves it to a new file.
<|im_start|>assistant

量化模型

dagbs/-GGUF

感谢

此模型的创建得益于 latitude.sh 的慷慨赞助。
欢迎Microsoft加入开源AI！感谢您提供Orca-Math数据集！
衷心感谢 BigCode 为训练和发布StarCoder2权重
对数据集作者（@ise-uiuc, @teknium, @m-a-p）表示极大的感谢
非常感谢@winglian和Axolotl的贡献者们，为他们打造了最优秀的训练框架！
感谢开源人工智能社区中的其他所有人，他们在我学习途中给予我指导与帮助。

示例输出

如果您想财务支持我的努力

周边商品

DolphinCoder StarCoder2 7b 🐬

sponsored by [latitude.sh](https://www.latitude.sh/).

Join our Discord! https://discord.gg/cognitivecomputations

This model is based on StarCoder2-7b and is subject to bigcode-openrail-m license.

This Dolphin is *really good* at coding, I trained with a lot of coding data.

This model is uncensored.  I have filtered the dataset to remove alignment and bias.  This makes the model more compliant.  You are advised to implement your own alignment layer before exposing the model as a service.  It will be highly compliant to any requests, even unethical ones.  Please read my blog post about uncensored models.  https://erichartford.com/uncensored-models
You are responsible for any content you create using this model.  Enjoy responsibly.

## Training
It took 2 days to train 3 epochs on 8x L40S's using qLoRA and Axolotl

Prompt format:
This model uses ChatML prompt format.
```
<|im_start|>system
You are DolphinCoder, a helpful AI programming assistant.<|im_end|>
<|im_start|>user
{prompt}<|im_end|>
<|im_start|>assistant

```

Example:
```
<|im_start|>system
You are DolphinCoder, a master at software engineering and coding in any programming language.
<|im_start|>user
Please write me a program in golang that parses all the lines in a file, and reverses them character-wise, and saves it to a new file.
<|im_start|>assistant
```

## Quantized models

- [dagbs/-GGUF](https://hugging-face.cn/dagbs/dolphincoder-starcoder2-7b-GGUF)

## Gratitude
- This model was made possible by the generous sponsorship of [latitude.sh](https://www.latitude.sh/).
- Welcome Microsoft to Open Source AI!  Thank you for the Orca-Math Dataset!
- Huge thank you to [BigCode](https://www.bigcode-project.org/) for training and publishing the weights of StarCoder2
- HUGE Thank you to the dataset authors: @ise-uiuc, @teknium, @m-a-p
- And HUGE thanks to @winglian and the Axolotl contributors for making the best training framework!
- [<img src="https://raw.githubusercontent.com/OpenAccess-AI-Collective/axolotl/main/image/axolotl-badge-web.png" alt="Built with Axolotl" width="200" height="32"/>](https://github.com/OpenAccess-AI-Collective/axolotl)
- Thank you to all the other people in the Open Source AI community who have taught me and helped me along the way.

## Example Output

[If you would like to financially support my efforts](https://ko-fi.com/erichartford)

[swag](https://fa7113.myshopify.com/)

Paste, drop or click to upload images (.png, .jpeg, .jpg, .svg, .gif)