spooknik / beyonder-4x7b-v2

结合了4个最好的7B模型的MoE模型

2,156 拉取 更新于5个月前

5个月前

8c32d3c4bb04 · 15GB

<div class="font-medium text-neutral-800 text-sm group-hover:underline truncate sm:col-start-1 sm:col-span-2">模型</div> <div class="font-mono text-[13px] text-neutral-400 subpixel-antialiased truncate sm:col-start-3 sm:col-span-8"> <div class="space-x-2 flex text-sm"> <div class="flex sm:space-x-2 items-center"><span class="hidden sm:block">架构</span><span class="text-neutral-400 sm:font-semibold sm:text-neutral-800 sm:text-xs">llama</span></div> <div>·</div> <div class="flex sm:space-x-2 items-center"><span class="hidden sm:block">参数</span><span class="text-neutral-400 sm:font-semibold sm:text-neutral-800 sm:text-xs">24.2B</span></div> <div>·</div> <div class="flex sm:space-x-2 items-center"><span class="hidden sm:block">量化</span><span class="text-neutral-400 sm:font-semibold sm:text-neutral-800 sm:text-xs">Q4_K_M</span></div> </div> </div> <div class="hidden sm:block text-right text-xs text-neutral-400 sm:col-start-12">15GB</div> </a> <a class="block sm:grid sm:grid-cols-12 grid-cols-12 gap-2 px-4 py-3 hover:bg-neutral-100 group" href="/spooknik/beyonder-4x7b-v2:latest#bb149822bdbd" hx-get="/spooknik/beyonder-4x7b-v2:latest#bb149822bdbd" hx-target="#file-explorer" hx-swap="innerHTML" hx-push-url="true"> <div class="font-medium text-neutral-800 text-sm group-hover:underline truncate sm:col-start-1 sm:col-span-2">参数</div> <div class="font-mono text-[13px] text-neutral-400 subpixel-antialiased truncate sm:col-start-3 sm:col-span-8">{"stop":["<|im_end|>","<|im_start|>"]} </div> <div class="hidden sm:block text-right text-xs text-neutral-400 sm:col-start-12">59B</div> </a> <a class="block sm:grid sm:grid-cols-12 grid-cols-12 gap-2 px-4 py-3 hover:bg-neutral-100 group" href="/spooknik/beyonder-4x7b-v2:latest#49fab83342a2" hx-get="/spooknik/beyonder-4x7b-v2:latest#49fab83342a2" hx-target="#file-explorer" hx-swap="innerHTML" hx-push-url="true"> <div class="font-medium text-neutral-800 text-sm group-hover:underline truncate sm:col-start-1 sm:col-span-2">模板</div> <div class="font-mono text-[13px] text-neutral-400 subpixel-antialiased truncate sm:col-start-3 sm:col-span-8"> <|im_start|>system {{ .System }}<|im_end|> <|im_start|>user {{ .Prompt }}<|im_end|> <|im_start|>assistant </div> <div class="hidden sm:block text-right text-xs text-neutral-400 sm:col-start-12">111B</div> </a>

README

原始模型 | GGUF 量化

这是一个中等规模的MoE模型，结合了openchat/openchat-3.5-1210、beowolx/CodeNinja-1.0-OpenChat-7B、maywell/PiVoT-0.1-Starling-LM-RP和WizardLM/WizardMath-7B-V1.1。

我认为这个模型非常好，体积更轻，比Mixtral好。

这是模型的V2版本，具有最新更新的量化（The Bloke的量化已过时）。

如有问题，请随时联系我。

Reddit: /u/spooknik | Discord: .spooknik