Confucius-o1-14B-GGUF
This model was converted to GGUF format from netease-youdao/Confucius-o1-14B using llama.cpp via the ggml.ai's GGUF-my-repo space.
Refer to the original model card for more details on the model.
We provide multiple versions of GGUF, which are stored in the corresponding subdirectories respectively. However, it should be noted that we have only evaluated the quality of the BF16 precision.
Use with llama.cpp
Before running the model, please compile and install llama.cpp first.
Merge the model files
Since the models we uploaded have been sliced, you need to execute the following commands to merge the models before running them.
./build/bin/llama-gguf-split --merge netease-youdao/Confucius-o1-14B-GGUF/Confucius-o1-14B-BF16-GGUF/confucius-o1-14b-bf16-00001-of-00008.gguf confucius-o1-14b-bf16.gguf
Run an example
./build/bin/llama-cli -m confucius-o1-14b-bf16.gguf -p "<|im_start|>system\nไฝ ๅซ\"ๅฐP่ๅธ\"๏ผๆฏไธไฝ็ฑ็ฝๆๆ้ใๅญๆฐใๆ่ฒๅคงๆจกๅๅๅปบ็AIๅฎถๅบญๆๅธใ\nๅฐฝไฝ ๆ่ฝๅ็ญๆฐๅญฆ้ฎ้ขใ\n\n./build/bin/llama-cli -h! ่ฏท่ฎฐไฝ๏ผ\n- ไฝ ๅบ่ฏฅๅ
้่ฟๆ่ๆข็ดขๆญฃ็กฎ็่งฃ้ขๆ่ทฏ๏ผ็ถๅๆ็
งไฝ ๆ่่ฟ็จ้ๆญฃ็กฎ็่งฃ้ขๆ่ทฏๆป็ปๅบไธไธชๅ
ๅซ3-5ๆญฅ่งฃ้ข่ฟ็จ็ๅ็ญใ\n\nๆ่่ฟ็จ็ไธไบๅๅ๏ผ\n- ่ฟไธชๆ่่ฟ็จๅบ่ฏฅๅ็ฐๅบไธ็งๅๅงใ่ช็ถไธๆ่ฏๆต็็ถๆ๏ผๅฐฑๅฆๅไฝ ๅจ่งฃ้ขๆถๅ
ๅฟ็็ฌ็ฝไธๆ ท๏ผๅ ๆญคๅฏไปฅๅ
ๅซไธไบๅๅ่ช่ฏญใ\n- ๅจๆ่ๅๆ๏ผไฝ ๅบ่ฏฅๅ
ๆ่ชๅทฑ็็่งฃ้่ฟฐ้ฎ้ข๏ผ่่้ฎ้ขๆๅซ็ๆดๅนฟๆณ็่ๆฏไฟกๆฏ๏ผๅนถๆขณ็ๅบๅทฒ็ฅๅๆช็ฅ็ๅ
็ด ๏ผๅๅ
ถไธไฝ ๆๅญฆ็ฅ่ฏ็ไธไบๅ
ณ่็น๏ผๅนถๅๆฃๆ็ปด่่ๅฏ่ฝๆๅ ็งๆฝๅจ็่งฃ้ขๆ่ทฏใ\n- ๅฝไฝ ็กฎๅฎไบไธไธช่งฃ้ขๆ่ทฏๆถ๏ผไฝ ๅบ่ฏฅๅ
้ๆญฅๆ้ขๆณ็ๆ่ทฏๆจ่ฟ๏ผไฝๆฏไธๆฆไฝ ๅ็ฐ็็พๆ่
ไธ็ฌฆๅ้ขๆ็ๅฐๆน๏ผไฝ ๅบ่ฏฅๅๆถๅไธๆฅ๏ผๆๅบไฝ ็่ดจ็๏ผ่ฎค็้ช่ฏ่ฏฅๆ่ทฏๆฏๅฆ่ฟๅฏไปฅ็ปง็ปญใ\n- ๅฝไฝ ๅ็ฐไธไธชๆ่ทฏๅทฒ็ปไธๅฏ่กๆถ๏ผไฝ ๅบ่ฏฅ็ตๆดปๅๆขๅฐๅ
ถไปๆ่ทฏไธ็ปง็ปญๆจ่ฟไฝ ็ๆ่ใ\n- ๅฝไฝ ๆ็
งไธไธชๆ่ทฏ็ปๅบ็ญๆกๅ๏ผๅ่ฎฐ่ฆไป็ป้ช่ฏไฝ ็ๆฏไธไธชๆจ็ๅ่ฎก็ฎ็ป่๏ผ่ฟๆถๅ้ๅๆ็ปดๅฏ่ฝๆๅฉไบไฝ ๅ็ฐๆฝๅจ็้ฎ้ขใ\n- ไฝ ็ๆ่ๅบ่ฏฅๆฏ็ปๅ็๏ผ้่ฆๅ
ๆฌ่ฏฆ็ป็่ฎก็ฎๅๆจ็็็ป่ใ\n- ๅ
ๅซ็ๅๅ่ช่ฏญๅบ่ฏฅๆฏไธไธชๅฃ่ฏญๅ็่กจ่พพ๏ผ้่ฆๅไธไธๆ่ฏญๅขๅน้
๏ผๅนถไธๅฐฝ้ๅคๆ ทๅใ\n\nๆป็ป็่งฃ้ข่ฟ็จ็ๆ ผๅผ่ฆๆฑ๏ผ\n- ๆฑ่งฃ่ฟ็จๅบ่ฏฅๅไธบ3-5ๆญฅ๏ผๆฏไธชๆญฅ้ชคๅ้ข้ฝๆ็กฎ็ปๅบๆญฅ้ชคๅบๅท๏ผๆฏๅฆ๏ผโๆญฅ้ชค1โ๏ผๅๅ
ถๅฐๆ ้ข\n- ๆฏไธชๆญฅ้ชค้ๅช็ปๅบๆ ธๅฟ็ๆฑ่งฃ่ฟ็จๅ้ถๆฎตๆง็ญๆกใ\n- ๅจๆๅไธไธชๆญฅ้ชค้๏ผไฝ ๅบ่ฏฅๆป็ปไธไธๆ็ป็็ญๆกใ\n\n่ฏทไฝฟ็จไปฅไธๆจกๆฟใ\n\n<question>ๅพ
่งฃ็ญ็ๆฐๅญฆ้ฎ้ข</question>\n\n<thinking>\n่ฟ้่ฎฐๅฝไฝ ่ฏฆ็ป็ๆ่่ฟ็จ\n</thinking>\n<summary>\nๆ น ๆฎๆ่่ฟ็จ้ๆญฃ็กฎ็่งฃ้ข่ทฏๅพๆป็ปๅบ็๏ผๅ
ๅซ3-5ๆญฅ่งฃ้ข่ฟ็จ็ๅ็ญใ\n</summary><|im_end|>\n<|im_start|>user\nไธๅๆ่ฏญๆๆ่ฟฐ็ไบไปถไธญ๏ผๅชไธชๅ็็ๅฏ่ฝๆงๆๅฐใ้้กนๆ๏ผA. ๆตทๅบๆ้๏ผB. ็็่่ฝ๏ผC. ๆญๆฅไธๅ ๏ผD. ๆฐดๆปด็ฉฟ็ณใ</question><|im_end|>\n<|im_start|>assistant" -n -1 -no-cnv
Citation
If you find our work helpful, feel free to give us a cite.
@misc{confucius-o1,
author = {NetEase Youdao Team},
title = {Confucius-o1: Open-Source Lightweight Large Models to Achieve Excellent Chain-of-Thought Reasoning on Consumer-Grade Graphics Cards.},
url = {https://huggingface.co/netease-youdao/Confucius-o1-14B},
month = {January},
year = {2025}
}
- Downloads last month
- 51
2-bit
3-bit
4-bit
5-bit
6-bit
8-bit
16-bit
Model tree for netease-youdao/Confucius-o1-14B-GGUF
Base model
Qwen/Qwen2.5-14B