Ton Cao

cpatonn's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in cyankiwi/Qwen3.8-27B-AWQ-INT4 about 1 month ago

Fix MTP ignore names for SGLang fused Linear layers (`qkv_proj` / `gate_up_proj`)

1

#9 opened about 1 month ago by

dived42

New activity in cyankiwi/Ornith-1.5-35B-A3B-AWQ-INT4 about 1 month ago

Loading issue on ROCm — asymmetric `compressed-tensors` MoE not supported in vLLM

1

#2 opened about 1 month ago by

tensornet

New activity in cyankiwi/gemma-4-26B-A4B-it-AWQ-4bit about 1 month ago

Sync chat_template.jinja with upstream google/gemma-4-26B-A4B-it

1

#10 opened about 1 month ago by

Johnson145

New activity in cyankiwi/GLM-5.3-Flash-AWQ-INT4 about 2 months ago

layer 44's 288 experts are left bf16

2

#1 opened about 2 months ago by

MirecX

New activity in cyankiwi/Qwen3.8-Flash-Next-AWQ-INT4 about 2 months ago

Running Qwen3.8-Flash-Next-AWQ-INT4

12

#1 opened about 2 months ago by

cpatonn

New activity in cyankiwi/Qwen3.8-27B-AWQ-INT4 2 months ago

Do AWQ-BF16-INT4

➕ 9

7

#1 opened 2 months ago by

ab22k

!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!

1

#3 opened 2 months ago by

zhnagchenchne

New activity in cyankiwi/Muse-Glimmer-30B-AWQ-INT4 2 months ago

Tool Calling and Reasoning Question

👀 1

2

#1 opened 2 months ago by

kalashshah19

New activity in cyankiwi/GLM-5.2-AWQ-INT4 3 months ago

Looking forward to testing this, thanks!

9

#1 opened 4 months ago by

dnhkng

New activity in cyankiwi/Laguna-S-2.1-AWQ-INT4 3 months ago

Loops

2

#1 opened 3 months ago by

valentijnvenus

New activity in cyankiwi/Hy3-AWQ-NVFP4 3 months ago

AWQ Dataset

2

#1 opened 3 months ago by

Dsturb

New activity in cyankiwi/MiniMax-M3-AWQ-INT4 4 months ago

generation settings???

2

#6 opened 4 months ago by

yuchenxie

New activity in cyankiwi/Ornith-1.0-35B-AWQ-FP8 4 months ago

Wrong files?

1

#1 opened 4 months ago by

ztsvvstz

New activity in cyankiwi/Qwen3.6-27B-AWQ-BF16-INT4 4 months ago

F16 or BF16?

6

#6 opened 5 months ago by

qenme

New activity in cyankiwi/MiniMax-M2.7-AWQ-4bit 4 months ago

Is there a plan to upload the M3 model?

👍 1

1

#4 opened 4 months ago by

chengongliang

New activity in cyankiwi/Step-3.7-Flash-AWQ-INT4 4 months ago

how to use it

10

#1 opened 4 months ago by

iSource1

New activity in cyankiwi/Nex-N2-mini-AWQ-INT4 4 months ago

error trying to run mini on a single 5090

1

#1 opened 4 months ago by

robert896r1

New activity in cyankiwi/Mellum2-12B-A2.5B-Thinking-AWQ-INT4 4 months ago

Unable to serve model, got "Only symmetric quantization is supported for MoE" using vllm 0.22.1

1

#1 opened 4 months ago by

ricky-cck

New activity in cyankiwi/gemma-4-12B-it-qat-AWQ-INT4 4 months ago

Vllm and SgLang command please

👍 1

5

#1 opened 4 months ago by

mtcl

New activity in cyankiwi/Qwen3.6-35B-A3B-AWQ-4bit 4 months ago

New Safetensors upload

2

#8 opened 5 months ago by

meganoob1337