Richard Zhang

pootow's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in unsloth/Qwen3.8-27B-GGUF 6 days ago

Qwen3.8-27B Serving Configs: RTX 4090 llama.cpp GGUF

🚀 1

8

#11 opened 11 days ago by

erdal

Running Qwen3.8-27B on a Single RTX 3090 (24 GB) 45-70t/s with 150k context

🔥 2

5

#68 opened 8 days ago by

SergeySS8

New activity in lmstudio-community/DeepSeek-R1-Distill-Qwen-1.5B-GGUF over 1 year ago

error loading model vocabulary using latest version of LM Studio

3

#1 opened over 1 year ago by

pootow

New activity in unsloth/Qwen3-30B-A3B-GGUF over 1 year ago

`UD-Q4_K_XL` or `Q4_K_M`?

16

#6 opened over 1 year ago by

pootow

New activity in ByteDance-Seed/UI-TARS-1.5-7B over 1 year ago

how do I load this model in 4bit quant?

1

#1 opened over 1 year ago by

pootow

New activity in unsloth/QwQ-32B-GGUF over 1 year ago

why it use much more GPU memory than official model?

3

#7 opened over 1 year ago by

pootow

New activity in huihui-ai/DeepSeek-R1-Distill-Qwen-32B-abliterated over 1 year ago

bad performance

👍 2

8

#3 opened over 1 year ago by

gigascake

New activity in DavidAU/Gemma-The-Writer-N-Restless-Quill-10B-Uncensored-GGUF over 1 year ago

Switching languages in response

6

#6 opened over 1 year ago by

tlvranas

New activity in bigcode/near-deduplication about 2 years ago

It stopped working

1

#2 opened almost 3 years ago by

ZJaume

New activity in TheBloke/Phind-CodeLlama-34B-v2-AWQ over 2 years ago

I get repeated gibberish output all the time.

3

#3 opened over 2 years ago by

pootow

New activity in TheBloke/Llama-2-13B-chat-GPTQ about 3 years ago

Is this model based on `chat` or `chat-hf` model of llama2?

👍 1

3

#6 opened about 3 years ago by

pootow

New activity in TheBloke/Llama-2-13B-GPTQ about 3 years ago

Is this model based on `chat` or `chat-hf` model of llama2?

1

#2 opened about 3 years ago by

pootow

New activity in Anthropic/hh-rlhf over 3 years ago

Identical 'chosen' and 'rejected'

👍 3

2

#7 opened over 3 years ago by

yongchanghao

New activity in OFA-Sys/ofa-huge almost 4 years ago

Where is the checkpoint for tokenizer?

3

#1 opened almost 4 years ago by

pootow

Where is the checkpoint for tokenizer?

3

#1 opened almost 4 years ago by

pootow

Where is the checkpoint for tokenizer?

3

#1 opened almost 4 years ago by

pootow