hugging-quants/Llama-4-Scout-17B-16E-Instruct-fbgemm Image-Text-to-Text β’ 109B β’ Updated Apr 9, 2025 β’ 13 β’ 2
hugging-quants/Llama-4-Scout-17B-16E-Instruct-fbgemm-unfused Image-Text-to-Text β’ 109B β’ Updated Apr 9, 2025 β’ 15 β’ 2
hugging-quants/gemma-2-9b-it-AWQ-INT4 Text Generation β’ 9B β’ Updated Oct 17, 2024 β’ 801k β’ 10
hugging-quants/Mixtral-8x7B-Instruct-v0.1-AWQ-INT4 Text Generation β’ 47B β’ Updated Oct 7, 2024 β’ 2.68k
hugging-quants/Llama-3.2-1B-Instruct-Q4_K_M-GGUF Text Generation β’ 1B β’ Updated Sep 25, 2024 β’ 45.4k β’ 36
hugging-quants/Llama-3.2-1B-Instruct-Q8_0-GGUF Text Generation β’ 1B β’ Updated Sep 25, 2024 β’ 7.67k β’ 50
hugging-quants/Llama-3.2-3B-Instruct-Q4_K_M-GGUF Text Generation β’ 3B β’ Updated Sep 25, 2024 β’ 42.2k β’ 55
hugging-quants/Llama-3.2-3B-Instruct-Q8_0-GGUF Text Generation β’ 3B β’ Updated Sep 25, 2024 β’ 1.16k β’ 53
hugging-quants/Meta-Llama-3.1-405B-BNB-NF4 Text Generation β’ 418B β’ Updated Sep 16, 2024 β’ 109 β’ 2
hugging-quants/Meta-Llama-3.1-405B-Instruct-BNB-NF4 Text Generation β’ 423B β’ Updated Sep 16, 2024 β’ 25 β’ 5
hugging-quants/Meta-Llama-3.1-405B-BNB-NF4-BF16 Text Generation β’ 117B β’ Updated Sep 16, 2024 β’ 88 β’ 2
hugging-quants/Meta-Llama-3.1-405B-Instruct-AWQ-INT4 Text Generation β’ 410B β’ Updated Sep 13, 2024 β’ 721 β’ 39
hugging-quants/Meta-Llama-3.1-70B-BNB-NF4-BF16 Text Generation β’ 21B β’ Updated Aug 8, 2024 β’ 112 β’ 2
hugging-quants/Meta-Llama-3.1-8B-Instruct-BNB-NF4 Text Generation β’ 8B β’ Updated Aug 8, 2024 β’ 142 β’ 8
hugging-quants/Meta-Llama-3.1-8B-Instruct-AWQ-INT4 Text Generation β’ 8B β’ Updated Aug 7, 2024 β’ 325k β’ 96
hugging-quants/Meta-Llama-3.1-70B-Instruct-GPTQ-INT4 Text Generation β’ 71B β’ Updated Aug 7, 2024 β’ 970 β’ 23
hugging-quants/Meta-Llama-3.1-405B-Instruct-GPTQ-INT4 Text Generation β’ 410B β’ Updated Aug 7, 2024 β’ 130 β’ 18
hugging-quants/Meta-Llama-3.1-8B-Instruct-GPTQ-INT4 Text Generation β’ 8B β’ Updated Aug 7, 2024 β’ 1.35k β’ 42
hugging-quants/Meta-Llama-3.1-70B-Instruct-AWQ-INT4 Text Generation β’ 71B β’ Updated Aug 7, 2024 β’ 24.4k β’ 112