Note: All model files below must be downloaded via the LM Downloader client. If you do not have the client, Download >>>
Gemma is a family of lightweight, state-of-the-art open models from Google, built from the same research and technology used to create the Gemini models. Gemma 3 models are multimodal, handling text and image input and generating text output, with open weights for both pre-trained variants and instruction-tuned variants.
| Name | Size | Target Dir |
|---|---|---|
| gemma-3-12b-it-qat-UD-IQ1_S.gguf | 3.06 GB | text_encoders |
| gemma-3-12b-it-qat-UD-IQ1_M.gguf | 3.25 GB | text_encoders |
| gemma-3-12b-it-qat-UD-IQ2_XXS.gguf | 3.60 GB | text_encoders |
| gemma-3-12b-it-qat-UD-IQ2_M.gguf | 4.37 GB | text_encoders |
| gemma-3-12b-it-qat-Q2_K.gguf | 4.77 GB | text_encoders |
| gemma-3-12b-it-qat-Q2_K_L.gguf | 4.77 GB | text_encoders |
| gemma-3-12b-it-qat-UD-IQ3_XXS.gguf | 4.83 GB | text_encoders |
| gemma-3-12b-it-qat-UD-Q2_K_XL.gguf | 4.86 GB | text_encoders |
| gemma-3-12b-it-qat-Q3_K_S.gguf | 5.46 GB | text_encoders |
| gemma-3-12b-it-qat-Q3_K_M.gguf | 6.01 GB | text_encoders |
| gemma-3-12b-it-qat-UD-Q3_K_XL.gguf | 6.14 GB | text_encoders |
| gemma-3-12b-it-qat-IQ4_XS.gguf | 6.55 GB | text_encoders |
| gemma-3-12b-it-qat-IQ4_NL.gguf | 6.89 GB | text_encoders |
| gemma-3-12b-it-qat-Q4_0.gguf | 6.91 GB | text_encoders |
| gemma-3-12b-it-qat-Q4_K_S.gguf | 6.94 GB | text_encoders |
| gemma-3-12b-it-qat-Q4_K_M.gguf | 7.30 GB | text_encoders |
| gemma-3-12b-it-qat-UD-Q4_K_XL.gguf | 7.43 GB | text_encoders |
| gemma-3-12b-it-qat-Q4_1.gguf | 7.56 GB | text_encoders |
| gemma-3-12b-it-qat-Q5_K_S.gguf | 8.23 GB | text_encoders |
| gemma-3-12b-it-qat-Q5_K_M.gguf | 8.45 GB | text_encoders |
| gemma-3-12b-it-qat-UD-Q5_K_XL.gguf | 8.46 GB | text_encoders |
| gemma-3-12b-it-qat-Q6_K.gguf | 9.66 GB | text_encoders |
| gemma-3-12b-it-qat-UD-Q6_K_XL.gguf | 10.56 GB | text_encoders |
| gemma-3-12b-it-qat-Q8_0.gguf | 12.51 GB | text_encoders |
| gemma-3-12b-it-qat-UD-Q8_K_XL.gguf | 14.39 GB | text_encoders |
| gemma-3-12b-it-qat-BF16.gguf | 23.54 GB | text_encoders |