Actual Models

Models recommended by Actual

Curated GGUF releases prepared for private inference on your own computers.

10 models30 variants

Updated

View registry JSON

Google3 variantsConversion date unavailable

Gemma 4 E2B IT

QuantizationQ8_0
Download5.5GB
Estimated memory6.4GB
run model
QuantizationQ6_K
Download4.5GB
Estimated memory5.2GB
run model
QuantizationQ4_K_M
Download4.1GB
Estimated memory4.7GB
run model
Technical details
Model ID
google/gemma-4-e2b-it@905e84b50c4d2a365ebde34e685027578e6728db
Owner
Actual Computer
License
apache-2.0
Source revision
google/gemma-4-E2B-it@905e84b50c4d2a365ebde34e685027578e6728db

Variant checksums

  • Q8_0e527942d0d2e904f2588beddc7fc901bcd8c6171713f92d6cd0cbe1071f68237
  • Q6_K78ea43d414ca7938d9b04089f1544e2a8ce717a379373b249eee6ac409fda2cd
  • Q4_K_Md576a86e7c21999bf78263253c87ab12c1375d04e6e6b2bb885cdfe971e0d5fb

Google3 variantsConversion date unavailable

Gemma 4 E4B IT

QuantizationQ8_0
Download8.4GB
Estimated memory9.7GB
run model
QuantizationQ6_K
Download6.7GB
Estimated memory7.7GB
run model
QuantizationQ4_K_M
Download5.9GB
Estimated memory6.8GB
run model
Technical details
Model ID
google/gemma-4-e4b-it@d6436b3d62967e1af08bbb046c6300b2a9ae8e85
Owner
Actual Computer
License
apache-2.0
Source revision
google/gemma-4-E4B-it@d6436b3d62967e1af08bbb046c6300b2a9ae8e85

Variant checksums

  • Q8_0ecacce4e487055edbc5feb435e1ca383a9d39a97aeb3e698125df626aeb820dd
  • Q6_K411d7e55487ab7cb32e732a2efbc5d6b55abe3df10769cf865fbbcd5df988f4b
  • Q4_K_M0d829a7f55dde54750d88cb3b5fed5b6af001605bbf220a9d1bdbf554a2bb34a

Google3 variantsConversion date unavailable

Gemma 4 12B IT

QuantizationQ8_0
Download12.0GB
Estimated memory13.8GB
run model
QuantizationQ6_K
Download9.3GB
Estimated memory10.7GB
run model
QuantizationQ4_K_M
Download7.0GB
Estimated memory8.1GB
run model
Technical details
Model ID
google/gemma-4-12b-it@5926caa4ec0cac5cbfadaf4077420520de1d5205
Owner
Actual Computer
License
apache-2.0
Source revision
google/gemma-4-12B-it@5926caa4ec0cac5cbfadaf4077420520de1d5205

Variant checksums

  • Q8_0c50e5032c4b8e347d5ba28f3a41e23f04b9f75aefc48d50d9b67962f1a049231
  • Q6_Ka34694bb62a2cde19b12d6ce613d2b65436776d93904b7d48607e8e8d4ae6dd7
  • Q4_K_Mb9d2a464e3718a5a96f950c129745a9964a4d35ee263d6ef14916242bce3cfbb

Google3 variantsConversion date unavailable

Gemma 4 26B A4B IT

QuantizationQ8_0
Download26.1GB
Estimated memory30.0GB
run model
QuantizationQ6_K
Download22.2GB
Estimated memory25.5GB
run model
QuantizationQ4_K_M
Download16.8GB
Estimated memory19.3GB
run model
Technical details
Model ID
google/gemma-4-26b-a4b-it@6e6f6edea8c52db2094dca3086e4b963a0034dfc
Owner
Actual Computer
License
apache-2.0
Source revision
google/gemma-4-26B-A4B-it@6e6f6edea8c52db2094dca3086e4b963a0034dfc

Variant checksums

  • Q8_0a373ef67674f0dd2a6ac1b7bf04fc84f22a4a426a60dab4a51c9c22534db79e9
  • Q6_Kb0f786ea663d29d3edc168f11885d8d32757a608d237d1690d06ff11c105a87b
  • Q4_K_Me7a9c0ba7de460d194941f5128fe4bc912b3ebb1b6725e799d89429266a6aa4a

Qwen3 variantsConversion date unavailable

Qwen3.8 27B

QuantizationQ8_0
Download30.9GB
Estimated memory35.5GB
run model
QuantizationQ6_K
Download24.7GB
Estimated memory28.4GB
run model
QuantizationQ4_K_M
Download19.5GB
Estimated memory22.4GB
run model
Technical details
Model ID
qwen/qwen3.8-27b@1d4bf0f2ff6012fd82039f2fa52739d0dd7c60c0
Owner
Actual Computer
License
apache-2.0
Source revision
Qwen/Qwen3.8-27B@1d4bf0f2ff6012fd82039f2fa52739d0dd7c60c0

Variant checksums

  • Q8_0b1f5ffc6b165f40ede4c3656857f81dfbca78582086034e649472ee4010d80c3
  • Q6_K13583411c4daf7ac24e4eccb403e40ccd56c41d3e364b23e9c4b59192b7a4366
  • Q4_K_Mc6054f4fe3502fcd96ee28150c6c6c0f4a1fb9889bd1b8b77d4d6193ab58f9a8

Meta3 variantsConversion date unavailable

Muse Glimmer 30B

QuantizationQ8_0
Download31.2GB
Estimated memory35.8GB
run model
QuantizationQ6_K
Download24.9GB
Estimated memory28.6GB
run model
QuantizationQ4_K_M
Download19.4GB
Estimated memory22.3GB
run model
Technical details
Model ID
meta-models/muse-glimmer-30b@97c77dff50b2797bcc558fa2d909761dbc575c59
Owner
Actual Computer
License
apache-2.0
Source revision
meta-models/Muse-Glimmer-30B@97c77dff50b2797bcc558fa2d909761dbc575c59

Variant checksums

  • Q8_02998873e80edd387960dd63c41c7d79bd2b992beff4b5caf03c5c0b144d4f3a4
  • Q6_Kb4b1af56d92229ec626212b7c00d527a6d61d42de72197be465846a7fafabaac
  • Q4_K_M984316a5bd706d417f0feb0c23051497a0fc1450283fc559668610ed909743c9

Google3 variantsConversion date unavailable

Gemma 4 31B IT

QuantizationQ8_0
Download31.5GB
Estimated memory36.2GB
run model
QuantizationQ6_K
Download24.6GB
Estimated memory28.3GB
run model
QuantizationQ4_K_M
Download18.5GB
Estimated memory21.3GB
run model
Technical details
Model ID
google/gemma-4-31b-it@fb9ae262347c3945692f09a612f8bb189def854f
Owner
Actual Computer
License
apache-2.0
Source revision
google/gemma-4-31B-it@fb9ae262347c3945692f09a612f8bb189def854f

Variant checksums

  • Q8_0f643e4ebd7d96f4c1b1a8292c5a69780fb317bf2327f2eceb2b2dfca38f46390
  • Q6_K3912f8f605a3af5ed96f9d93bd909a264cb7b55e2250a81f66a7dd51a877d986
  • Q4_K_M42c4902d0c7ef86a70d820fcc6fbffaa9aa5fe29c2883fdcd82526f1ad6b3a96

NVIDIA3 variantsConversion date unavailable

NVIDIA Nemotron 3.5 Lightning 30B A3B BF16

QuantizationQ8_0
Download32.6GB
Estimated memory37.5GB
run model
QuantizationQ6_K
Download32.5GB
Estimated memory37.4GB
run model
QuantizationQ4_K_M
Download23.7GB
Estimated memory27.2GB
run model
Technical details
Model ID
nvidia/nvidia-nemotron-3.5-lightning-30b-a3b-bf16@33268dc8a6da85a56be2b12241453e4e1237bbe1
Owner
Actual Computer
License
OpenMDW-1.1
Source revision
nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16@33268dc8a6da85a56be2b12241453e4e1237bbe1

Variant checksums

  • Q8_07c28974abe94badc0e760467f7ab63bd52928a68cd70aad665635536e576bcd6
  • Q6_Kabd85f4ec9afcdb8e766cb07ce528d20e8074e19ccefbceed18d425bba6635c0
  • Q4_K_Mc015ca2eb6dbfeeb5e3a684d32a9b975572ae4c9c5e30b5beb112582cc00c584

Nvidia3 variantsConversion date unavailable

Nemotron 3 Nano Omni 30B A3B Reasoning Bf16

QuantizationQ8_0
Download32.8GB
Estimated memory37.7GB
run model
QuantizationQ6_K
Download32.7GB
Estimated memory37.6GB
run model
QuantizationQ4_K_M
Download24.3GB
Estimated memory28.0GB
run model
Technical details
Model ID
nvidia/nemotron-3-nano-omni-30b-a3b-reasoning-bf16@87c1afb6dc3e5080345cc4e430146a44121541ac
Owner
Actual Computer
License
other
Source revision
nvidia/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-BF16@87c1afb6dc3e5080345cc4e430146a44121541ac

Variant checksums

  • Q8_0e5f4d467d5b890916a07a3d92204a4031e461506a8eb0f5a74073415921cc52e
  • Q6_K60a9b19a7917db52f8b2ab8182e4dabb2ae5e2c8a73cf1a1dcedd49678d51e26
  • Q4_K_M2e8742b94af603a0e54e976b8342be6d865af15f8e2e4930495d7fff219c1996

DeepSeek3 variantsConversion date unavailable

DeepSeek V4 Flash

QuantizationQ8_0
Download144.3GB
Estimated memory166.0GB
run model
QuantizationQ6_K
Download142.7GB
Estimated memory164.1GB
run model
QuantizationQ4_K_M
Download141.1GB
Estimated memory162.3GB
run model
Technical details
Model ID
deepseek-ai/deepseek-v4-flash@7872f01b1d1fe23eabc4c98b48bffcef5a386062
Owner
Actual Computer
License
mit
Source revision
deepseek-ai/DeepSeek-V4-Flash-0731@7872f01b1d1fe23eabc4c98b48bffcef5a386062

Variant checksums

  • Q8_02c1cc0b4cc43b87cff4064561065b7b0dcb338edcc1c6b0517ca3f25bf4899a4
  • Q6_Ke7c79585c7735281a0d12d8450855a0550e98474b9f7d31a0769e52160a470c2
  • Q4_K_Mfb18f5d102731b4d5ffdf8607730f727ce1cf8747059437a2dce450a4bb57717