Actual Models

Models recommended by Actual

Curated GGUF releases prepared for private inference on your own computers.

10 models30 variants

Updated

View registry JSON

DeepSeek3 variantsConversion date unavailable

DeepSeek V4 Flash

QuantizationQ8_0
Download144.3GB
Estimated memory166.0GB
run model
QuantizationQ6_K
Download142.7GB
Estimated memory164.1GB
run model
QuantizationQ4_K_M
Download141.1GB
Estimated memory162.3GB
run model
Technical details
Model ID
deepseek-ai/deepseek-v4-flash@7872f01b1d1fe23eabc4c98b48bffcef5a386062
Owner
Actual Computer
License
mit
Source revision
deepseek-ai/DeepSeek-V4-Flash-0731@7872f01b1d1fe23eabc4c98b48bffcef5a386062

Variant checksums

  • Q8_02c1cc0b4cc43b87cff4064561065b7b0dcb338edcc1c6b0517ca3f25bf4899a4
  • Q6_Ke7c79585c7735281a0d12d8450855a0550e98474b9f7d31a0769e52160a470c2
  • Q4_K_Mfb18f5d102731b4d5ffdf8607730f727ce1cf8747059437a2dce450a4bb57717

Nvidia3 variantsConversion date unavailable

Nemotron 3 Nano Omni 30B A3B Reasoning Bf16

QuantizationQ8_0
Download32.8GB
Estimated memory37.7GB
run model
QuantizationQ6_K
Download32.7GB
Estimated memory37.6GB
run model
QuantizationQ4_K_M
Download24.3GB
Estimated memory28.0GB
run model
Technical details
Model ID
nvidia/nemotron-3-nano-omni-30b-a3b-reasoning-bf16@87c1afb6dc3e5080345cc4e430146a44121541ac
Owner
Actual Computer
License
other
Source revision
nvidia/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-BF16@87c1afb6dc3e5080345cc4e430146a44121541ac

Variant checksums

  • Q8_0e5f4d467d5b890916a07a3d92204a4031e461506a8eb0f5a74073415921cc52e
  • Q6_K60a9b19a7917db52f8b2ab8182e4dabb2ae5e2c8a73cf1a1dcedd49678d51e26
  • Q4_K_M2e8742b94af603a0e54e976b8342be6d865af15f8e2e4930495d7fff219c1996

NVIDIA3 variantsConversion date unavailable

NVIDIA Nemotron 3.5 Lightning 30B A3B BF16

QuantizationQ8_0
Download32.6GB
Estimated memory37.5GB
run model
QuantizationQ6_K
Download32.5GB
Estimated memory37.4GB
run model
QuantizationQ4_K_M
Download23.7GB
Estimated memory27.2GB
run model
Technical details
Model ID
nvidia/nvidia-nemotron-3.5-lightning-30b-a3b-bf16@33268dc8a6da85a56be2b12241453e4e1237bbe1
Owner
Actual Computer
License
OpenMDW-1.1
Source revision
nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16@33268dc8a6da85a56be2b12241453e4e1237bbe1

Variant checksums

  • Q8_07c28974abe94badc0e760467f7ab63bd52928a68cd70aad665635536e576bcd6
  • Q6_Kabd85f4ec9afcdb8e766cb07ce528d20e8074e19ccefbceed18d425bba6635c0
  • Q4_K_Mc015ca2eb6dbfeeb5e3a684d32a9b975572ae4c9c5e30b5beb112582cc00c584

Google3 variantsConversion date unavailable

Gemma 4 31B IT

QuantizationQ8_0
Download31.5GB
Estimated memory36.2GB
run model
QuantizationQ6_K
Download24.6GB
Estimated memory28.3GB
run model
QuantizationQ4_K_M
Download18.5GB
Estimated memory21.3GB
run model
Technical details
Model ID
google/gemma-4-31b-it@fb9ae262347c3945692f09a612f8bb189def854f
Owner
Actual Computer
License
apache-2.0
Source revision
google/gemma-4-31B-it@fb9ae262347c3945692f09a612f8bb189def854f

Variant checksums

  • Q8_0f643e4ebd7d96f4c1b1a8292c5a69780fb317bf2327f2eceb2b2dfca38f46390
  • Q6_K3912f8f605a3af5ed96f9d93bd909a264cb7b55e2250a81f66a7dd51a877d986
  • Q4_K_M42c4902d0c7ef86a70d820fcc6fbffaa9aa5fe29c2883fdcd82526f1ad6b3a96

Meta3 variantsConversion date unavailable

Muse Glimmer 30B

QuantizationQ8_0
Download31.2GB
Estimated memory35.8GB
run model
QuantizationQ6_K
Download24.9GB
Estimated memory28.6GB
run model
QuantizationQ4_K_M
Download19.4GB
Estimated memory22.3GB
run model
Technical details
Model ID
meta-models/muse-glimmer-30b@97c77dff50b2797bcc558fa2d909761dbc575c59
Owner
Actual Computer
License
apache-2.0
Source revision
meta-models/Muse-Glimmer-30B@97c77dff50b2797bcc558fa2d909761dbc575c59

Variant checksums

  • Q8_02998873e80edd387960dd63c41c7d79bd2b992beff4b5caf03c5c0b144d4f3a4
  • Q6_Kb4b1af56d92229ec626212b7c00d527a6d61d42de72197be465846a7fafabaac
  • Q4_K_M984316a5bd706d417f0feb0c23051497a0fc1450283fc559668610ed909743c9

Qwen3 variantsConversion date unavailable

Qwen3.8 27B

QuantizationQ8_0
Download30.9GB
Estimated memory35.5GB
run model
QuantizationQ6_K
Download24.7GB
Estimated memory28.4GB
run model
QuantizationQ4_K_M
Download19.5GB
Estimated memory22.4GB
run model
Technical details
Model ID
qwen/qwen3.8-27b@1d4bf0f2ff6012fd82039f2fa52739d0dd7c60c0
Owner
Actual Computer
License
apache-2.0
Source revision
Qwen/Qwen3.8-27B@1d4bf0f2ff6012fd82039f2fa52739d0dd7c60c0

Variant checksums

  • Q8_0b1f5ffc6b165f40ede4c3656857f81dfbca78582086034e649472ee4010d80c3
  • Q6_K13583411c4daf7ac24e4eccb403e40ccd56c41d3e364b23e9c4b59192b7a4366
  • Q4_K_Mc6054f4fe3502fcd96ee28150c6c6c0f4a1fb9889bd1b8b77d4d6193ab58f9a8

Google3 variantsConversion date unavailable

Gemma 4 26B A4B IT

QuantizationQ8_0
Download26.1GB
Estimated memory30.0GB
run model
QuantizationQ6_K
Download22.2GB
Estimated memory25.5GB
run model
QuantizationQ4_K_M
Download16.8GB
Estimated memory19.3GB
run model
Technical details
Model ID
google/gemma-4-26b-a4b-it@6e6f6edea8c52db2094dca3086e4b963a0034dfc
Owner
Actual Computer
License
apache-2.0
Source revision
google/gemma-4-26B-A4B-it@6e6f6edea8c52db2094dca3086e4b963a0034dfc

Variant checksums

  • Q8_0a373ef67674f0dd2a6ac1b7bf04fc84f22a4a426a60dab4a51c9c22534db79e9
  • Q6_Kb0f786ea663d29d3edc168f11885d8d32757a608d237d1690d06ff11c105a87b
  • Q4_K_Me7a9c0ba7de460d194941f5128fe4bc912b3ebb1b6725e799d89429266a6aa4a

Google3 variantsConversion date unavailable

Gemma 4 12B IT

QuantizationQ8_0
Download12.0GB
Estimated memory13.8GB
run model
QuantizationQ6_K
Download9.3GB
Estimated memory10.7GB
run model
QuantizationQ4_K_M
Download7.0GB
Estimated memory8.1GB
run model
Technical details
Model ID
google/gemma-4-12b-it@5926caa4ec0cac5cbfadaf4077420520de1d5205
Owner
Actual Computer
License
apache-2.0
Source revision
google/gemma-4-12B-it@5926caa4ec0cac5cbfadaf4077420520de1d5205

Variant checksums

  • Q8_0c50e5032c4b8e347d5ba28f3a41e23f04b9f75aefc48d50d9b67962f1a049231
  • Q6_Ka34694bb62a2cde19b12d6ce613d2b65436776d93904b7d48607e8e8d4ae6dd7
  • Q4_K_Mb9d2a464e3718a5a96f950c129745a9964a4d35ee263d6ef14916242bce3cfbb

Google3 variantsConversion date unavailable

Gemma 4 E4B IT

QuantizationQ8_0
Download8.4GB
Estimated memory9.7GB
run model
QuantizationQ6_K
Download6.7GB
Estimated memory7.7GB
run model
QuantizationQ4_K_M
Download5.9GB
Estimated memory6.8GB
run model
Technical details
Model ID
google/gemma-4-e4b-it@d6436b3d62967e1af08bbb046c6300b2a9ae8e85
Owner
Actual Computer
License
apache-2.0
Source revision
google/gemma-4-E4B-it@d6436b3d62967e1af08bbb046c6300b2a9ae8e85

Variant checksums

  • Q8_0ecacce4e487055edbc5feb435e1ca383a9d39a97aeb3e698125df626aeb820dd
  • Q6_K411d7e55487ab7cb32e732a2efbc5d6b55abe3df10769cf865fbbcd5df988f4b
  • Q4_K_M0d829a7f55dde54750d88cb3b5fed5b6af001605bbf220a9d1bdbf554a2bb34a

Google3 variantsConversion date unavailable

Gemma 4 E2B IT

QuantizationQ8_0
Download5.5GB
Estimated memory6.4GB
run model
QuantizationQ6_K
Download4.5GB
Estimated memory5.2GB
run model
QuantizationQ4_K_M
Download4.1GB
Estimated memory4.7GB
run model
Technical details
Model ID
google/gemma-4-e2b-it@905e84b50c4d2a365ebde34e685027578e6728db
Owner
Actual Computer
License
apache-2.0
Source revision
google/gemma-4-E2B-it@905e84b50c4d2a365ebde34e685027578e6728db

Variant checksums

  • Q8_0e527942d0d2e904f2588beddc7fc901bcd8c6171713f92d6cd0cbe1071f68237
  • Q6_K78ea43d414ca7938d9b04089f1544e2a8ce717a379373b249eee6ac409fda2cd
  • Q4_K_Md576a86e7c21999bf78263253c87ab12c1375d04e6e6b2bb885cdfe971e0d5fb