From 085112601e67fe07930a512553b30739f9a33e2c Mon Sep 17 00:00:00 2001 From: hackit Date: Sat, 27 Jun 2026 14:41:24 +0000 Subject: [PATCH] docs: model mirror catalog --- README.md | 68 +++++++++++++++++++++++++++++++++++++++++++++++++++++-- 1 file changed, 66 insertions(+), 2 deletions(-) diff --git a/README.md b/README.md index a25b77d..0c23b9b 100644 --- a/README.md +++ b/README.md @@ -1,3 +1,67 @@ -# mate-local-models +# MATE — Lokale Modelle (Mirror-Katalog) -MATE lokale Modelle — Mirror-Katalog (manifest.json + Download-Links, Dateien via CDN) \ No newline at end of file +Öffentlicher Spiegel der lokalen MATE-Modelle für iOS, Android und Desktop. Dieses Repo ist der **Katalog**: `manifest.json` + Download-Links. Die eigentlichen Modell-Dateien werden statisch über das CDN ausgeliefert (nicht in Git eingecheckt — die größten Dateien sind >20 GB). + +- **Manifest (Maschinen-lesbar):** `https://llm.flsk.cloud/local/local-llm/manifest.json` +- **Mirror-Basis:** `https://llm.flsk.cloud/local/local-llm/` +- **Umfang:** 23 Modelle · 153.62 GB · Stand 2026-06-26 +- **Quelle:** Modelle.md (MATE Modellstrategie) + +## Schnellstart + +```bash +# Katalog laden +curl -s https://llm.flsk.cloud/local/local-llm/manifest.json | jq . + +# Beispiel: ein GGUF-Modell holen +curl -LO https://llm.flsk.cloud/local/local-llm/chat/gguf/unsloth/Qwen3.5-2B-GGUF/Qwen3.5-2B-Q4_K_M.gguf +``` + +## Chat · MLX (iOS / macOS) + +| Modell | Rolle | Plattform | Größe | HF-Repo | Mirror | +|---|---|---|---:|---|---| +| Qwen 3.5 (2B) · MLX | Mobile Default | iOS/macOS | 1.75 GB | [mlx-community/Qwen3.5-2B-MLX-4bit](https://huggingface.co/mlx-community/Qwen3.5-2B-MLX-4bit) | [Ordner](https://llm.flsk.cloud/local/local-llm/chat/mlx/mlx-community/Qwen3.5-2B-MLX-4bit) | +| Qwen 3.5 (0.8B) · MLX | Mobile Fallback | iOS/macOS | 0.65 GB | [mlx-community/Qwen3.5-0.8B-MLX-4bit](https://huggingface.co/mlx-community/Qwen3.5-0.8B-MLX-4bit) | [Ordner](https://llm.flsk.cloud/local/local-llm/chat/mlx/mlx-community/Qwen3.5-0.8B-MLX-4bit) | +| Qwen 3.5 (4B) · MLX | Desktop Default / Mobile Strong | iOS/macOS | 3.06 GB | [mlx-community/Qwen3.5-4B-MLX-4bit](https://huggingface.co/mlx-community/Qwen3.5-4B-MLX-4bit) | [Ordner](https://llm.flsk.cloud/local/local-llm/chat/mlx/mlx-community/Qwen3.5-4B-MLX-4bit) | +| Qwen 3.5 (9B) · MLX | Desktop Strong | macOS | 5.98 GB | [mlx-community/Qwen3.5-9B-MLX-4bit](https://huggingface.co/mlx-community/Qwen3.5-9B-MLX-4bit) | [Ordner](https://llm.flsk.cloud/local/local-llm/chat/mlx/mlx-community/Qwen3.5-9B-MLX-4bit) | +| Qwen 3.6 (35B A3B) · MLX | Desktop Flagship (MoE) | macOS | 20.43 GB | [mlx-community/Qwen3.6-35B-A3B-4bit](https://huggingface.co/mlx-community/Qwen3.6-35B-A3B-4bit) | [Ordner](https://llm.flsk.cloud/local/local-llm/chat/mlx/mlx-community/Qwen3.6-35B-A3B-4bit) | +| Gemma 4 (E2B) · MLX | Mobile Gemma (small) | iOS/macOS | 3.61 GB | [mlx-community/gemma-4-e2b-it-4bit](https://huggingface.co/mlx-community/gemma-4-e2b-it-4bit) | [Ordner](https://llm.flsk.cloud/local/local-llm/chat/mlx/mlx-community/gemma-4-e2b-it-4bit) | +| Gemma 4 (E4B) · MLX | Gemma Standard | iOS/macOS | 5.25 GB | [mlx-community/gemma-4-e4b-it-4bit](https://huggingface.co/mlx-community/gemma-4-e4b-it-4bit) | [Ordner](https://llm.flsk.cloud/local/local-llm/chat/mlx/mlx-community/gemma-4-e4b-it-4bit) | +| Gemma 4 (12B) · MLX | Desktop Strong | macOS | 6.77 GB | [mlx-community/gemma-4-12B-it-4bit](https://huggingface.co/mlx-community/gemma-4-12B-it-4bit) | [Ordner](https://llm.flsk.cloud/local/local-llm/chat/mlx/mlx-community/gemma-4-12B-it-4bit) | +| Gemma 4 (26B A4B) · MLX | Desktop Flagship (MoE) | macOS | 15.64 GB | [mlx-community/gemma-4-26b-a4b-it-4bit](https://huggingface.co/mlx-community/gemma-4-26b-a4b-it-4bit) | [Ordner](https://llm.flsk.cloud/local/local-llm/chat/mlx/mlx-community/gemma-4-26b-a4b-it-4bit) | + +## Chat · GGUF (Android / Linux / Windows) + +| Modell | Rolle | Plattform | Größe | HF-Repo | Mirror | +|---|---|---|---:|---|---| +| Qwen 3.5 (0.8B) · GGUF Q4_K_M | Mobile/Android Fallback | Android/Linux/Windows | 0.74 GB | [unsloth/Qwen3.5-0.8B-GGUF](https://huggingface.co/unsloth/Qwen3.5-0.8B-GGUF) | [Ordner](https://llm.flsk.cloud/local/local-llm/chat/gguf/unsloth/Qwen3.5-0.8B-GGUF) | +| Qwen 3.5 (2B) · GGUF Q4_K_M | Mobile/Android Default | Android/Linux/Windows | 1.95 GB | [unsloth/Qwen3.5-2B-GGUF](https://huggingface.co/unsloth/Qwen3.5-2B-GGUF) | [Ordner](https://llm.flsk.cloud/local/local-llm/chat/gguf/unsloth/Qwen3.5-2B-GGUF) | +| Qwen 3.5 (4B) · GGUF Q4_K_M | Desktop / Android Strong | Android/Linux/Windows | 3.41 GB | [unsloth/Qwen3.5-4B-GGUF](https://huggingface.co/unsloth/Qwen3.5-4B-GGUF) | [Ordner](https://llm.flsk.cloud/local/local-llm/chat/gguf/unsloth/Qwen3.5-4B-GGUF) | +| Qwen 3.5 (9B) · GGUF Q4_K_M | Desktop Strong | Linux/Windows | 6.60 GB | [unsloth/Qwen3.5-9B-GGUF](https://huggingface.co/unsloth/Qwen3.5-9B-GGUF) | [Ordner](https://llm.flsk.cloud/local/local-llm/chat/gguf/unsloth/Qwen3.5-9B-GGUF) | +| Qwen 3.6 (35B A3B) · GGUF UD-Q4_K_M | Desktop Flagship (MoE) | Linux/Windows | 23.03 GB | [unsloth/Qwen3.6-35B-A3B-GGUF](https://huggingface.co/unsloth/Qwen3.6-35B-A3B-GGUF) | [Ordner](https://llm.flsk.cloud/local/local-llm/chat/gguf/unsloth/Qwen3.6-35B-A3B-GGUF) | +| Gemma 4 (E2B) · GGUF QAT UD-Q2_K_XL | Android Gemma small (QAT) | Android | 3.17 GB | [unsloth/gemma-4-E2B-it-qat-mobile-GGUF](https://huggingface.co/unsloth/gemma-4-E2B-it-qat-mobile-GGUF) | [Ordner](https://llm.flsk.cloud/local/local-llm/chat/gguf/unsloth/gemma-4-E2B-it-qat-mobile-GGUF) | +| Gemma 4 (E4B) · GGUF QAT UD-Q2_K_XL | Android Gemma strong (QAT) | Android | 4.21 GB | [unsloth/gemma-4-E4B-it-qat-mobile-GGUF](https://huggingface.co/unsloth/gemma-4-E4B-it-qat-mobile-GGUF) | [Ordner](https://llm.flsk.cloud/local/local-llm/chat/gguf/unsloth/gemma-4-E4B-it-qat-mobile-GGUF) | +| Gemma 4 (E4B) · GGUF Q4_K_M | Desktop Gemma Standard | Linux/Windows | 5.97 GB | [unsloth/gemma-4-E4B-it-GGUF](https://huggingface.co/unsloth/gemma-4-E4B-it-GGUF) | [Ordner](https://llm.flsk.cloud/local/local-llm/chat/gguf/unsloth/gemma-4-E4B-it-GGUF) | +| Gemma 4 (12B) · GGUF Q4_K_M | Desktop Gemma Strong | Linux/Windows | 7.30 GB | [unsloth/gemma-4-12b-it-GGUF](https://huggingface.co/unsloth/gemma-4-12b-it-GGUF) | [Ordner](https://llm.flsk.cloud/local/local-llm/chat/gguf/unsloth/gemma-4-12b-it-GGUF) | +| Gemma 4 (26B A4B) · GGUF UD-Q4_K_M | Desktop Gemma Flagship (MoE) | Linux/Windows | 18.14 GB | [unsloth/gemma-4-26B-A4B-it-GGUF](https://huggingface.co/unsloth/gemma-4-26B-A4B-it-GGUF) | [Ordner](https://llm.flsk.cloud/local/local-llm/chat/gguf/unsloth/gemma-4-26B-A4B-it-GGUF) | + +## Bildgenerierung · MLX + +| Modell | Rolle | Plattform | Größe | HF-Repo | Mirror | +|---|---|---|---:|---|---| +| Bonsai Image Ternary 4B · MLX 2bit | Image Desktop Default | macOS | 3.89 GB | [prism-ml/bonsai-image-ternary-4B-mlx-2bit](https://huggingface.co/prism-ml/bonsai-image-ternary-4B-mlx-2bit) | [Ordner](https://llm.flsk.cloud/local/local-llm/image/mlx/prism-ml/bonsai-image-ternary-4B-mlx-2bit) | +| Bonsai Image Binary 4B · MLX 1bit | Image Mobile (validate runtime) | iOS | 3.43 GB | [prism-ml/bonsai-image-binary-4B-mlx-1bit](https://huggingface.co/prism-ml/bonsai-image-binary-4B-mlx-1bit) | [Ordner](https://llm.flsk.cloud/local/local-llm/image/mlx/prism-ml/bonsai-image-binary-4B-mlx-1bit) | + +## Bildgenerierung · Gemlite (NVIDIA) + +| Modell | Rolle | Plattform | Größe | HF-Repo | Mirror | +|---|---|---|---:|---|---| +| Bonsai Image Ternary 4B · Gemlite 2bit | Image Desktop NVIDIA | Linux/Windows (NVIDIA) | 4.55 GB | [prism-ml/bonsai-image-ternary-4B-gemlite-2bit](https://huggingface.co/prism-ml/bonsai-image-ternary-4B-gemlite-2bit) | [Ordner](https://llm.flsk.cloud/local/local-llm/image/gemlite/prism-ml/bonsai-image-ternary-4B-gemlite-2bit) | +| Bonsai Image Binary 4B · Gemlite 1bit | Image NVIDIA small | Linux/Windows (NVIDIA) | 4.09 GB | [prism-ml/bonsai-image-binary-4B-gemlite-1bit](https://huggingface.co/prism-ml/bonsai-image-binary-4B-gemlite-1bit) | [Ordner](https://llm.flsk.cloud/local/local-llm/image/gemlite/prism-ml/bonsai-image-binary-4B-gemlite-1bit) | + +## Hinweise + +- MLX-Modelle sind Multi-File-Snapshots (Safetensors + Tokenizer + Config) — die Dateiliste pro Modell steht im `manifest.json` (`files`), die Einzel-URL ist `//`. +- GGUF-Modelle enthalten nur die Runtime-Quantisierung (Q4_K_M / UD-Q4_K_M / UD-Q2_K_XL) plus `mmproj-F16.gguf` für Vision/Attachments. +- Desktop-Flaggschiffe (Qwen 3.6 35B, Gemma 4 12B/26B) sind **nicht** für Mobile vorgesehen.