Pyodide LLM

ブラウザ上の WebAssembly 版 Python（Pyodide）で言語モデルを動かす実験です。読み込み・トークナイザ・サンプリング・生成のループは素の Python で、1 トークンぶんの計算は WASM SIMD カーネルが、使える端末では複数のコアで行います。実験なのでモデルは小さく、出力はそれなりです。既定のモデルは問いに答えられる Shisa V2.1c LFM2 350M で、初回は Hugging Face から 379 MB を取得してこのブラウザの中で変換します。取得を減らすならもあります。いちばん軽いモデルはです。一覧の最後のグループも同じように Hugging Face から取得して変換します。この端末の CPU・GPU・保存・回線はベンチマークでまとめて測れます。くわしくは Pyodide LLM の概要へ。

An experiment in running language models on Python on WebAssembly (Pyodide) in the browser: loading, the tokenizer, the sampling and the generation loop are plain Python, and the computation of each token runs in WASM SIMD kernels, on several cores where the device allows. The default model, Shisa V2.1c LFM2 350M, answers questions: the first visit fetches its 379 MB from Hugging Face and converts it right here. fetches less. is the lightest model. The last group of the list is fetched and converted the same way. The benchmark measures this device's CPU, GPU, storage and line in one run.

このプロジェクトについて / About, models and licenses

github.com/takano32/pyodide-llm
Pyodide LLM の概要: しくみと計測結果のまとめ / how it works and what was measured (in Japanese)
Pyodide: Python for the browser, based on WebAssembly
llama2.py and llama2.c, which the NumPy engine is a port of
Measure this browser: the model of this page with and without the kernels, as a table you can copy or report (every step takes longer)
Benchmark this device: that and more in one run (the CPU, the GPU, the storage and the line), one report

The models and their licenses. The models of the last group are fetched from Hugging Face when you choose one, and converted to int8 in this browser.

sbintuitions/tiny-lm (MIT License): SB Intuitions tiny-lm 29M, SB Intuitions tiny-lm 29M (original)
llm-jp/llm-jp-3-150m (Apache License 2.0): llm-jp-3 150M, llm-jp-3 150M (original)
karpathy/tinyllamas (MIT License): Andrej Karpathy TinyStories 260K, Andrej Karpathy TinyStories 15M, Andrej Karpathy TinyStories 42M, Andrej Karpathy TinyStories 15M (original), Andrej Karpathy TinyStories 42M (original)
ellishg/tinyllamas (MIT License): Ellis Hoag TinyStories 3.5M
rinna/japanese-gpt2-xsmall (MIT License): rinna japanese-gpt2 xsmall
rinna/japanese-gpt2-small (MIT License): rinna japanese-gpt2 small
llm-jp/llm-jp-3-150m-instruct3 (Apache License 2.0): llm-jp-3 150M instruct3
rinna/japanese-gpt-neox-small (MIT License): rinna japanese-gpt-neox small
LiquidAI/LFM2.5-230M (LFM Open License v1.0): Liquid AI LFM2.5 230M
LiquidAI/LFM2.5-230M-GGUF (LFM Open License v1.0): Liquid AI LFM2.5 230M (GGUF)
shisa-ai/shisa-v2.1c-lfm2-350m (LFM Open License v1.0): Shisa V2.1c LFM2 350M (4-bit), Shisa V2.1c LFM2 350M
mradermacher/shisa-v2.1c-lfm2-350m-GGUF (LFM Open License v1.0): Shisa V2.1c LFM2 350M (4-bit) (GGUF), Shisa V2.1c LFM2 350M (GGUF)
google/gemma-3-270m-it (Gemma Terms of Use): Google Gemma 3 270M. Gemma is provided under and subject to the Gemma Terms of Use found at ai.google.dev/gemma/terms
unsloth/gemma-3-270m-it (Gemma Terms of Use): Google Gemma 3 270M (copy)
unsloth/gemma-3-270m-it-GGUF (Gemma Terms of Use): Google Gemma 3 270M (GGUF)
rinna/japanese-gpt2-medium (MIT License): rinna japanese-gpt2 medium
LiquidAI/LFM2.5-350M (LFM Open License v1.0): Liquid AI LFM2.5 350M
LiquidAI/LFM2.5-350M-GGUF (LFM Open License v1.0): Liquid AI LFM2.5 350M (GGUF)
prism-ml/Ternary-Bonsai-1.7B-unpacked (Apache License 2.0): Prism ML Ternary Bonsai 1.7B
prism-ml/Ternary-Bonsai-1.7B-gguf (Apache License 2.0): Prism ML Ternary Bonsai 1.7B (GGUF)
llm-jp/llm-jp-3-440m (Apache License 2.0): llm-jp-3 440M
llm-jp/llm-jp-3-440m-instruct3 (Apache License 2.0): llm-jp-3 440M instruct3
Qwen/Qwen2.5-0.5B-Instruct (Apache License 2.0): Alibaba Qwen2.5 0.5B Instruct
bartowski/Qwen2.5-0.5B-Instruct-GGUF (Apache License 2.0): Alibaba Qwen2.5 0.5B Instruct (GGUF)
Qwen/Qwen3-0.6B (Apache License 2.0): Alibaba Qwen3 0.6B (thinking), Alibaba Qwen3 0.6B (no thinking)
unsloth/Qwen3-0.6B-GGUF (Apache License 2.0): Alibaba Qwen3 0.6B (thinking) (GGUF), Alibaba Qwen3 0.6B (no thinking) (GGUF)
LiquidAI/LFM2-700M (LFM Open License v1.0): Liquid AI LFM2 700M
LiquidAI/LFM2-700M-GGUF (LFM Open License v1.0): Liquid AI LFM2 700M (GGUF)
Qwen/Qwen3.5-0.8B (Apache License 2.0): Alibaba Qwen3.5 0.8B (thinking), Alibaba Qwen3.5 0.8B (no thinking)
unsloth/Qwen3.5-0.8B-GGUF (Apache License 2.0): Alibaba Qwen3.5 0.8B (thinking) (GGUF), Alibaba Qwen3.5 0.8B (no thinking) (GGUF)
Takenoko12345678/Qwen3.5-0.8B-Japanese-SFT-v2.5 (Apache License 2.0): Atemoya Qwen3.5 0.8B Japanese SFT v2.5 (thinking), Atemoya Qwen3.5 0.8B Japanese SFT v2.5 (no thinking)
Takenoko12345678/Qwen3.5-0.8B-Japanese-SFT-v2.5-GGUF (Apache License 2.0): Atemoya Qwen3.5 0.8B Japanese SFT v2.5 (thinking) (GGUF), Atemoya Qwen3.5 0.8B Japanese SFT v2.5 (no thinking) (GGUF)
sbintuitions/sarashina2.2-0.5b (MIT License): SB Intuitions sarashina2.2 0.5B
mradermacher/sarashina2.2-0.5b-GGUF (MIT License): SB Intuitions sarashina2.2 0.5B (GGUF)
sbintuitions/sarashina2.2-0.5b-instruct-v0.1 (MIT License): SB Intuitions sarashina2.2 0.5B Instruct
mmnga/sarashina2.2-0.5b-instruct-v0.1-gguf (MIT License): SB Intuitions sarashina2.2 0.5B Instruct (GGUF)
cyberagent/CAT-Translate-0.8b (MIT License): CyberAgent CAT-Translate 0.8B
mmnga-o/CAT-Translate-0.8b-gguf (MIT License): CyberAgent CAT-Translate 0.8B (GGUF)
llm-jp/llm-jp-3-980m-instruct3 (Apache License 2.0): llm-jp-3 980M instruct3
mmnga/llm-jp-3-980m-instruct3-gguf (Apache License 2.0): llm-jp-3 980M instruct3 (GGUF)
prism-ml/Ternary-Bonsai-4B-unpacked (Apache License 2.0): Prism ML Ternary Bonsai 4B
prism-ml/Ternary-Bonsai-4B-gguf (Apache License 2.0): Prism ML Ternary Bonsai 4B (GGUF)
google/gemma-3-1b-it (Gemma Terms of Use): Google Gemma 3 1B. Gemma is provided under and subject to the Gemma Terms of Use found at ai.google.dev/gemma/terms
unsloth/gemma-3-1b-it (Gemma Terms of Use): Google Gemma 3 1B (copy)
unsloth/gemma-3-1b-it-GGUF (Gemma Terms of Use): Google Gemma 3 1B (GGUF)
LiquidAI/LFM2.5-1.2B-Instruct (LFM Open License v1.0): Liquid AI LFM2.5 1.2B Instruct
LiquidAI/LFM2.5-1.2B-Instruct-GGUF (LFM Open License v1.0): Liquid AI LFM2.5 1.2B Instruct (GGUF)
LiquidAI/LFM2.5-1.2B-JP-202606 (LFM Open License v1.0): Liquid AI LFM2.5 1.2B JP
LiquidAI/LFM2.5-1.2B-JP-202606-GGUF (LFM Open License v1.0): Liquid AI LFM2.5 1.2B JP (GGUF)
shisa-ai/shisa-v2.1-lfm2-1.2b (LFM Open License v1.0): Shisa V2.1 LFM2 1.2B
mradermacher/shisa-v2.1-lfm2-1.2b-GGUF (LFM Open License v1.0): Shisa V2.1 LFM2 1.2B (GGUF)
rinna/japanese-gpt-1b (MIT License): rinna japanese-gpt 1B
sbintuitions/sarashina2.2-1b-instruct-v0.1 (MIT License): SB Intuitions sarashina2.2 1B Instruct
mmnga/sarashina2.2-1b-instruct-v0.1-gguf (MIT License): SB Intuitions sarashina2.2 1B Instruct (GGUF)
cyberagent/CAT-Translate-1.4b (MIT License): CyberAgent CAT-Translate 1.4B
mmnga-o/CAT-Translate-1.4b-gguf (MIT License): CyberAgent CAT-Translate 1.4B (GGUF)
sbintuitions/sarashina2.2-1b (MIT License): SB Intuitions sarashina2.2 1B
mradermacher/sarashina2.2-1b-GGUF (MIT License): SB Intuitions sarashina2.2 1B (GGUF)
stockmark/gpt-neox-japanese-1.4b (MIT License): Stockmark gpt-neox-japanese 1.4B
SakanaAI/TinySwallow-1.5B-Instruct (Apache License 2.0 (derived from Qwen), and the Gemma Terms of Use and Prohibited Use Policy (trained on Gemma data)): Sakana AI TinySwallow 1.5B Instruct
SakanaAI/TinySwallow-1.5B-Instruct-GGUF (Apache License 2.0 (derived from Qwen), and the Gemma Terms of Use and Prohibited Use Policy (trained on Gemma data)): Sakana AI TinySwallow 1.5B Instruct (GGUF)
Rakuten/RakutenAI-2.0-mini-instruct (Apache License 2.0): RakutenAI 2.0 mini instruct
mmnga/RakutenAI-2.0-mini-instruct-gguf (Apache License 2.0): RakutenAI 2.0 mini instruct (GGUF)
Qwen/Qwen2.5-1.5B-Instruct (Apache License 2.0): Alibaba Qwen2.5 1.5B Instruct
bartowski/Qwen2.5-1.5B-Instruct-GGUF (Apache License 2.0): Alibaba Qwen2.5 1.5B Instruct (GGUF)
line-corporation/japanese-large-lm-1.7b (Apache License 2.0): LINE japanese-large-lm 1.7B
mmnga/line-corp-japanese-large-lm-1.7b-gguf (Apache License 2.0): LINE japanese-large-lm 1.7B (GGUF)
line-corporation/japanese-large-lm-1.7b-instruction-sft (Apache License 2.0): LINE japanese-large-lm 1.7B instruction-sft
mmnga/line-corp-japanese-large-lm-1.7b-instruction-sft-gguf (Apache License 2.0): LINE japanese-large-lm 1.7B instruction-sft (GGUF)
utter-project/EuroLLM-1.7B-Instruct (Apache License 2.0): EuroLLM 1.7B Instruct
mradermacher/EuroLLM-1.7B-Instruct-GGUF (Apache License 2.0): EuroLLM 1.7B Instruct (GGUF)
Qwen/Qwen3-1.7B (Apache License 2.0): Alibaba Qwen3 1.7B (thinking), Alibaba Qwen3 1.7B (no thinking)
unsloth/Qwen3-1.7B-GGUF (Apache License 2.0): Alibaba Qwen3 1.7B (thinking) (GGUF), Alibaba Qwen3 1.7B (no thinking) (GGUF)
XHToken/Spark-X2.5-1.7B (Apache License 2.0): Spark-X2.5 1.7B (thinking), Spark-X2.5 1.7B (no thinking)
XHToken/Spark-X2.5-1.7B-GGUF (Apache License 2.0): Spark-X2.5 1.7B (thinking) (GGUF), Spark-X2.5 1.7B (no thinking) (GGUF)
llm-jp/llm-jp-3-1.8b-instruct3 (Apache License 2.0): llm-jp-3 1.8B instruct3
mmnga/llm-jp-3-1.8b-instruct3-gguf (Apache License 2.0): llm-jp-3 1.8B instruct3 (GGUF)
llm-jp/llm-jp-3.1-1.8b-instruct4 (Apache License 2.0): llm-jp-3.1 1.8B instruct4
mmnga/llm-jp-3.1-1.8b-instruct4-gguf (Apache License 2.0): llm-jp-3.1 1.8B instruct4 (GGUF)
Qwen/Qwen3.5-2B (Apache License 2.0): Alibaba Qwen3.5 2B (thinking), Alibaba Qwen3.5 2B (no thinking)
unsloth/Qwen3.5-2B-GGUF (Apache License 2.0): Alibaba Qwen3.5 2B (thinking) (GGUF), Alibaba Qwen3.5 2B (no thinking) (GGUF)
prism-ml/Ternary-Bonsai-8B-unpacked (Apache License 2.0): Prism ML Ternary Bonsai 8B
prism-ml/Ternary-Bonsai-8B-gguf (Apache License 2.0): Prism ML Ternary Bonsai 8B (GGUF)
google/gemma-4-E2B-it (Apache License 2.0): Google Gemma 4 E2B
ggml-org/gemma-4-E2B-it-GGUF (Apache License 2.0): Google Gemma 4 E2B (GGUF)
Qwen/Qwen2.5-3B-Instruct (Qwen Research License Agreement): Alibaba Qwen2.5 3B Instruct
bartowski/Qwen2.5-3B-Instruct-GGUF (Qwen Research License Agreement): Alibaba Qwen2.5 3B Instruct (GGUF)
HuggingFaceTB/SmolLM3-3B (Apache License 2.0): Hugging Face SmolLM3 3B (thinking), Hugging Face SmolLM3 3B (no thinking)
ggml-org/SmolLM3-3B-GGUF (Apache License 2.0): Hugging Face SmolLM3 3B (thinking) (GGUF), Hugging Face SmolLM3 3B (no thinking) (GGUF)
shisa-ai/shisa-v2.1-llama3.2-3b (Llama 3.2 Community License): Llama 3.2 Shisa V2.1 3B
mradermacher/shisa-v2.1-llama3.2-3b-GGUF (Llama 3.2 Community License): Llama 3.2 Shisa V2.1 3B (GGUF)
sbintuitions/sarashina2.2-3b-instruct-v0.1 (MIT License): SB Intuitions sarashina2.2 3B Instruct
mmnga/sarashina2.2-3b-instruct-v0.1-gguf (MIT License): SB Intuitions sarashina2.2 3B Instruct (GGUF)
cyberagent/CAT-Translate-3.3b (MIT License): CyberAgent CAT-Translate 3.3B
line-corporation/japanese-large-lm-3.6b (Apache License 2.0): LINE japanese-large-lm 3.6B
line-corporation/japanese-large-lm-3.6b-instruction-sft (Apache License 2.0): LINE japanese-large-lm 3.6B instruction-sft
ibm-granite/granite-4.2-3b (Apache License 2.0): IBM Granite 4.2 3B (thinking), IBM Granite 4.2 3B (no thinking)
ibm-granite/granite-4.2-3b-GGUF (Apache License 2.0): IBM Granite 4.2 3B (thinking) (GGUF), IBM Granite 4.2 3B (no thinking) (GGUF)
llm-jp/llm-jp-3-3.7b-instruct3 (Apache License 2.0): llm-jp-3 3.7B instruct3
mmnga/llm-jp-3-3.7b-instruct3-gguf (Apache License 2.0): llm-jp-3 3.7B instruct3 (GGUF)
Qwen/Qwen3-4B (Apache License 2.0): Alibaba Qwen3 4B (thinking), Alibaba Qwen3 4B (no thinking)
Qwen/Qwen3-4B-GGUF (Apache License 2.0): Alibaba Qwen3 4B (thinking) (GGUF), Alibaba Qwen3 4B (no thinking) (GGUF)
Qwen/Qwen3-4B-Instruct-2507 (Apache License 2.0): Alibaba Qwen3 4B Instruct 2507
unsloth/Qwen3-4B-Instruct-2507-GGUF (Apache License 2.0): Alibaba Qwen3 4B Instruct 2507 (GGUF)
Qwen/Qwen3-4B-Thinking-2507 (Apache License 2.0): Alibaba Qwen3 4B Thinking 2507
unsloth/Qwen3-4B-Thinking-2507-GGUF (Apache License 2.0): Alibaba Qwen3 4B Thinking 2507 (GGUF)
XHToken/Spark-X2.5-4B (Apache License 2.0): Spark-X2.5 4B (thinking), Spark-X2.5 4B (no thinking)
XHToken/Spark-X2.5-4B-GGUF (Apache License 2.0): Spark-X2.5 4B (thinking) (GGUF), Spark-X2.5 4B (no thinking) (GGUF)
Qwen/Qwen3.5-4B (Apache License 2.0): Alibaba Qwen3.5 4B (thinking), Alibaba Qwen3.5 4B (no thinking)
unsloth/Qwen3.5-4B-GGUF (Apache License 2.0): Alibaba Qwen3.5 4B (thinking) (GGUF), Alibaba Qwen3.5 4B (no thinking) (GGUF)
TokenRhythm/NeoHorse-1-4B (Apache License 2.0): TokenRhythm NeoHorse-1 4B (thinking), TokenRhythm NeoHorse-1 4B (no thinking)
TokenRhythm/NeoHorse-1-4B-GGUF (Apache License 2.0): TokenRhythm NeoHorse-1 4B (thinking) (GGUF), TokenRhythm NeoHorse-1 4B (no thinking) (GGUF)
InternScience/Agents-A1-4B (Apache License 2.0): Shanghai AI Lab Agents-A1 4B (thinking), Shanghai AI Lab Agents-A1 4B (no thinking)
InternScience/Agents-A1-4B-Q8_0-GGUF (Apache License 2.0): Shanghai AI Lab Agents-A1 4B (thinking) (GGUF), Shanghai AI Lab Agents-A1 4B (no thinking) (GGUF)
google/gemma-4-E4B-it (Apache License 2.0): Google Gemma 4 E4B
ggml-org/gemma-4-E4B-it-GGUF (Apache License 2.0): Google Gemma 4 E4B (GGUF)
Qwen/Qwen3.8-27B (Apache License 2.0): Prism ML Ternary Bonsai 2 27B (thinking), Prism ML Ternary Bonsai 2 27B (no thinking), Underdog Saluki 27B (thinking), Underdog Saluki 27B (no thinking)
prism-ml/Ternary-Bonsai-2-27B-gguf (Apache License 2.0): Prism ML Ternary Bonsai 2 27B (thinking) (GGUF), Prism ML Ternary Bonsai 2 27B (no thinking) (GGUF)
ConwayResearch/Underdog-Saluki-27B-1.0 (Apache License 2.0): Underdog Saluki 27B (thinking) (GGUF), Underdog Saluki 27B (no thinking) (GGUF)
Rakuten/RakutenAI-7B-chat (Apache License 2.0): RakutenAI 7B chat
mradermacher/RakutenAI-7B-chat-GGUF (Apache License 2.0): RakutenAI 7B chat (GGUF)
tokyotech-llm/Swallow-MS-7b-instruct-v0.1 (Apache License 2.0): Science Tokyo Swallow-MS 7B instruct
mmnga/tokyotech-llm-Swallow-MS-7b-instruct-v0.1-gguf (Apache License 2.0): Science Tokyo Swallow-MS 7B instruct (GGUF)
Qwen/Qwen2.5-7B-Instruct (Apache License 2.0): Alibaba Qwen2.5 7B Instruct
bartowski/Qwen2.5-7B-Instruct-GGUF (Apache License 2.0): Alibaba Qwen2.5 7B Instruct (GGUF)
tokyotech-llm/Llama-3.1-Swallow-8B-Instruct-v0.5 (Meta Llama 3.1 Community License and Gemma Terms of Use): Science Tokyo Llama 3.1 Swallow 8B Instruct
mmnga/Llama-3.1-Swallow-8B-Instruct-v0.5-gguf (Meta Llama 3.1 Community License and Gemma Terms of Use): Science Tokyo Llama 3.1 Swallow 8B Instruct (GGUF)
elyza/Llama-3-ELYZA-JP-8B (Meta Llama 3 Community License): Llama-3-ELYZA-JP 8B
mmnga/Llama-3-ELYZA-JP-8B-gguf (Meta Llama 3 Community License): Llama-3-ELYZA-JP 8B (GGUF)
shisa-ai/shisa-v2.1-qwen3-8b (Apache License 2.0): Shisa V2.1 Qwen3 8B
mradermacher/shisa-v2.1-qwen3-8b-GGUF (Apache License 2.0): Shisa V2.1 Qwen3 8B (GGUF)
cyberagent/CAT-Thinking-8B (Apache License 2.0): CyberAgent CAT-Thinking 8B
mmnga-o/CAT-Thinking-8B-gguf (Apache License 2.0): CyberAgent CAT-Thinking 8B (GGUF)
Qwen/Qwen3-8B (Apache License 2.0): Alibaba Qwen3 8B (thinking), Alibaba Qwen3 8B (no thinking)
Qwen/Qwen3-8B-GGUF (Apache License 2.0): Alibaba Qwen3 8B (thinking) (GGUF), Alibaba Qwen3 8B (no thinking) (GGUF)
tokyotech-llm/Qwen3-Swallow-8B-RL-v0.2 (Apache License 2.0): Science Tokyo Qwen3 Swallow 8B RL (thinking), Science Tokyo Qwen3 Swallow 8B RL (no thinking)
mmnga-o/Qwen3-Swallow-8B-RL-v0.2-gguf (Apache License 2.0): Science Tokyo Qwen3 Swallow 8B RL (thinking) (GGUF), Science Tokyo Qwen3 Swallow 8B RL (no thinking) (GGUF)
llm-jp/llm-jp-4-8b-instruct (Apache License 2.0): llm-jp-4 8B instruct
mmnga-o/llm-jp-4-8b-instruct-gguf (Apache License 2.0): llm-jp-4 8B instruct (GGUF)
ibm-granite/granite-4.2-8b (Apache License 2.0): IBM Granite 4.2 8B (thinking), IBM Granite 4.2 8B (no thinking)
ibm-granite/granite-4.2-8b-GGUF (Apache License 2.0): IBM Granite 4.2 8B (thinking) (GGUF), IBM Granite 4.2 8B (no thinking) (GGUF)
Qwen/Qwen3.5-9B (Apache License 2.0): Alibaba Qwen3.5 9B (thinking), Alibaba Qwen3.5 9B (no thinking)
unsloth/Qwen3.5-9B-GGUF (Apache License 2.0): Alibaba Qwen3.5 9B (thinking) (GGUF), Alibaba Qwen3.5 9B (no thinking) (GGUF)
TokenRhythm/NeoHorse-1-9B (Apache License 2.0): TokenRhythm NeoHorse-1 9B (thinking), TokenRhythm NeoHorse-1 9B (no thinking)
TokenRhythm/NeoHorse-1-9B-GGUF (Apache License 2.0): TokenRhythm NeoHorse-1 9B (thinking) (GGUF), TokenRhythm NeoHorse-1 9B (no thinking) (GGUF)
EleutherAI/pythia-14m-deduped (Apache License 2.0): EleutherAI Pythia 14M
mradermacher/pythia-14m-GGUF (Apache License 2.0): EleutherAI Pythia 14M (GGUF)
distilbert/distilgpt2 (Apache License 2.0): Hugging Face DistilGPT2 82M
QuantFactory/distilgpt2-GGUF (Apache License 2.0): Hugging Face DistilGPT2 82M (GGUF)
EleutherAI/pythia-70m-deduped (Apache License 2.0): EleutherAI Pythia 70M
mradermacher/pythia-70m-deduped-GGUF (Apache License 2.0): EleutherAI Pythia 70M (GGUF)
HuggingFaceTB/SmolLM2-135M-Instruct (Apache License 2.0): Hugging Face SmolLM2 135M Instruct
bartowski/SmolLM2-135M-Instruct-GGUF (Apache License 2.0): Hugging Face SmolLM2 135M Instruct (GGUF)
HuggingFaceTB/SmolLM2-135M (Apache License 2.0): Hugging Face SmolLM2 135M
mradermacher/SmolLM2-135M-GGUF (Apache License 2.0): Hugging Face SmolLM2 135M (GGUF)
openai-community/gpt2 (MIT License): OpenAI GPT-2 124M
mradermacher/gpt2-GGUF (MIT License): OpenAI GPT-2 124M (GGUF)
EleutherAI/pythia-160m (Apache License 2.0): EleutherAI Pythia 160M
mradermacher/pythia-160m-GGUF (Apache License 2.0): EleutherAI Pythia 160M (GGUF)
HuggingFaceTB/SmolLM2-360M-Instruct (Apache License 2.0): Hugging Face SmolLM2 360M Instruct
HuggingFaceTB/SmolLM2-360M-Instruct-GGUF (Apache License 2.0): Hugging Face SmolLM2 360M Instruct (GGUF)
openai-community/gpt2-medium (Modified MIT License): OpenAI GPT-2 medium 355M
mradermacher/gpt2-medium-GGUF (Modified MIT License): OpenAI GPT-2 medium 355M (GGUF)
HuggingFaceTB/SmolLM2-360M (Apache License 2.0): Hugging Face SmolLM2 360M
mradermacher/SmolLM2-360M-GGUF (Apache License 2.0): Hugging Face SmolLM2 360M (GGUF)
EleutherAI/pythia-410m (Apache License 2.0): EleutherAI Pythia 410M
mradermacher/pythia-410m-GGUF (Apache License 2.0): EleutherAI Pythia 410M (GGUF)
Qwen/Qwen2.5-Coder-0.5B-Instruct (Apache License 2.0): Alibaba Qwen2.5 Coder 0.5B Instruct
bartowski/Qwen2.5-Coder-0.5B-Instruct-GGUF (Apache License 2.0): Alibaba Qwen2.5 Coder 0.5B Instruct (GGUF)
openai-community/gpt2-large (Modified MIT License): OpenAI GPT-2 large 774M
mradermacher/gpt2-large-GGUF (Modified MIT License): OpenAI GPT-2 large 774M (GGUF)
EleutherAI/pythia-1b (Apache License 2.0): EleutherAI Pythia 1B
mradermacher/pythia-1b-GGUF (Apache License 2.0): EleutherAI Pythia 1B (GGUF)
TinyLlama/TinyLlama-1.1B-Chat-v1.0 (Apache License 2.0): TinyLlama 1.1B Chat
TheBloke/TinyLlama-1.1B-Chat-v1.0-GGUF (Apache License 2.0): TinyLlama 1.1B Chat (GGUF)
openbmb/MiniCPM5-1B (Apache License 2.0): OpenBMB MiniCPM5 1B (thinking), OpenBMB MiniCPM5 1B (no thinking)
openbmb/MiniCPM5-1B-GGUF (Apache License 2.0): OpenBMB MiniCPM5 1B (thinking) (GGUF), OpenBMB MiniCPM5 1B (no thinking) (GGUF)
meta-llama/Llama-3.2-1B-Instruct (Llama 3.2 Community License): Meta Llama 3.2 1B Instruct
unsloth/Llama-3.2-1B-Instruct (Llama 3.2 Community License): Meta Llama 3.2 1B Instruct (copy)
bartowski/Llama-3.2-1B-Instruct-GGUF (Llama 3.2 Community License): Meta Llama 3.2 1B Instruct (GGUF)
EleutherAI/pythia-1.4b (Apache License 2.0): EleutherAI Pythia 1.4B
mradermacher/pythia-1.4b-GGUF (Apache License 2.0): EleutherAI Pythia 1.4B (GGUF)
Qwen/Qwen2.5-Coder-1.5B-Instruct (Apache License 2.0): Alibaba Qwen2.5 Coder 1.5B Instruct
bartowski/Qwen2.5-Coder-1.5B-Instruct-GGUF (Apache License 2.0): Alibaba Qwen2.5 Coder 1.5B Instruct (GGUF)
openai-community/gpt2-xl (Modified MIT License): OpenAI GPT-2 XL 1.5B
mradermacher/gpt2-xl-GGUF (Modified MIT License): OpenAI GPT-2 XL 1.5B (GGUF)
HuggingFaceTB/SmolLM2-1.7B-Instruct (Apache License 2.0): Hugging Face SmolLM2 1.7B Instruct
bartowski/SmolLM2-1.7B-Instruct-GGUF (Apache License 2.0): Hugging Face SmolLM2 1.7B Instruct (GGUF)
deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B (MIT License): DeepSeek-R1 Distill Qwen 1.5B
mradermacher/DeepSeek-R1-Distill-Qwen-1.5B-GGUF (MIT License): DeepSeek-R1 Distill Qwen 1.5B (GGUF)
openbmb/MiniCPM5-2B (Apache License 2.0): OpenBMB MiniCPM5 2B (thinking), OpenBMB MiniCPM5 2B (no thinking)
openbmb/MiniCPM5-2B-GGUF (Apache License 2.0): OpenBMB MiniCPM5 2B (thinking) (GGUF), OpenBMB MiniCPM5 2B (no thinking) (GGUF)
EleutherAI/pythia-2.8b (Apache License 2.0): EleutherAI Pythia 2.8B
mradermacher/pythia-2.8b-GGUF (Apache License 2.0): EleutherAI Pythia 2.8B (GGUF)
Qwen/Qwen2.5-Coder-3B-Instruct (Qwen Research License Agreement): Alibaba Qwen2.5 Coder 3B Instruct
bartowski/Qwen2.5-Coder-3B-Instruct-GGUF (Qwen Research License Agreement): Alibaba Qwen2.5 Coder 3B Instruct (GGUF)
meta-llama/Llama-3.2-3B-Instruct (Llama 3.2 Community License): Meta Llama 3.2 3B Instruct
unsloth/Llama-3.2-3B-Instruct (Llama 3.2 Community License): Meta Llama 3.2 3B Instruct (copy)
bartowski/Llama-3.2-3B-Instruct-GGUF (Llama 3.2 Community License): Meta Llama 3.2 3B Instruct (GGUF)
NousResearch/Hermes-3-Llama-3.2-3B (Meta Llama 3 Community License): Nous Research Hermes 3 Llama 3.2 3B
NousResearch/Hermes-3-Llama-3.2-3B-GGUF (Meta Llama 3 Community License): Nous Research Hermes 3 Llama 3.2 3B (GGUF)
EleutherAI/pythia-6.9b (Apache License 2.0): EleutherAI Pythia 6.9B
mradermacher/pythia-6.9b-GGUF (Apache License 2.0): EleutherAI Pythia 6.9B (GGUF)
mistralai/Mistral-7B-Instruct-v0.2 (Apache License 2.0): Mistral 7B Instruct v0.2
TheBloke/Mistral-7B-Instruct-v0.2-GGUF (Apache License 2.0): Mistral 7B Instruct v0.2 (GGUF)
mistralai/Mistral-7B-Instruct-v0.3 (Apache License 2.0): Mistral 7B Instruct v0.3
bartowski/Mistral-7B-Instruct-v0.3-GGUF (Apache License 2.0): Mistral 7B Instruct v0.3 (GGUF)
HuggingFaceH4/zephyr-7b-beta (MIT License): Hugging Face zephyr 7B beta
TheBloke/zephyr-7B-beta-GGUF (MIT License): Hugging Face zephyr 7B beta (GGUF)
Qwen/Qwen2.5-Coder-7B-Instruct (Apache License 2.0): Alibaba Qwen2.5 Coder 7B Instruct
bartowski/Qwen2.5-Coder-7B-Instruct-GGUF (Apache License 2.0): Alibaba Qwen2.5 Coder 7B Instruct (GGUF)
deepseek-ai/DeepSeek-R1-Distill-Qwen-7B (MIT License): DeepSeek-R1 Distill Qwen 7B
mradermacher/DeepSeek-R1-Distill-Qwen-7B-GGUF (MIT License): DeepSeek-R1 Distill Qwen 7B (GGUF)
deepseek-ai/DeepSeek-R1-Distill-Llama-8B (MIT License (derived from Llama 3.1 8B, originally under the Llama 3.1 Community License)): DeepSeek-R1 Distill Llama 8B
mradermacher/DeepSeek-R1-Distill-Llama-8B-GGUF (MIT License (derived from Llama 3.1 8B, originally under the Llama 3.1 Community License)): DeepSeek-R1 Distill Llama 8B (GGUF)
meta-llama/Llama-3.1-8B-Instruct (Llama 3.1 Community License): Meta Llama 3.1 8B Instruct
unsloth/Meta-Llama-3.1-8B-Instruct (Llama 3.1 Community License): Meta Llama 3.1 8B Instruct (copy)
bartowski/Meta-Llama-3.1-8B-Instruct-GGUF (Llama 3.1 Community License): Meta Llama 3.1 8B Instruct (GGUF)