Real on-device LLM benchmarks, submitted from the TokForge app. Ranked by decode speed (tokens/sec).
| # | Device | SoC | Model | Backend | Prefill t/s | Decode t/s | RAM | App | Tested |
|---|---|---|---|---|---|---|---|---|---|
| 1 | Apple iPhone 17 Pro Max | Apple A19 Pro | Qwen3-30B-A3B (MoE, top-4 experts) | MNN CPU (KleidiAI W4A8) · INT4 W4A8 | 10.6 | 14.4 | 12 GB | 16.108 | 3 months ago |
| 2 | REDMAGIC NX809J | SM8850 | Qwen3.6-35B-A3B-abliterated-MNN | cpu · MNN | 13.6 | 13.6 | 23 GB | v3.6.0-beta75 | 3 months ago |
| 3 | 8849 OB-A98 | MT6897 | Qwen3.6-35B-A3B-abliterated-MNN | cpu · MNN | 5.7 | 4.4 | 17 GB | 1.1.1 | 6 weeks ago |
| # | Device | SoC | Model | Backend | Prefill t/s | Decode t/s | RAM | App | Tested |
|---|---|---|---|---|---|---|---|---|---|
| 1 | nubia NX741J | SM8850 | Qwen3-0.6B-kl-baseline-20k-MNN | cpu · MNN | 379.6 | 122.0 | 15 GB | 1.3 | 4 weeks ago |
| 2 | REDMAGIC NX809J | SM8850 | Qwen3.5-0.8B-MNN | cpu · MNN | 274.5 | 78.3 | 23 GB | 1.0 | 7 weeks ago |
| 3 | Apple iPhone18,2 | Apple A19 Pro | qwen2.5-1.5b-instruct-q4_k_m.gguf | llama.cpp · Q4_K_M | - | 64.4 | 11 GB | 16.163 (1830) | 3 months ago |
| 4 | motorola motorola edge 30 pro | SM8450 | Qwen3-0.6B-MNN | cpu · MNN | 195.2 | 53.7 | 11 GB | 1.0 | 7 weeks ago |
| 5 | REDMAGIC NX809J | SM8850 | Qwen3-1.7B-MNN | cpu · | 45.1 | 50.6 | 23 GB | v3.6.0-beta43 | 3 months ago |
| 6 | POCO 2412DPC0AG | MT6899 | Qwen3-0.6B-MNN | cpu · MNN | 221.6 | 50.2 | 11 GB | 1.0 | 7 weeks ago |
| 7 | Apple iPhone16,2 | Apple A17 Pro | Qwen2.5-1.5B-Instruct-Q4_K_M | gguf · Q4_K_M | 312.5 | 48.3 | 8 GB | 0.1.0 | 3 months ago |
| 8 | OnePlus KB2005 | SM8250 | Qwen3-0.6B-lk-alpha-20k-MNN | cpu · MNN | 136.2 | 43.9 | 11 GB | 1.1.1 | 6 weeks ago |
| 9 | nubia NX733J | SM8750 | Qwen3-0.6B-Q8_0 | gguf · Q8_0 | 339.4 | 42.0 | 23 GB | v3.6.0-beta130 | 2 months ago |
| 10 | Apple iPhone16,2 | Apple A17 Pro | llama-3.2-1b-instruct-q4_k_m.gguf | llama.cpp · Q4_K_M | 479.4 | 41.3 | 7 GB | 16.163 (1830) | 3 months ago |
| 11 | samsung SM-G988U | SM8250 | Qwen3.5-0.8B-MNN | cpu · | - | 38.3 | 10 GB | v3.6.0-beta130 | 2 months ago |
| 12 | nubia NX733J | SM8750 | Qwen3-0.6B.Q4_K_M | gguf · 0.6B.Q4_K_M | 262.4 | 36.4 | 23 GB | v3.6.0-beta130 | 2 months ago |
| 13 | OPPO CPH2791 | MT6993 | Qwen3-0.6B-MNN | cpu · MNN | 289.1 | 35.4 | 15 GB | 1.3.1 | 3 weeks ago |
| 14 | docomo SO-53B | SM8350 | DeepSeek-R1-Distill-Qwen-0.5B-CoMa.IQ4_XS | gguf · CoMa.IQ4_XS | 27.1 | 27.1 | 7 GB | v3.6.0-beta70 | 3 months ago |
| 15 | vivo V2270A | SM7325 | Qwen3.5-0.8B-MNN | cpu · MNN | 74.7 | 24.4 | 11 GB | v3.6.0-beta120 | 3 months ago |
| 16 | POCO 23049PCD8G | SM7475 | Josiefied-Qwen3-1.7B-abliterated-v1-MNN-plus | cpu · | - | 24.1 | 7 GB | 1.3.3 | 2 weeks ago |
| 17 | HONOR BVL-AN00 | SM8650 | LFM2.5-1.2B-Instruct-Q8_0 | gguf · Q8_0 | - | 20.3 | 15 GB | v3.6.0-beta139 | 2 months ago |
| 18 | Lenovo TB520FU | SM8650 | Qwen3-1.7B-Q4_K_M | gguf · Q4_K_M | 19.1 | 19.1 | 15 GB | v3.6.0-beta39 | 3 months ago |
| 19 | iQOO I2508 | SM8845 | qwen2.5-1.5b-instruct-q4_k_m | gguf · q4_k_m | 77.8 | 18.5 | 7 GB | 1.2 | 5 weeks ago |
| 20 | samsung SM-S906E | SM8450 | LFM2.5-1.2B-Instruct-Q4_K_M | gguf · Q4_K_M | 61.9 | 17.3 | 7 GB | 1.3.3 | 2 weeks ago |
| 21 | samsung SM-S176V | s5e8535 | Qwen3.5-0.8B-MNN | cpu · | - | 13.7 | 3 GB | 1.2.1 | 4 weeks ago |
| 22 | motorola moto g(20) | ums512_1h10 | Qwen3.5-0.8B-MNN | cpu · MNN | 31.9 | 12.9 | 3 GB | 1.3.2.1 | 3 weeks ago |
| 23 | google Pixel 10 Pro XL | Tensor G5 | Llama-3.2-1B-Instruct-Uncensored.i1-Q4_K_M | gguf · Q4_K_M | 108.0 | 11.0 | 15 GB | v3.6.0-beta145 | 8 weeks ago |
| 24 | realme RMX3370 | SM8250 | LFM2.5-1.2B-Thinking-Q4_K_M | gguf · Q4_K_M | 54.8 | 10.8 | 11 GB | v3.6.0-beta143 | 9 weeks ago |
| 25 | Infinix Infinix X6821 | MT6789V/CD | Palette-RP-1.2B-Instruct-2609-v0.5.Q8_0 | gguf · Q8_0 | - | 9.5 | 8 GB | 1.3.4 | 13 days ago |
| 26 | Infinix Infinix X6821 | MT6789V/CD | PHOEBE_SENTIMENTAL-RP-NSFW-3.2-1B.Q8_0 | gguf · Q8_0 | - | 8.1 | 8 GB | 1.3.4 | 8 days ago |
| 27 | samsung SM-A346E | MT6877 | Qwen3.5-0.8B-MNN | cpu · MNN | 9.9 | 7.6 | 7 GB | 1.1.1 | 6 weeks ago |
| 28 | samsung SM-A057F | SM6225 | qwen3-0.6b-q4_k_m | gguf · q4_k_m | 17.9 | 7.1 | 4 GB | 1.3.3 | 2 weeks ago |
| # | Device | SoC | Model | Backend | Prefill t/s | Decode t/s | RAM | App | Tested |
|---|---|---|---|---|---|---|---|---|---|
| 1 | REDMAGIC NX809J | SM8850 | Qwen3-4B-abliterated-MNN | cpu · MNN | 55.0 | 23.5 | 23 GB | v3.6.0-beta146 | 7 weeks ago |
| 2 | POCO 26077PC53G | SM8850 | Gemma-4-E2B-it-MNN | cpu · MNN | 74.9 | 19.5 | 15 GB | 1.3.3 | 8 days ago |
| 3 | Redmi 25102RKBEC | SM8850 | Qwen3.5-4B-uncensored-MNN | cpu · MNN | 46.7 | 18.7 | 11 GB | 1.3.6.1 | 1 day ago |
| 4 | POCO 2510DPC44G | SM8750 | Gemma-4-E2B-it-MNN | cpu · MNN | 84.9 | 17.9 | 11 GB | 1.3.3 | 8 days ago |
| 5 | OnePlus PLC110 | MT6991 | Qwen3.5-4B-Uncensored-MNN | cpu · | - | 17.0 | 15 GB | 1.3.3 | 12 days ago |
| 6 | nubia NX789J | SM8750 | Qwen3.5-4B-uncensored-MNN | cpu · MNN | 44.4 | 16.4 | 15 GB | 1.3.6.1 | today |
| 7 | POCO 2412DPC0AG | MT6899 | Gemma-4-E2B-it-MNN | cpu · | - | 16.1 | 11 GB | 1.0 | 7 weeks ago |
| 8 | POCO 23049PCD8G | SM7475 | Huihui-gemma-4-E2B-it-abliterated-MNN | cpu · | - | 16.1 | 7 GB | 1.3.3 | 2 weeks ago |
| 9 | Lenovo TB390FU | SM8735P | Qwen3.5-4B-uncensored-MNN | cpu · MNN | 43.6 | 15.3 | 7 GB | v3.6.0-beta146 | 8 weeks ago |
| 10 | POCO 2412DPC0AG | MT6899 | Gemma-4-E2B-it-MNN | cpu · MNN | 49.4 | 14.8 | 11 GB | v3.6.0-beta144 | 9 weeks ago |
| 11 | samsung SM-G990W2 | SM8350 | Qwen3.5-2B-MNN | cpu · MNN | 13.7 | 13.7 | 5 GB | v3.6.0-beta105 | 3 months ago |
| 12 | HONOR BVL-AN00 | SM8650 | Qwen3.5-4B-uncensored-MNN | cpu · | - | 13.5 | 15 GB | v3.6.0-beta139 | 2 months ago |
| 13 | POCO 23049PCD8G | SM7475 | Qwen3.5-4B-Claude-4.6-Opus-abliterated-MNN | cpu · | - | 13.1 | 7 GB | 1.3.3 | 2 weeks ago |
| 14 | HONOR BVL-AN00 | SM8650 | Qwen3-4B-abliterated-MNN | opencl · MNN | 45.0 | 12.7 | 15 GB | 1.3.6.1 | 1 day ago |
| 15 | POCO 2602BPC18G | MT6991 | Qwen3.5-4B-uncensored-MNN | cpu · MNN | 63.3 | 12.2 | 11 GB | 1.3.2.1 | 3 weeks ago |
| 16 | POCO 2412DPC0AG | MT6899 | Qwen3-4B-abliterated-MNN | cpu · MNN | 37.8 | 12.1 | 11 GB | 1.3.2 | 3 weeks ago |
| 17 | Xiaomi 23127PN0CC | SM8650 | Qwen3.5-4B-MNN | cpu · MNN | 44.9 | 11.6 | 11 GB | 1.3.3 | 10 days ago |
| 18 | POCO 23049PCD8G | SM7475 | Qwen3.5-4B-uncensored-MNN | cpu · | - | 11.5 | 7 GB | v3.6.0-beta144 | 9 weeks ago |
| 19 | samsung SM-S931W | SM8750 | Huihui-gemma-4-E4B-it-abliterated-MNN | cpu · | - | 11.2 | 11 GB | 1.2.1 | 4 weeks ago |
| 20 | vivo V2417A | MT6989 | Qwen3.5-4B-uncensored-MNN | cpu · MNN | 34.7 | 11.2 | 11 GB | 1.3.6.1 | today |
| 21 | nubia NX741J | SM8850 | gemma-4-E4B-it-MNN | cpu · MNN | 52.7 | 10.9 | 15 GB | 1.3 | 4 weeks ago |
| 22 | POCO 2412DPC0AG | MT6899 | Qwen3.5-4B-MNN | cpu · | - | 10.8 | 11 GB | v3.6.0-beta105 | 7 weeks ago |
| 23 | OPPO PGX110 | MT6895Z_A/TCZA | Qwen3.5-4B-uncensored-MNN | cpu · | - | 9.9 | 15 GB | 1.1.1 | 5 weeks ago |
| 24 | google Pixel 10 | Tensor G5 | Qwen3.5-4B-uncensored-MNN | cpu · | 8.9 | 9.8 | 11 GB | v3.6.0-beta70 | 3 months ago |
| 25 | HUAWEI LMU-LX9 | Kirin | Qwen3.5-4B-uncensored-MNN | cpu · MNN | 29.3 | 9.6 | 15 GB | 1.3.3 | 2 weeks ago |
| 26 | OPPO PGX110 | MT6895Z_A/TCZA | Qwen3.5-4B-MNN | cpu · | - | 9.5 | 15 GB | 1.1.1 | 5 weeks ago |
| 27 | TECNO TECNO LJ9 | MT6897 | Qwen3.5-4B-uncensored-MNN | cpu · MNN | 9.2 | 9.2 | 11 GB | v3.5.0-RC20.23.81 | 3 months ago |
| 28 | samsung SM-S928U | SM8650 | Qwen3.5-4B-abliterated.i1-Q4_0 | gguf · Q4_0 | - | 9.1 | 11 GB | 1.3.3 | 10 days ago |
| 29 | google Pixel 10 Pro XL | Tensor G5 | Qwen3.5-4B-MNN | cpu · MNN | 14.6 | 9.0 | 15 GB | v3.6.0-beta145 | 8 weeks ago |
| 30 | OPPO PGX110 | MT6895Z_A/TCZA | Qwen3.5-4B-MNN | cpu · MNN | 16.6 | 8.9 | 15 GB | 1.1.1 | 5 weeks ago |
| 31 | OPPO PGX110 | MT6895Z_A/TCZA | Qwen3-4B-abliterated-MNN | cpu · MNN | 17.3 | 8.6 | 15 GB | 1.1.1 | 5 weeks ago |
| 32 | OPPO CPH2305 | SM8450 | Gemma-4-E2B-it-MNN | cpu · MNN | 8.5 | 8.5 | 11 GB | v3.6.0-beta105 | 3 months ago |
| 33 | samsung SM-S928W | SM8650 | Qwen3-VL-4B-Instruct-Uncensored-abliterated.Q4_K_M | gguf · abliterated.Q4_K_M | 32.7 | 8.4 | 11 GB | v3.6.0-beta146 | 7 weeks ago |
| 34 | BLU BOLD N2 | mt6833 | gemma-4-E2B-it-qat-UD-Q4_K_XL | gguf · Q4_K_XL | 6.7 | 8.2 | 7 GB | v3.6.0-beta55 | 3 months ago |
| 35 | HONOR BVL-AN00 | SM8650 | Qwen3-4B-abliterated-MNN | cpu · | - | 8.1 | 15 GB | v3.6.0-beta139 | 2 months ago |
| 36 | POCO 2412DPC0AG | MT6899 | microsoft_Phi-4-mini-reasoning-Q4_K_M | gguf · Q4_K_M | - | 8.0 | 11 GB | v3.6.0-beta146 | 7 weeks ago |
| 37 | Redmi 25053RT47C | SM8735 | Qwen3.5-4B-uncensored-MNN | cpu · | 6.1 | 7.7 | 11 GB | v3.6.0-beta55 | 3 months ago |
| 38 | HONOR BVL-AN00 | SM8650 | Qwen3-4B-abliterated-MNN | cpu · MNN | 11.8 | 7.0 | 15 GB | 1.3.6.1 | 1 day ago |
| 39 | iQOO I2407 | SM7635 | Gemma-4-E2B-it-MNN | mnn · | 5.9 | 6.7 | 11 GB | v3.6.0-beta105 | 3 months ago |
| 40 | POCO 2412DPC0AG | MT6899 | Phi-4-mini-reasoning-Q8_0 | gguf · Q8_0 | - | 6.0 | 11 GB | v3.6.0-beta146 | 7 weeks ago |
| 41 | Infinix Infinix X6812B | mt6769 | Qwen3.5-2B-MNN | cpu · MNN | 14.9 | 5.6 | 6 GB | 1.3.1 | 3 weeks ago |
| 42 | samsung SM-A546B | s5e8835 | Qwen3.5-4B-uncensored-MNN | cpu · | - | 5.3 | 7 GB | v3.6.0-beta145 | 8 weeks ago |
| 43 | google Pixel 9a | Tensor G4 | Qwen3.5-4B-MNN | cpu · MNN | 5.2 | 5.2 | 7 GB | v3.6.0-beta70 | 3 months ago |
| 44 | samsung SM-G988U | SM8250 | Qwen3-4B-Instruct-2507-Q4_K_M.gguf | gguf · | - | 4.8 | 10 GB | v3.6.0-beta129 | 2 months ago |
| 45 | Xiaomi 2107113SG | SM8350 | starcoder2-3b.i1-Q6_K | gguf · Q6_K | - | 4.7 | 7 GB | v3.6.0-beta124 | 2 months ago |
| 46 | OPPO PGX110 | MT6895Z_A/TCZA | Qwen3.5-4B-uncensored-MNN | cpu · MNN | 4.6 | 4.7 | 15 GB | 1.1.1 | 5 weeks ago |
| 47 | POCO M2102J20SG | SM8150 | mlabonne_gemma-3-4b-it-abliterated-Q4_K_M | gguf · Q4_K_M | 11.7 | 3.8 | 7 GB | v3.6.0-beta143 | 7 weeks ago |
| 48 | vivo vivo 2004 | SM7150 | Qwen3.5-4B-uncensored-MNN | cpu · MNN | 8.1 | 3.8 | 7 GB | v3.6.0-beta146 | 7 weeks ago |
| 49 | samsung SM-G988U | SM8250 | Qwen3-4B-Instruct-2507-Q4_K_M | gguf · Q4_K_M | 15.8 | 3.8 | 10 GB | v3.6.0-beta129 | 2 months ago |
| 50 | samsung SM-A336E | s5e8825 | Qwen3.5-2B-MNN | cpu · MNN | 2.0 | 3.2 | 5 GB | v3.6.0-beta139 | 2 months ago |
| 51 | vivo V2314A | MT6896Z/CZA | Qwen3.5-4B-uncensored-MNN | cpu · MNN | 13.0 | 3.2 | 11 GB | v3.6.0-beta140 | 2 months ago |
| 52 | Redmi 24069RA21C | SM8635 | Qwen3.5-4B-MNN | cpu · MNN | 2.7 | 2.7 | 11 GB | v3.6.0-beta146 | 8 weeks ago |
| # | Device | SoC | Model | Backend | Prefill t/s | Decode t/s | RAM | App | Tested |
|---|---|---|---|---|---|---|---|---|---|
| 1 | OnePlus PMB110 | MT6993 | Qwen3.5-9B-uncensored-MNN | opencl · MNN | 25.3 | 120.8 | 15 GB | 1.1.1 | 6 weeks ago |
| 2 | samsung SM-S948N | SM8850 | Qwen3.5-9B-uncensored-MNN | cpu · | - | 13.8 | 15 GB | v3.6.0-beta140 | 2 months ago |
| 3 | REDMAGIC NX809J | SM8850 | Qwen3.5-9B-uncensored-MNN | cpu · MNN | 32.0 | 13.8 | 23 GB | 1.0 | 7 weeks ago |
| 4 | OnePlus CPH2747 | SM8850 | Qwen3.5-9B-ultra-uncensored-heretic-v1-MNN | opencl · MNN | 21.7 | 12.7 | 15 GB | 1.3.3 | 10 days ago |
| 5 | nubia NX741J | SM8850 | DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored-MNN | opencl · MNN | 53.3 | 11.6 | 15 GB | 1.3 | 3 weeks ago |
| 6 | realme RMX5090 | SM8750 | Qwen3.5-9B-uncensored-MNN | opencl · MNN | 16.6 | 11.3 | 15 GB | 1.3.6.1 | today |
| 7 | REDMAGIC NX799J | SM8750 | DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored-MNN | opencl · MNN | 23.2 | 11.3 | 11 GB | v3.6.0-beta137 | 2 months ago |
| 8 | nubia NP05J | SM8750 | Qwen3.5-9B-uncensored-MNN | cpu · MNN | 11.3 | 11.3 | 11 GB | v3.6.0-beta105 | 3 months ago |
| 9 | realme RMX5090 | SM8750 | Qwen3.5-9B-uncensored-MNN | cpu · | - | 10.9 | 15 GB | 1.3.6.1 | 1 day ago |
| 10 | realme RMX5060 | MT6989 | Qwen3.5-9B-uncensored-MNN | cpu · MNN | 10.2 | 7.4 | 11 GB | 1.1.1 | 6 weeks ago |
| 11 | Redmi 2407FRK8EC | MT6989 | Qwen3-8B-abliterated-v2-MNN | cpu · MNN | 7.2 | 7.2 | 23 GB | v3.6.0-beta39 | 3 months ago |
| 12 | OnePlus CPH2767 | SM8845 | Qwen3.5-9B-MNN | cpu · MNN | 20.3 | 7.0 | 15 GB | 1.1.1 | 6 weeks ago |
| 13 | HONOR BVL-N49 | SM8650 | Qwen3.5-9B-uncensored-MNN | cpu · MNN | - | 6.5 | 11 GB | v3.5.0-RC20.23.69 | 3 months ago |
| 14 | google Pixel 10 Pro XL | Tensor G5 | Qwen3-8B-abliterated-v2-MNN | cpu · MNN | 16.9 | 5.0 | 15 GB | 1.3.6.1 | 1 day ago |
| 15 | samsung SM-S918B | SM8550 | Qwen3.5-9B-uncensored-MNN | cpu · MNN | 15.3 | 4.8 | 11 GB | v3.6.0-beta130 | 2 months ago |
| 16 | OnePlus PHB110 | SM8550 | Qwen3.5-9B-ultra-uncensored-heretic-v1-MNN | cpu · MNN | 15.5 | 4.4 | 15 GB | 1.3.2.1 | 2 weeks ago |
| 17 | samsung SM-S928U1 | SM8650 | Qwen3.5-9B-MNN | cpu · MNN | 13.9 | 4.2 | 11 GB | 1.1.1 | 6 weeks ago |
| 18 | OnePlus PHB110 | SM8550 | Qwen3.5-9B-Q4_0 | gguf · Q4_0 | 15.6 | 4.2 | 15 GB | 1.3.2.1 | 2 weeks ago |
| 19 | OnePlus PMB110 | MT6993 | Qwen3.5-9B-uncensored-MNN | cpu · MNN | 36.8 | 4.1 | 15 GB | v3.6.0-beta146 | 8 weeks ago |
| 20 | realme RMX5090 | SM8750 | Qwen3.8-9B-Distill-SLERP-F451-Pro-Writer-Uncensored-Q5_K_M-no-mtp | gguf · mtp | 35.2 | 3.8 | 15 GB | 1.3.6.1 | today |
| 21 | google Pixel 10 Pro XL | Tensor G5 | Qwen3-6B-Hivemind-Inst-Hrtic-Ablit-Uncensored-Q4_K_M-imat | gguf · imat | 23.2 | 3.5 | 15 GB | v3.6.0-beta145 | 8 weeks ago |
| 22 | Xiaomi 25019PNF3C | SM8750 | Qwen3.5-9B-MNN | cpu · MNN | 3.2 | 3.2 | 15 GB | 1.2.1 | 4 weeks ago |
| 23 | samsung SM-A556E | s5e8845 | Qwen3.5-9B-MNN | cpu · MNN | 9.6 | 3.1 | 11 GB | 1.3.2 | 3 weeks ago |
| 24 | Xiaomi 2509FPN0BC | SM8850 | Qwen3.5-9B-MNN | cpu · | 2.1 | 2.3 | 15 GB | v3.6.0-beta55 | 3 months ago |
| 25 | Nothing A142 | MT6886 | Qwen3.5-9B-MNN | cpu · | - | 2.2 | 11 GB | 1.3.2.1 | 2 weeks ago |
| # | Device | SoC | Model | Backend | Prefill t/s | Decode t/s | RAM | App | Tested |
|---|---|---|---|---|---|---|---|---|---|
| 1 | nubia NX741J | SM8850 | Lumimaid-Magnum-v4-12B-Q4_K_M | gguf · Q4_K_M | 15.3 | 4.2 | 15 GB | 1.3 | 4 weeks ago |
| 2 | nubia NX733J | SM8750 | Qwen3.5-27B-MNN | cpu · MNN | 2.0 | 1.7 | 23 GB | v3.6.0-beta130 | 2 months ago |
| # | Device | SoC | Model | Backend | Prefill t/s | Decode t/s | RAM | App | Tested |
|---|---|---|---|---|---|---|---|---|---|
| 1 | HONOR BVL-N49 | SM8650 | Qwen3 | cpu · | - | 11.5 | 11 GB | v3.5.0-RC20.23.69 | 3 months ago |
| 2 | Apple iPhone15,3 | Apple A16 Bionic | x | llama.cpp · | - | 1.0 | 5 GB | 16.134 (1801) | 3 months ago |
| # | Device | SoC | Model | Backend | Prefill t/s | Decode t/s | RAM | App | Tested |
|---|---|---|---|---|---|---|---|---|---|
| 1 | nubia NX741J | SM8850 | Qwen3-0.6B-kl-baseline-20k-MNN | cpu · MNN | 379.6 | 122.0 | 15 GB | 1.3 | 4 weeks ago |
| 2 | OnePlus PMB110 | MT6993 | Qwen3.5-9B-uncensored-MNN | opencl · MNN | 25.3 | 120.8 | 15 GB | 1.1.1 | 6 weeks ago |
| 3 | REDMAGIC NX809J | SM8850 | Qwen3.5-0.8B-MNN | cpu · MNN | 274.5 | 78.3 | 23 GB | 1.0 | 7 weeks ago |
| 4 | Apple iPhone18,2 | Apple A19 Pro | qwen2.5-1.5b-instruct-q4_k_m.gguf | llama.cpp · Q4_K_M | - | 64.4 | 11 GB | 16.163 (1830) | 3 months ago |
| 5 | motorola motorola edge 30 pro | SM8450 | Qwen3-0.6B-MNN | cpu · MNN | 195.2 | 53.7 | 11 GB | 1.0 | 7 weeks ago |
| 6 | REDMAGIC NX809J | SM8850 | Qwen3-1.7B-MNN | cpu · | 45.1 | 50.6 | 23 GB | v3.6.0-beta43 | 3 months ago |
| 7 | POCO 2412DPC0AG | MT6899 | Qwen3-0.6B-MNN | cpu · MNN | 221.6 | 50.2 | 11 GB | 1.0 | 7 weeks ago |
| 8 | Apple iPhone16,2 | Apple A17 Pro | Qwen2.5-1.5B-Instruct-Q4_K_M | gguf · Q4_K_M | 312.5 | 48.3 | 8 GB | 0.1.0 | 3 months ago |
| 9 | OnePlus KB2005 | SM8250 | Qwen3-0.6B-lk-alpha-20k-MNN | cpu · MNN | 136.2 | 43.9 | 11 GB | 1.1.1 | 6 weeks ago |
| 10 | nubia NX733J | SM8750 | Qwen3-0.6B-Q8_0 | gguf · Q8_0 | 339.4 | 42.0 | 23 GB | v3.6.0-beta130 | 2 months ago |
| 11 | Apple iPhone16,2 | Apple A17 Pro | llama-3.2-1b-instruct-q4_k_m.gguf | llama.cpp · Q4_K_M | 479.4 | 41.3 | 7 GB | 16.163 (1830) | 3 months ago |
| 12 | samsung SM-G988U | SM8250 | Qwen3.5-0.8B-MNN | cpu · | - | 38.3 | 10 GB | v3.6.0-beta130 | 2 months ago |
| 13 | nubia NX733J | SM8750 | Qwen3-0.6B.Q4_K_M | gguf · 0.6B.Q4_K_M | 262.4 | 36.4 | 23 GB | v3.6.0-beta130 | 2 months ago |
| 14 | OPPO CPH2791 | MT6993 | Qwen3-0.6B-MNN | cpu · MNN | 289.1 | 35.4 | 15 GB | 1.3.1 | 3 weeks ago |
| 15 | docomo SO-53B | SM8350 | DeepSeek-R1-Distill-Qwen-0.5B-CoMa.IQ4_XS | gguf · CoMa.IQ4_XS | 27.1 | 27.1 | 7 GB | v3.6.0-beta70 | 3 months ago |
| 16 | vivo V2270A | SM7325 | Qwen3.5-0.8B-MNN | cpu · MNN | 74.7 | 24.4 | 11 GB | v3.6.0-beta120 | 3 months ago |
| 17 | POCO 23049PCD8G | SM7475 | Josiefied-Qwen3-1.7B-abliterated-v1-MNN-plus | cpu · | - | 24.1 | 7 GB | 1.3.3 | 2 weeks ago |
| 18 | REDMAGIC NX809J | SM8850 | Qwen3-4B-abliterated-MNN | cpu · MNN | 55.0 | 23.5 | 23 GB | v3.6.0-beta146 | 7 weeks ago |
| 19 | HONOR BVL-AN00 | SM8650 | LFM2.5-1.2B-Instruct-Q8_0 | gguf · Q8_0 | - | 20.3 | 15 GB | v3.6.0-beta139 | 2 months ago |
| 20 | POCO 26077PC53G | SM8850 | Gemma-4-E2B-it-MNN | cpu · MNN | 74.9 | 19.5 | 15 GB | 1.3.3 | 8 days ago |
| 21 | Lenovo TB520FU | SM8650 | Qwen3-1.7B-Q4_K_M | gguf · Q4_K_M | 19.1 | 19.1 | 15 GB | v3.6.0-beta39 | 3 months ago |
| 22 | Redmi 25102RKBEC | SM8850 | Qwen3.5-4B-uncensored-MNN | cpu · MNN | 46.7 | 18.7 | 11 GB | 1.3.6.1 | 1 day ago |
| 23 | iQOO I2508 | SM8845 | qwen2.5-1.5b-instruct-q4_k_m | gguf · q4_k_m | 77.8 | 18.5 | 7 GB | 1.2 | 5 weeks ago |
| 24 | POCO 2510DPC44G | SM8750 | Gemma-4-E2B-it-MNN | cpu · MNN | 84.9 | 17.9 | 11 GB | 1.3.3 | 8 days ago |
| 25 | samsung SM-S906E | SM8450 | LFM2.5-1.2B-Instruct-Q4_K_M | gguf · Q4_K_M | 61.9 | 17.3 | 7 GB | 1.3.3 | 2 weeks ago |
| 26 | OnePlus PLC110 | MT6991 | Qwen3.5-4B-Uncensored-MNN | cpu · | - | 17.0 | 15 GB | 1.3.3 | 12 days ago |
| 27 | nubia NX789J | SM8750 | Qwen3.5-4B-uncensored-MNN | cpu · MNN | 44.4 | 16.4 | 15 GB | 1.3.6.1 | today |
| 28 | POCO 2412DPC0AG | MT6899 | Gemma-4-E2B-it-MNN | cpu · | - | 16.1 | 11 GB | 1.0 | 7 weeks ago |
| 29 | POCO 23049PCD8G | SM7475 | Huihui-gemma-4-E2B-it-abliterated-MNN | cpu · | - | 16.1 | 7 GB | 1.3.3 | 2 weeks ago |
| 30 | Lenovo TB390FU | SM8735P | Qwen3.5-4B-uncensored-MNN | cpu · MNN | 43.6 | 15.3 | 7 GB | v3.6.0-beta146 | 8 weeks ago |
| 31 | POCO 2412DPC0AG | MT6899 | Gemma-4-E2B-it-MNN | cpu · MNN | 49.4 | 14.8 | 11 GB | v3.6.0-beta144 | 9 weeks ago |
| 32 | Apple iPhone 17 Pro Max | Apple A19 Pro | Qwen3-30B-A3B (MoE, top-4 experts) | MNN CPU (KleidiAI W4A8) · INT4 W4A8 | 10.6 | 14.4 | 12 GB | 16.108 | 3 months ago |
| 33 | samsung SM-S948N | SM8850 | Qwen3.5-9B-uncensored-MNN | cpu · | - | 13.8 | 15 GB | v3.6.0-beta140 | 2 months ago |
| 34 | REDMAGIC NX809J | SM8850 | Qwen3.5-9B-uncensored-MNN | cpu · MNN | 32.0 | 13.8 | 23 GB | 1.0 | 7 weeks ago |
| 35 | samsung SM-G990W2 | SM8350 | Qwen3.5-2B-MNN | cpu · MNN | 13.7 | 13.7 | 5 GB | v3.6.0-beta105 | 3 months ago |
| 36 | samsung SM-S176V | s5e8535 | Qwen3.5-0.8B-MNN | cpu · | - | 13.7 | 3 GB | 1.2.1 | 4 weeks ago |
| 37 | REDMAGIC NX809J | SM8850 | Qwen3.6-35B-A3B-abliterated-MNN | cpu · MNN | 13.6 | 13.6 | 23 GB | v3.6.0-beta75 | 3 months ago |
| 38 | HONOR BVL-AN00 | SM8650 | Qwen3.5-4B-uncensored-MNN | cpu · | - | 13.5 | 15 GB | v3.6.0-beta139 | 2 months ago |
| 39 | POCO 23049PCD8G | SM7475 | Qwen3.5-4B-Claude-4.6-Opus-abliterated-MNN | cpu · | - | 13.1 | 7 GB | 1.3.3 | 2 weeks ago |
| 40 | motorola moto g(20) | ums512_1h10 | Qwen3.5-0.8B-MNN | cpu · MNN | 31.9 | 12.9 | 3 GB | 1.3.2.1 | 3 weeks ago |
| 41 | HONOR BVL-AN00 | SM8650 | Qwen3-4B-abliterated-MNN | opencl · MNN | 45.0 | 12.7 | 15 GB | 1.3.6.1 | 1 day ago |
| 42 | OnePlus CPH2747 | SM8850 | Qwen3.5-9B-ultra-uncensored-heretic-v1-MNN | opencl · MNN | 21.7 | 12.7 | 15 GB | 1.3.3 | 10 days ago |
| 43 | POCO 2602BPC18G | MT6991 | Qwen3.5-4B-uncensored-MNN | cpu · MNN | 63.3 | 12.2 | 11 GB | 1.3.2.1 | 3 weeks ago |
| 44 | POCO 2412DPC0AG | MT6899 | Qwen3-4B-abliterated-MNN | cpu · MNN | 37.8 | 12.1 | 11 GB | 1.3.2 | 3 weeks ago |
| 45 | Xiaomi 23127PN0CC | SM8650 | Qwen3.5-4B-MNN | cpu · MNN | 44.9 | 11.6 | 11 GB | 1.3.3 | 10 days ago |
| 46 | nubia NX741J | SM8850 | DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored-MNN | opencl · MNN | 53.3 | 11.6 | 15 GB | 1.3 | 3 weeks ago |
| 47 | HONOR BVL-N49 | SM8650 | Qwen3 | cpu · | - | 11.5 | 11 GB | v3.5.0-RC20.23.69 | 3 months ago |
| 48 | POCO 23049PCD8G | SM7475 | Qwen3.5-4B-uncensored-MNN | cpu · | - | 11.5 | 7 GB | v3.6.0-beta144 | 9 weeks ago |
| 49 | realme RMX5090 | SM8750 | Qwen3.5-9B-uncensored-MNN | opencl · MNN | 16.6 | 11.3 | 15 GB | 1.3.6.1 | today |
| 50 | REDMAGIC NX799J | SM8750 | DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored-MNN | opencl · MNN | 23.2 | 11.3 | 11 GB | v3.6.0-beta137 | 2 months ago |
| 51 | nubia NP05J | SM8750 | Qwen3.5-9B-uncensored-MNN | cpu · MNN | 11.3 | 11.3 | 11 GB | v3.6.0-beta105 | 3 months ago |
| 52 | samsung SM-S931W | SM8750 | Huihui-gemma-4-E4B-it-abliterated-MNN | cpu · | - | 11.2 | 11 GB | 1.2.1 | 4 weeks ago |
| 53 | vivo V2417A | MT6989 | Qwen3.5-4B-uncensored-MNN | cpu · MNN | 34.7 | 11.2 | 11 GB | 1.3.6.1 | today |
| 54 | google Pixel 10 Pro XL | Tensor G5 | Llama-3.2-1B-Instruct-Uncensored.i1-Q4_K_M | gguf · Q4_K_M | 108.0 | 11.0 | 15 GB | v3.6.0-beta145 | 8 weeks ago |
| 55 | nubia NX741J | SM8850 | gemma-4-E4B-it-MNN | cpu · MNN | 52.7 | 10.9 | 15 GB | 1.3 | 4 weeks ago |
| 56 | realme RMX5090 | SM8750 | Qwen3.5-9B-uncensored-MNN | cpu · | - | 10.9 | 15 GB | 1.3.6.1 | 1 day ago |
| 57 | realme RMX3370 | SM8250 | LFM2.5-1.2B-Thinking-Q4_K_M | gguf · Q4_K_M | 54.8 | 10.8 | 11 GB | v3.6.0-beta143 | 9 weeks ago |
| 58 | POCO 2412DPC0AG | MT6899 | Qwen3.5-4B-MNN | cpu · | - | 10.8 | 11 GB | v3.6.0-beta105 | 7 weeks ago |
| 59 | OPPO PGX110 | MT6895Z_A/TCZA | Qwen3.5-4B-uncensored-MNN | cpu · | - | 9.9 | 15 GB | 1.1.1 | 5 weeks ago |
| 60 | google Pixel 10 | Tensor G5 | Qwen3.5-4B-uncensored-MNN | cpu · | 8.9 | 9.8 | 11 GB | v3.6.0-beta70 | 3 months ago |
| 61 | HUAWEI LMU-LX9 | Kirin | Qwen3.5-4B-uncensored-MNN | cpu · MNN | 29.3 | 9.6 | 15 GB | 1.3.3 | 2 weeks ago |
| 62 | Infinix Infinix X6821 | MT6789V/CD | Palette-RP-1.2B-Instruct-2609-v0.5.Q8_0 | gguf · Q8_0 | - | 9.5 | 8 GB | 1.3.4 | 13 days ago |
| 63 | OPPO PGX110 | MT6895Z_A/TCZA | Qwen3.5-4B-MNN | cpu · | - | 9.5 | 15 GB | 1.1.1 | 5 weeks ago |
| 64 | TECNO TECNO LJ9 | MT6897 | Qwen3.5-4B-uncensored-MNN | cpu · MNN | 9.2 | 9.2 | 11 GB | v3.5.0-RC20.23.81 | 3 months ago |
| 65 | samsung SM-S928U | SM8650 | Qwen3.5-4B-abliterated.i1-Q4_0 | gguf · Q4_0 | - | 9.1 | 11 GB | 1.3.3 | 10 days ago |
| 66 | google Pixel 10 Pro XL | Tensor G5 | Qwen3.5-4B-MNN | cpu · MNN | 14.6 | 9.0 | 15 GB | v3.6.0-beta145 | 8 weeks ago |
| 67 | OPPO PGX110 | MT6895Z_A/TCZA | Qwen3.5-4B-MNN | cpu · MNN | 16.6 | 8.9 | 15 GB | 1.1.1 | 5 weeks ago |
| 68 | OPPO PGX110 | MT6895Z_A/TCZA | Qwen3-4B-abliterated-MNN | cpu · MNN | 17.3 | 8.6 | 15 GB | 1.1.1 | 5 weeks ago |
| 69 | OPPO CPH2305 | SM8450 | Gemma-4-E2B-it-MNN | cpu · MNN | 8.5 | 8.5 | 11 GB | v3.6.0-beta105 | 3 months ago |
| 70 | samsung SM-S928W | SM8650 | Qwen3-VL-4B-Instruct-Uncensored-abliterated.Q4_K_M | gguf · abliterated.Q4_K_M | 32.7 | 8.4 | 11 GB | v3.6.0-beta146 | 7 weeks ago |
| 71 | BLU BOLD N2 | mt6833 | gemma-4-E2B-it-qat-UD-Q4_K_XL | gguf · Q4_K_XL | 6.7 | 8.2 | 7 GB | v3.6.0-beta55 | 3 months ago |
| 72 | Infinix Infinix X6821 | MT6789V/CD | PHOEBE_SENTIMENTAL-RP-NSFW-3.2-1B.Q8_0 | gguf · Q8_0 | - | 8.1 | 8 GB | 1.3.4 | 8 days ago |
| 73 | HONOR BVL-AN00 | SM8650 | Qwen3-4B-abliterated-MNN | cpu · | - | 8.1 | 15 GB | v3.6.0-beta139 | 2 months ago |
| 74 | POCO 2412DPC0AG | MT6899 | microsoft_Phi-4-mini-reasoning-Q4_K_M | gguf · Q4_K_M | - | 8.0 | 11 GB | v3.6.0-beta146 | 7 weeks ago |
| 75 | Redmi 25053RT47C | SM8735 | Qwen3.5-4B-uncensored-MNN | cpu · | 6.1 | 7.7 | 11 GB | v3.6.0-beta55 | 3 months ago |
| 76 | samsung SM-A346E | MT6877 | Qwen3.5-0.8B-MNN | cpu · MNN | 9.9 | 7.6 | 7 GB | 1.1.1 | 6 weeks ago |
| 77 | realme RMX5060 | MT6989 | Qwen3.5-9B-uncensored-MNN | cpu · MNN | 10.2 | 7.4 | 11 GB | 1.1.1 | 6 weeks ago |
| 78 | Redmi 2407FRK8EC | MT6989 | Qwen3-8B-abliterated-v2-MNN | cpu · MNN | 7.2 | 7.2 | 23 GB | v3.6.0-beta39 | 3 months ago |
| 79 | samsung SM-A057F | SM6225 | qwen3-0.6b-q4_k_m | gguf · q4_k_m | 17.9 | 7.1 | 4 GB | 1.3.3 | 2 weeks ago |
| 80 | OnePlus CPH2767 | SM8845 | Qwen3.5-9B-MNN | cpu · MNN | 20.3 | 7.0 | 15 GB | 1.1.1 | 6 weeks ago |
| 81 | HONOR BVL-AN00 | SM8650 | Qwen3-4B-abliterated-MNN | cpu · MNN | 11.8 | 7.0 | 15 GB | 1.3.6.1 | 1 day ago |
| 82 | iQOO I2407 | SM7635 | Gemma-4-E2B-it-MNN | mnn · | 5.9 | 6.7 | 11 GB | v3.6.0-beta105 | 3 months ago |
| 83 | HONOR BVL-N49 | SM8650 | Qwen3.5-9B-uncensored-MNN | cpu · MNN | - | 6.5 | 11 GB | v3.5.0-RC20.23.69 | 3 months ago |
| 84 | POCO 2412DPC0AG | MT6899 | Phi-4-mini-reasoning-Q8_0 | gguf · Q8_0 | - | 6.0 | 11 GB | v3.6.0-beta146 | 7 weeks ago |
| 85 | Infinix Infinix X6812B | mt6769 | Qwen3.5-2B-MNN | cpu · MNN | 14.9 | 5.6 | 6 GB | 1.3.1 | 3 weeks ago |
| 86 | samsung SM-A546B | s5e8835 | Qwen3.5-4B-uncensored-MNN | cpu · | - | 5.3 | 7 GB | v3.6.0-beta145 | 8 weeks ago |
| 87 | google Pixel 9a | Tensor G4 | Qwen3.5-4B-MNN | cpu · MNN | 5.2 | 5.2 | 7 GB | v3.6.0-beta70 | 3 months ago |
| 88 | google Pixel 10 Pro XL | Tensor G5 | Qwen3-8B-abliterated-v2-MNN | cpu · MNN | 16.9 | 5.0 | 15 GB | 1.3.6.1 | 1 day ago |
| 89 | samsung SM-G988U | SM8250 | Qwen3-4B-Instruct-2507-Q4_K_M.gguf | gguf · | - | 4.8 | 10 GB | v3.6.0-beta129 | 2 months ago |
| 90 | samsung SM-S918B | SM8550 | Qwen3.5-9B-uncensored-MNN | cpu · MNN | 15.3 | 4.8 | 11 GB | v3.6.0-beta130 | 2 months ago |
| 91 | Xiaomi 2107113SG | SM8350 | starcoder2-3b.i1-Q6_K | gguf · Q6_K | - | 4.7 | 7 GB | v3.6.0-beta124 | 2 months ago |
| 92 | OPPO PGX110 | MT6895Z_A/TCZA | Qwen3.5-4B-uncensored-MNN | cpu · MNN | 4.6 | 4.7 | 15 GB | 1.1.1 | 5 weeks ago |
| 93 | OnePlus PHB110 | SM8550 | Qwen3.5-9B-ultra-uncensored-heretic-v1-MNN | cpu · MNN | 15.5 | 4.4 | 15 GB | 1.3.2.1 | 2 weeks ago |
| 94 | 8849 OB-A98 | MT6897 | Qwen3.6-35B-A3B-abliterated-MNN | cpu · MNN | 5.7 | 4.4 | 17 GB | 1.1.1 | 6 weeks ago |
| 95 | nubia NX741J | SM8850 | Lumimaid-Magnum-v4-12B-Q4_K_M | gguf · Q4_K_M | 15.3 | 4.2 | 15 GB | 1.3 | 4 weeks ago |
| 96 | samsung SM-S928U1 | SM8650 | Qwen3.5-9B-MNN | cpu · MNN | 13.9 | 4.2 | 11 GB | 1.1.1 | 6 weeks ago |
| 97 | OnePlus PHB110 | SM8550 | Qwen3.5-9B-Q4_0 | gguf · Q4_0 | 15.6 | 4.2 | 15 GB | 1.3.2.1 | 2 weeks ago |
| 98 | OnePlus PMB110 | MT6993 | Qwen3.5-9B-uncensored-MNN | cpu · MNN | 36.8 | 4.1 | 15 GB | v3.6.0-beta146 | 8 weeks ago |
| 99 | POCO M2102J20SG | SM8150 | mlabonne_gemma-3-4b-it-abliterated-Q4_K_M | gguf · Q4_K_M | 11.7 | 3.8 | 7 GB | v3.6.0-beta143 | 7 weeks ago |
| 100 | realme RMX5090 | SM8750 | Qwen3.8-9B-Distill-SLERP-F451-Pro-Writer-Uncensored-Q5_K_M-no-mtp | gguf · mtp | 35.2 | 3.8 | 15 GB | 1.3.6.1 | today |
| 101 | vivo vivo 2004 | SM7150 | Qwen3.5-4B-uncensored-MNN | cpu · MNN | 8.1 | 3.8 | 7 GB | v3.6.0-beta146 | 7 weeks ago |
| 102 | samsung SM-G988U | SM8250 | Qwen3-4B-Instruct-2507-Q4_K_M | gguf · Q4_K_M | 15.8 | 3.8 | 10 GB | v3.6.0-beta129 | 2 months ago |
| 103 | google Pixel 10 Pro XL | Tensor G5 | Qwen3-6B-Hivemind-Inst-Hrtic-Ablit-Uncensored-Q4_K_M-imat | gguf · imat | 23.2 | 3.5 | 15 GB | v3.6.0-beta145 | 8 weeks ago |
| 104 | samsung SM-A336E | s5e8825 | Qwen3.5-2B-MNN | cpu · MNN | 2.0 | 3.2 | 5 GB | v3.6.0-beta139 | 2 months ago |
| 105 | vivo V2314A | MT6896Z/CZA | Qwen3.5-4B-uncensored-MNN | cpu · MNN | 13.0 | 3.2 | 11 GB | v3.6.0-beta140 | 2 months ago |
| 106 | Xiaomi 25019PNF3C | SM8750 | Qwen3.5-9B-MNN | cpu · MNN | 3.2 | 3.2 | 15 GB | 1.2.1 | 4 weeks ago |
| 107 | samsung SM-A556E | s5e8845 | Qwen3.5-9B-MNN | cpu · MNN | 9.6 | 3.1 | 11 GB | 1.3.2 | 3 weeks ago |
| 108 | Redmi 24069RA21C | SM8635 | Qwen3.5-4B-MNN | cpu · MNN | 2.7 | 2.7 | 11 GB | v3.6.0-beta146 | 8 weeks ago |
| 109 | Xiaomi 2509FPN0BC | SM8850 | Qwen3.5-9B-MNN | cpu · | 2.1 | 2.3 | 15 GB | v3.6.0-beta55 | 3 months ago |
| 110 | Nothing A142 | MT6886 | Qwen3.5-9B-MNN | cpu · | - | 2.2 | 11 GB | 1.3.2.1 | 2 weeks ago |
| 111 | nubia NX733J | SM8750 | Qwen3.5-27B-MNN | cpu · MNN | 2.0 | 1.7 | 23 GB | v3.6.0-beta130 | 2 months ago |
| 112 | Apple iPhone15,3 | Apple A16 Bionic | x | llama.cpp · | - | 1.0 | 5 GB | 16.134 (1801) | 3 months ago |
How fast the phone writes its reply, in tokens per second. A token is roughly three quarters of a word. 15 or more feels like comfortable reading speed, 8 to 15 is usable, under 8 feels slow.
How fast the phone reads your prompt before it starts answering. Higher means less waiting before the first word appears. A dash means that run did not measure prefill.
The pause between sending a message and seeing the first word of the answer, in milliseconds. Reported by newer app versions through the API.
Every score comes from the TokForge app's built-in benchmark on a real phone: a fixed prompt, a fixed reply length, several timed passes. The methodology tag on each API row says how the passes were combined (for example "median3" means the median of 3 timed passes). Each row shows the best submitted score for that phone chip, model, backend and quantization combination.
Models are grouped by total parameter count: Under 2B, 2-4B (2B up to 5B), 7-9B (5B up to 10B), 14B+ (10B and up). MoE (mixture-of-experts) models get their own tab because only a fraction of their parameters is active per token, so they behave differently from dense models of the same total size. Models we cannot size yet appear under Other.
Every score is signed by the app before it is sent. That signature is anti-spam friction, not identity verification: it keeps drive-by fake scores off the board and carries no personal data. Submissions hold no user content and nothing that identifies a person.
112 devices · auto-refreshes every 60s · API: /v1/board · tokforge.ai