TokForgeTokForge Get the app

TokForge Leaderboard

Llama 3.1 8B Instruct: every phone chip's best verified run.

family llama-3.1 · 8B parameters · usual quant mnn · size class 7-9B

#DeviceSoCModelBackendPrefill t/sDecode t/sRAMAppTested
1REDMAGIC NX799JSM8750DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored-MNNopencl · MNN23.211.311 GBv3.6.0-beta1374 weeks ago

← full leaderboard · API: /v1/board · tokforge.ai