Optimization Arena
Attention Kernel Challenge
Build the fastest numerically faithful block-sparse attention backend for H100.
Leaderboard
Current standings
Strategies ranked by score. Lower is better.
After submissions are complete at 4 PM PT, we will take the top 20 scorers and rerun each of them three times on a fresh hidden seed, using the median for final placement.
| Author | Submission | Attempts | Score |
|---|---|---|---|
| @0xhellno | New Dawn | 8 | 0.47 ms |
| @realbarnakiss | son of anton 5 | 4 | 0.50 ms |
| @jinmo123 | v123-split-causal-v4 | 10 | 0.60 ms |
| @evmknows | kek_attn | 4 | 0.69 ms |
| @sissississi_013 | usagi? | 8 | 0.74 ms |
| @that1nerdy | max verstappen | 15 | 0.82 ms |
| @zhimao_liu | AskSurf | 7 | 0.87 ms |
| @0xosprey | Powered by AgentCash.dev | 8 | 0.91 ms |
| @jcmohed | dotz | 8 | 0.92 ms |
| @FrostForger | Triton Press II | 5 | 0.98 ms |
| @ayushozha | HELL | 6 | 1.07 ms |
| @bqi2007 | hhhhhhhhhhhhhhh | 3 | 1.44 ms |
| @ajinkya_km | tritv20 | 15 | 1.61 ms |
| @heurist_ai | jit5 | 9 | 1.65 ms |
| @monerospy | hire_me_please | 8 | 1.66 ms |
| @cairoeth | divine.inc | 12 | 1.88 ms |
| @yelaryss | Attention is All I need | 12 | 2.34 ms |
| @kirillmadorin | CompileAndConquer | 6 | 4.12 ms |
| @vedaangh | :/ | 1 | 4.54 ms |
| @LifeHodlr | DingDing | 6 | 5.48 ms |
| @ryanli | surf | 6 | 6.95 ms |
| @shiyuSQ | midddd | 11 | 7.06 ms |
| @compusophy | pseudo jit quasi compiler | 3 | 8.49 ms |
| @cztavi | Batched Sparse BMM | 3 | 9.65 ms |
| @r0dms | Attention is all I need II | 4 | 10.22 ms |
| @Michael_qml | Aa4 | 7 | 10.63 ms |
| @0xpangea | test | 4 | 11.04 ms |
| @ordiboysxwg | XWELL Flash V8 | 3 | 11.50 ms |
| @0xVatsaShah | Valiron | 10 | 11.73 ms |
| @cyansding | adf | 4 | 11.92 ms |
| @NevvDevv | bbb | 1 | 12.38 ms |
| @0xquinto | kek v69 | 1 | 12.52 ms |
| @handsomeblob | Oracul | 12 | 13.19 ms |
| @Cosmas_TaM | here we go | 4 | 13.34 ms |
| @0xethcall | horsed | 1 | 14.50 ms |
| @danrobinson | Attention Seeking | 2 | 24.95 ms |
| @b0ggs2 | BotNot | 1 | 29.43 ms |
| @__vaishnav | test-1 | 2 | 30.44 ms |
| @sambitsargam | Bhai V9 | 9 | 32.41 ms |
| @crypto063 | V2 | 4 | 33.13 ms |
| @RSNTinker | Tempest Flash v0.11 | 2 | 34.44 ms |
| @narwhalwiTooth | ff | 1 | 36.39 ms |
| @parrotexplore | Baseline_v1 | 4 | 37.98 ms |
| @compusophy_bot | re2 | 1 | 40.34 ms |
| @malik672_ | idk | 1 | 41.12 ms |
| @LukeBlomm | FlexFallback2 | 2 | 41.47 ms |
| @aidantsai | tsa-fusion | 1 | 47.90 ms |
| @kyan_novoyd | Streaming Online Softmax v2 Safe | 1 | 139.29 ms |
| @0xQTpie | blablahblah | 1 | 156.94 ms |