Megakernel Inference Engines Beat vLLM and SGLang
Coding agents wrote one GPU program per model that runs the whole decode loop. On eight open models it beat the fastest general engine by up to 2.05x.
Coding agents wrote one GPU program per model that runs the whole decode loop. On eight open models it beat the fastest general engine by up to 2.05x.