intelligence.midi
Intelligence
MoE routing / floating point / fly brains
Papers
2 entriesScroll papers →
1. Fly Brain LM
A language model based on the fruit fly connectome, running entirely in the browser on WebGPU.
-
2. Batch Size and MoE Routing
Changing only the batch size changes MoE expert selection, and differently on RDNA3 and RDNA4.