intelligence.midi

Intelligence

Papers

2 entries

Scroll papers →

  1. build log shipped

    1. Fly Brain LM

    P. Tran + team

    A language model based on the fruit fly connectome, running entirely in the browser on WebGPU.

    connectome · state-space model · WebGPU read: Fly Brain LM →
  2. research in progress

    2. Batch Size and MoE Routing

    P. Tran, co-authors

    Changing only the batch size changes MoE expert selection, and differently on RDNA3 and RDNA4.

    MoE · floating point · RDNA read: Batch Size and MoE Routing →