Mage / An investigation by Superposition
The ideas inside
the computation.
Linear algebra, local interactions, and the movement of information. Small GPU experiments are a way to make these ideas tangible—and to ask better questions about the systems built from them.
The equation is only the beginning.
Why two implementations of the same mathematics can have very different costs. Start with reuse, then follow the reductions and the relationships between neighbors.
Read the ideas and compare the profilesReuse
Repeated structure is a chance to avoid repeated movement.
Reduction
Many partial answers must eventually become one shared result.
Interaction
Local relationships can build a much larger pattern.
The investigation uses Python, Rust, and an RTX 4090. Code, setup instructions, measurement records, and failures live in the GitHub repository.
For the broader motivation and how my thinking changes, read Superposition.