-
Training a 430M Swedish LM
I trained a 430M-parameter Swedish language model on 10B tokens costing about 70$, which includes failed runs. The reason for building this model is to learn a bit about the...
-
On collapsible algebraic numbers
This post concerns Problem 3 from Griffin Macris’s list of open problems. It was originally stated as a question:
-
Advanced Shadow Sampling Techniques
Shadow mapping is one of the most common techniques for real-time shadows, but a naïve implementation produces hard, aliased edges. This post is a practical guide to improving shadow sampling...