“On Hate Scaling Laws For Data-Swamps”
Highly recommended. This paper looks at the effects of scale on model bias and it looks like bias gets worse with scale. Which is unsurprising, TBH.
... works as a web developer in Hveragerði, Iceland, and writes about the web, digital publishing, and web/product development
These are his notes
“On Hate Scaling Laws For Data-Swamps”
Highly recommended. This paper looks at the effects of scale on model bias and it looks like bias gets worse with scale. Which is unsurprising, TBH.