Writing as Compression-Perplexity Optimization
▼Thoughts on viewing expository writing as an act of compressing information in high-perplexity form to evoke delight in the reader.
Thoughts on viewing expository writing as an act of compressing information in high-perplexity form to evoke delight in the reader.
Explaining the math from the Rumelhart, Hinton, Williams 1986 backpropagation paper via Python code.
Thoughts on bridging interpersonal semantic gaps via fine-tuned embedding spaces.
An exploration of recommender systems, their impact on society, and the need for decentralized data.