Discussion about this post

User's avatar
Stephen Tucker's avatar

Grateful for this read, which introduced me to the convergent representation hypothesis. I'm a neuroscience instrumentation engineer, not a computer scientist, and I've been following closely the developments in compressive sensing because I think these ideas may be important to brain recording. Anyway, I'm not sure I grasp your final point, or how these ideas relate--you suggest that we can hope to decode the few samples of Linear A we have by leveraging an otherwise complete corpus of language embeddings? At some point, the limited amount of Linear A we have still makes this a very hard inversion problem. (Luckily we can continue to record the whales...)

Expand full comment
Roshan's avatar

This is a very bold claim. If I take this idea to, what I think, is its logical conclusion, then are you suggesting that representations in neural networks have the converge to representations inside our brains? In other words, are you claiming that the platonic representations are completely agnostic of the substance that is generating those representations?

Expand full comment
6 more comments...

No posts