

Good question! Unfortunately, I haven’t found a good source myself. I’ve been trying to piece it together based on my theoretical/mathematical neuroscience background and self-study about transformer architectures. The problem is the point neurons in transformers don’t map to neurons in cortex. You have to instead look at the bigger functions that are being computed by each system.
The best single source to learn more about theoretical neuroscience is Neuronal Dynamics: From Single Neurons to Networks and Models of cognition. But its super math heavy. If you want to easier to digest videos I recommend Artem Kirsanov on youtube. For transformer architecture 3 Blue 1 Brown has a great series of videos about it on YouTube as well.

Just remembered another great book kind of bridging both topics that’s a great introduction to the field. Its called Models of the Mind by Grace Lindsay. It follows the history of computational/theoretical neuroscience and how we got to our modern understanding. Its written for a more general audience than Neuronal Dynamics and gives a great overview of the field.