Complex Computations from Developmental Priors
Visiting speaker
Dániel Barabási
Harvard University
Past Talk
In-person
Tuesday
Nov 14, 2023
Watch video
3:30 pm
EST
Virtual
177 Huntington Ave.
11th floor
Devon House
58 St Katharine's Way
London E1W 1LP, UK
Online
Register here
Machine learning (ML) models have long overlooked innateness: how strong pressures for survival lead to the encoding of complex behaviors in the nascent wiring of a brain. Here, we derive a neurodevelopmental encoding of artificial neural networks that considers the weight matrix of a neural network to be emergent from well-studied rules of neuronal compatibility. Rather than updating the network’s weights directly, we improve task fitness by updating the neurons’ wiring rules, thereby mirroring evolutionary selection on brain development. We find that our model (1) provides sufficient representational power for high accuracy on ML benchmarks while also compressing parameter count, and (2) can act as a regularizer, selecting simple circuits that provide stable and adaptive performance on metalearning tasks. In summary, by introducing neurodevelopmental considerations into ML frameworks, we not only model the emergence of innate behaviors, but also define a discovery process for structures that promote complex computations.
About the speaker
About the speaker
Dániel Barabási is a postdoctoral fellow at Harvard University, whose work blends neuroscience, network science, and machine learning. He received his B.S. in Physics from the University of Notre Dame in 2017, where he worked on network models of brain connectivity, and was awarded a PhD in Biophysics from Harvard in 2023. Dániel's research illuminates the intricate relationship between brain connectivity and gene expression. His developmental results imply that the brain is not a complex entity molded solely by experience, but is a fundamentally simple self-assembling system, governed by genetic processes during embryonic development.
Dániel Barabási is a postdoctoral fellow at Harvard University, whose work blends neuroscience, network science, and machine learning. He received his B.S. in Physics from the University of Notre Dame in 2017, where he worked on network models of brain connectivity, and was awarded a PhD in Biophysics from Harvard in 2023. Dániel's research illuminates the intricate relationship between brain connectivity and gene expression. His developmental results imply that the brain is not a complex entity molded solely by experience, but is a fundamentally simple self-assembling system, governed by genetic processes during embryonic development.