Seminars

Modern deep learning systems exhibit complex dynamical behavior, yet a principled theory explaining how these dynamics shape learning and memory is still missing. This talk presents a research program toward a dynamical theory of deep learning based on the interaction between state and parameter dynamics in recurrent neural networks. I show how gating mechanisms induce lag-dependent effective learning rates that constrain temporal credit assignment, and introduce a learnability theory characterizing the maximum temporal horizon at which gradient signals remain detectable under heavy-tailed stochastic gradients. Finally, I discuss recent results linking these learning limits to the distribution of neuron-wise time scales emerging during training, whose geometry determines the temporal reach of learning.

This seminar offers an overview of recent advancements in the geometric aspects of neural networks. Specifically, we will explore how concepts from discrete and tropical geometry can be utilized to describe the geometric complexity of neural networks. No particular prior knowledge of geometry is required.

This seminar introduces the transition from traditional neural networks to Graph Neural Networks (GNNs), highlighting the limitations of MLPs in modeling relational data. It presents graphs as a natural representation for such data and describes GNNs through the message passing paradigm. Key architectures, challenges, and current research directions, including spatio-temporal graph learning, are briefly discussed.

This seminar provides an accessible introduction to the mathematical concept of sheaves. We will focus in particular on sheaves defined on graphs, explaining their intuition and basic properties in a simple and approachable way. Building on this foundation, we will introduce Sheaf Neural Networks, a recent extension of Graph Neural Networks that uses sheaf structures.