Olivier Laurent (left) is currently pursuing his PhD at Institut Polytechnique de Paris and Paris-Saclay University under Gianni Franchi’s (center) guidance. He presented his paper A Symmetry-aware Exploration of Bayesian Neural Network Posteriors at ICLR 2024. Gianni, an assistant professor at ENSTA, told us that the video above illustrates the progression of the posterior of a basic DNN trained on CIFAR-10, following dimension reduction for clearer visualization. The image depicts the histogram of the joint distribution of a neural network consisting of only 4 neurons. “We specifically plot 2 neurons,” said Gianni, “to observe the impact of symmetries.” “This paper holds interest due to its capacity to visualize the behavior of DNN distribution throughout DNN training,” he also declared. “It marks the inaugural dataset of DNN checkpointing. Additionally, it enables the acquisition of ground truth regarding the posterior, facilitating the exploration of the relationship between symmetries and Bayesian Neural Networks.” 25 Computer Vision News Computer Vision News ICLR Poster Presentation
RkJQdWJsaXNoZXIy NTc3NzU=