Institute Homepage DE Sign In

Publications

Deep Models and Optimization Conference Paper Recurrent neural networks: vanishing and exploding gradients are not the end of the story Zucchet, N., Orvieto, A. In Proceedings of the Thirty-Eighth Annual Conference on Neural Information Processing Systems, Thirty-Eighth Annual Conference on Neural Information Processing Systems, October 2024 (Published) URL BibTeX
Deep Models and Optimization Conference Paper Theoretical Foundations of Deep Selective State-Space Models Muca Cirone, N., Orvieto, A., Walker, B., Salvi, C., Lyons, T. In Proceedings of the Thirty-Eighth Annual Conference on Neural Information Processing Systems, Thirty-Eighth Annual Conference on Neural Information Processing Systems, October 2024 (Published) URL BibTeX
Deep Models and Optimization Conference Paper Understanding the differences in Foundation Models: Attention, State Space Models, and Recurrent Neural Networks Sieber, J., Amo Alonso, C., Didier, A., Zeilinger, M., Orvieto, A. In Proceedings of the Thirty-Eighth Annual Conference on Neural Information Processing Systems, Thirty-Eighth Annual Conference on Neural Information Processing Systems, October 2024 (Published) URL BibTeX
Empirical Inference Article A Probabilistic Model behind Self-Supervised Learning Bizeul, A., Schölkopf, B., Allen, C. Transactions on Machine Learning Research, October 2024 (Published) PDF URL BibTeX
Social Foundations of Computation Algorithms and Society Conference Paper Decline Now: A Combinatorial Model for Algorithmic Collective Action Sigg, D., Hardt, M., Mendler-Dünner, C. CHI Conference on Human Factors in Computing Systems, October 2024 (Accepted) arXiv BibTeX
Empirical Inference Article How developments in natural language processing help us in understanding human behaviour Mihalcea, R., Biester, L., Boyd, R. L., Jin, Z., Perez-Rosas, V., Wilson, S., Pennebaker, J. W. Nature Human Behaviour, 8(10):1877-1889, Nature Publishing Group UK London, October 2024 (Published) DOI URL BibTeX
Empirical Inference Conference Paper Redesigning Information Markets in the Era of Language Models Weiss, M., Rahaman, N., Wüthrich, M., Bengio, Y., Li, L. E., Schölkopf, B., Pal, C. First Conference on Language Modeling (COLM), arXiv:2403.14443, October 2024 (Published) arXiv URL BibTeX
Empirical Inference Conference Paper GraphDreamer: Compositional 3D Scene Synthesis from Scene Graphs Gao, G., Liu, W., Chen, A., Geiger, A., Schölkopf, B. IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 21295-21304, IEEE, Piscataway, NJ, CVPR, September 2024 (Published) DOI URL BibTeX
Empirical Inference Ph.D. Thesis Advances in Probabilistic Methods for Deep Learning Immer, A. ETH Zurich, Switzerland, September 2024, CLS PhD Program (Published) BibTeX
Empirical Inference Master Thesis Alien Recombination: Exploring Concept Blends Beyond Human Cognitive Availability in Visual Art Hernandez, A. Technical University of Munich, Germany, September 2024 (Published) BibTeX
Haptic Intelligence Empirical Inference Optics and Sensing Laboratory Software Workshop Article Fiber-Optic Shape Sensing Using Neural Networks Operating on Multispecklegrams Cao, C. G. L., Javot, B., Bhattarai, S., Bierig, K., Oreshnikov, I., Volchkov, V. V. IEEE Sensors Journal, 24(17):27532-27540, September 2024 (Published) DOI BibTeX
Empirical Inference Autonomous Learning Conference Paper Learning to Control Emulated Muscles in Real Robots: A Software Test Bed for Bio-Inspired Actuators in Hardware Schumacher, P., Krause, L., Schneider, J., Büchler, D., Martius, G., Haeufle, D. In Proceedings 10th International Conference on Biomedical Robotics and Biomechatronics (BioRob), 806-813, IEEE, 10th International Conference on Biomedical Robotics and Biomechatronics (BioRob), September 2024 (Published) arXiv DOI URL BibTeX
Robust Machine Learning Conference Paper Measuring Per-Unit Interpretability at Scale Without Humans Klindt, D., Zimmermann, R., Brendel, W. In September 2024 (Published) OpenReview BibTeX
Robust Machine Learning Conference Paper Rule Extrapolation in Language Models: A Study of Compositional Generalization on OOD Prompts Mészáros, A., Ujváry, S., Brendel, W., Reizinger, P., Huszár, F. In September 2024 (Published) ArXiv BibTeX
Empirical Inference Conference Paper Competition of Mechanisms: Tracing How Language Models Handle Facts and Counterfactuals Ortu*, F., Jin*, Z., Doimo, D., Sachan, M., Cazzaniga, A., Schölkopf, B. Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (ACL) , Volume 1, Long Papers:8420-8436, (Editors: Lun-Wei Ku and Andre Martins and Vivek Srikumar), Association for Computational Linguistics, August 2024, *equal contribution (Published) arXiv URL BibTeX
Empirical Inference Article Leveraging Task Structures for Improved Identifiability in Neural Network Representations Chen*, W., Horwood*, J., Heo, J., Hernández-Lobato, J. M. Transactions on Machine Learning Research, August 2024, *equal contribution (Published) URL BibTeX
Empirical Inference Conference Paper Modelling Variability in Human Annotator Simulation Wu*, W., Chen*, W., Zhang, C., Woodland, P. C. Findings of the Association for Computational Linguistics (ACL), 1139-1157, (Editors: Ku, Lun-Wei and Martins, Andre and Srikumar, Vivek), Association for Computational Linguistics, August 2024, *equal contribution (Published) URL BibTeX
Empirical Inference Conference Paper Moûsai: Efficient Text-to-Music Diffusion Models Schneider, F., Kamal, O., Jin, Z., Schölkopf, B. Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (ACL), Volume 1: Long Papers:8050-8068, (Editors: Lun-Wei Ku and Andre Martins and Vivek Srikumar), Association for Computational Linguistics, August 2024 (Published) URL BibTeX
Empirical Inference Conference Paper CausalCite: A Causal Formulation of Paper Citations Agrawal, I., Jin, Z., Mokhtarian, E., Guo, S., Chen, Y., Sachan, M., Schölkopf, B. Findings of the Association for Computational Linguistics (ACL), 8395-8410, (Editors: Ku, Lun-Wei and Martins, Andre and Srikumar, Vivek), Association for Computational Linguistics, August 2024 (Published) arXiv URL BibTeX
Deep Models and Optimization Article An Adaptive Stochastic Gradient Method with Non-negative Gauss-Newton Stepsizes Orvieto, A., Xiao, L. July 2024 (Submitted) BibTeX
Empirical Inference Ph.D. Thesis A Measure-Theoretic Axiomatisation of Causality and Kernel Regression Park, J. University of Tübingen, Germany, July 2024 (Published) BibTeX
Empirical Inference Conference Paper A Sparsity Principle for Partially Observable Causal Representation Learning Xu, D., Yao, D., Lachapelle, S., Taslakian, P., von Kügelgen, J., Locatello, F., Magliacane, S. Proceedings of the 41st International Conference on Machine Learning (ICML), 235:55389-55433, Proceedings of Machine Learning Research, (Editors: Salakhutdinov, Ruslan and Kolter, Zico and Heller, Katherine and Weller, Adrian and Oliver, Nuria and Scarlett, Jonathan and Berkenkamp, Felix), PMLR, July 2024 (Published) URL BibTeX
Empirical Inference Conference Paper Accuracy on the wrong line: On the pitfalls of noisy data for OOD generalisation Sanyal, A., Hu, Y., Yu, Y., Ma, Y., Wang, Y., Schölkopf, B. ICML 2024 Next Generation of AI Safety Workshop (Oral), July 2024 (Published) arXiv PDF BibTeX
Empirical Inference Conference Paper All-in-one simulation-based inference Gloeckler, M., Deistler, M., Weilbach, C. D., Wood, F., Macke, J. H. Proceedings of the 41st International Conference on Machine Learning (ICML), 235:15735-15766, Proceedings of Machine Learning Research, (Editors: Salakhutdinov, Ruslan and Kolter, Zico and Heller, Katherine and Weller, Adrian and Oliver, Nuria and Scarlett, Jonathan and Berkenkamp, Felix), PMLR, July 2024 (Published) URL BibTeX
Learning and Dynamical Systems Empirical Inference Article Deep Backtracking Counterfactuals for Causally Compliant Explanations Kladny, K., Kügelgen, J. V., Schölkopf, B., Muehlebach, M. Transactions on Machine Learning Research, July 2024 (Published) arXiv URL BibTeX
Empirical Inference Conference Paper Detecting and Identifying Selection Structure in Sequential Data Zheng, Y., Tang, Z., Qiu, Y., Schölkopf, B., Zhang, K. Proceedings of the 41st International Conference on Machine Learning (ICML), 235:61498-61525, Proceedings of Machine Learning Research, (Editors: Salakhutdinov, Ruslan and Kolter, Zico and Heller, Katherine and Weller, Adrian and Oliver, Nuria and Scarlett, Jonathan and Berkenkamp, Felix), PMLR, July 2024 (Published) URL BibTeX
Empirical Inference Conference Paper Diffusion Tempering Improves Parameter Estimation with Probabilistic Integrators for ODEs Beck, J., Bosch, N., Deistler, M., Kadhim, K. L., Macke, J. H., Hennig, P., Berens, P. Proceedings of the 41st International Conference on Machine Learning (ICML), 235:3305-3326, Proceedings of Machine Learning Research, (Editors: Salakhutdinov, Ruslan and Kolter, Zico and Heller, Katherine and Weller, Adrian and Oliver, Nuria and Scarlett, Jonathan and Berkenkamp, Felix), PMLR, July 2024 (Published) arXiv URL BibTeX
Empirical Inference Conference Paper Diffusive Gibbs Sampling Chen*, W., Zhang*, M., Paige, B., Hernández-Lobato, J. M., Barber, D. Proceedings of the 41st International Conference on Machine Learning (ICML), 235:7731-7747, Proceedings of Machine Learning Research, (Editors: Salakhutdinov, Ruslan and Kolter, Zico and Heller, Katherine and Weller, Adrian and Oliver, Nuria and Scarlett, Jonathan and Berkenkamp, Felix), PMLR, July 2024, *equal contribution (Published) URL BibTeX
Empirical Inference Conference Paper Do Language Models Exhibit the Same Cognitive Biases in Problem Solving as Human Learners? Opedal, A., Stolfo, A., Shirakami, H., Jiao, Y., Cotterell, R., Schölkopf, B., Saparov, A., Sachan, M. Proceedings of the 41st International Conference on Machine Learning (ICML), 235:38762-38778, Proceedings of Machine Learning Research, (Editors: Salakhutdinov, Ruslan and Kolter, Zico and Heller, Katherine and Weller, Adrian and Oliver, Nuria and Scarlett, Jonathan and Berkenkamp, Felix), PMLR, July 2024 (Published) URL BibTeX
Empirical Inference Ph.D. Thesis Enhancement and Evaluation of Deep Generative Networks with Applications in Super-Resolution and Image Generation Sajjadi, S. M. M. University of Tübingen, Germany, July 2024 (Published) BibTeX
Empirical Inference Conference Paper Geometry-Aware Instrumental Variable Regression Kremer, H., Schölkopf, B. Proceedings of the 41st International Conference on Machine Learning (ICML), 235:25560-25582, Proceedings of Machine Learning Research, (Editors: Salakhutdinov, Ruslan and Kolter, Zico and Heller, Katherine and Weller, Adrian and Oliver, Nuria and Scarlett, Jonathan and Berkenkamp, Felix), PMLR, July 2024 (Published) URL BibTeX
Empirical Inference Conference Paper Implicit meta-learning may lead language models to trust more reliable sources Krasheninnikov, D., Krasheninnikov, E., Mlodozeniec, B. K., Maharaj, T., Krueger, D. Proceedings of the 41st International Conference on Machine Learning, 235:25534-25559, Proceedings of Machine Learning Research, (Editors: Salakhutdinov, Ruslan and Kolter, Zico and Heller, Katherine and Weller, Adrian and Oliver, Nuria and Scarlett, Jonathan and Berkenkamp, Felix), PMLR, July 2024 (Published) URL BibTeX
Empirical Inference Conference Paper Improving Neural Additive Models with Bayesian Principles Bouchiat, K., Immer, A., Yèche, H., Rätsch, G., Fortuin, V. Proceedings of the 41st International Conference on Machine Learning (ICML), 235:4416-4443, Proceedings of Machine Learning Research, (Editors: Salakhutdinov, Ruslan and Kolter, Zico and Heller, Katherine and Weller, Adrian and Oliver, Nuria and Scarlett, Jonathan and Berkenkamp, Felix), PMLR, July 2024 (Published) URL BibTeX
Robust Machine Learning Conference Paper InfoNCE: Identifying the Gap Between Theory and Practice Rusak, E., Reizinger, P., Juhos, A., Bringmann, O., Zimmermann, R. S., Brendel, W. In July 2024 (Published) BibTeX
Empirical Inference Conference Paper On the Growth of Mistakes in Differentially Private Online Learning: A Lower Bound Perspective Dmitriev, D., Szabó, K., Sanyal, A. Proceedings of the 37th Annual Conference on Learning Theory (COLT), 247:1379-1398, Proceedings of Machine Learning Research, (Editors: Agrawal, Shipra and Roth, Aaron), PMLR, July 2024, (talk) (Published) URL BibTeX
Empirical Inference Robust Machine Learning Conference Paper Position: Understanding LLMs Requires More Than Statistical Generalization Reizinger, P., Ujváry, S., Mészáros, A., Kerekes, A., Brendel, W., Huszár, F. Proceedings of the 41st International Conference on Machine Learning (ICML), 235:42365-42390, Proceedings of Machine Learning Research, (Editors: Salakhutdinov, Ruslan and Kolter, Zico and Heller, Katherine and Weller, Adrian and Oliver, Nuria and Scarlett, Jonathan and Berkenkamp, Felix), PMLR, July 2024 (Published) arXiv URL BibTeX
Empirical Inference Article Probabilistic pathway-based multimodal factor analysis Immer, A., Stark, S. G., Jacob, F., Bonilla, X., Thomas, T., Kahles, A., Goetze, S., Milani, E. S., Wollscheid, B., Consortium, T. T. P., et al. Bioinformatics, 40(Supplement 1):i189-i198, July 2024 (Published) DOI URL BibTeX
Empirical Inference Conference Paper Products, Abstractions and Inclusions of Causal Spaces Buchholz, S., Park, J., Schölkopf, B. 40th Conference on Uncertainty in Artificial Intelligence (UAI), 244:430-449, Proceedings of Machine Learning Research, (Editors: Kiyavash, Negar and Mooij, Joris M.), PMLR, July 2024 (Published) arXiv URL BibTeX
Empirical Inference Conference Paper Provable Privacy with Non-Private Pre-Processing Hu, Y., Sanyal, A., Schölkopf, B. Proceedings of the 41st International Conference on Machine Learning (ICML), 235:19402-19437, Proceedings of Machine Learning Research, (Editors: Salakhutdinov, Ruslan and Kolter, Zico and Heller, Katherine and Weller, Adrian and Oliver, Nuria and Scarlett, Jonathan and Berkenkamp, Felix), PMLR, July 2024 (Published) URL BibTeX
Empirical Inference Conference Paper Robustness of Nonlinear Representation Learning Buchholz, S., Schölkopf, B. Proceedings of the 41st International Conference on Machine Learning (ICML), 235:4785-4821, Proceedings of Machine Learning Research, (Editors: Salakhutdinov, Ruslan and Kolter, Zico and Heller, Katherine and Weller, Adrian and Oliver, Nuria and Scarlett, Jonathan and Berkenkamp, Felix), PMLR, July 2024 (Published) URL BibTeX
Empirical Inference Learning and Dynamical Systems Robotics Conference Paper Safe & Accurate at Speed with Tendons: A Robot Arm for Exploring Dynamic Motion Guist, S., Schneider, J., Ma, H., Chen, L., Berenz, V., Martus, J., Ott, H., Grüninger, F., Muehlebach, M., Fiene, J., et al. Proceedings of Robotics: Science and Systems, July 2024 (Published) arXiv Project Page DOI URL BibTeX
Empirical Inference Conference Paper Simultaneous identification of models and parameters of scientific simulators Schröder, C., Macke, J. H. Proceedings of the 41st International Conference on Machine Learning (ICML), 235:43895-43927, Proceedings of Machine Learning Research, (Editors: Salakhutdinov, Ruslan and Kolter, Zico and Heller, Katherine and Weller, Adrian and Oliver, Nuria and Scarlett, Jonathan and Berkenkamp, Felix), PMLR, July 2024 (Published) URL BibTeX
Empirical Inference Conference Paper Stitching Manifolds: Leveraging Interaction to Compose Object Representations into Scenes Keurti, H., Schölkopf, B., Aceituno, P. V., Grewe, B. ICML 2024 Workshop on Geometry-grounded Representation Learning and Generative Modeling (GRaM), July 2024 (Published) URL BibTeX
Empirical Inference Conference Paper Targeted Reduction of Causal Models Kekić, A., Schölkopf, B., Besserve, M. 40th Conference on Uncertainty in Artificial Intelligence (UAI), 244:1953-1980, Proceedings of Machine Learning Research, (Editors: Kiyavash, Negar and Mooij, Joris M.), PMLR, July 2024 (Published) arXiv URL BibTeX
Human Aspects of Machine Learning Empirical Inference Conference Paper The Role of Learning Algorithms in Collective Action Ben-Dov*, O., Fawkes*, J., Samadi, S., Sanyal, A. Proceedings of the 41st International Conference on Machine Learning (ICML), 235:3443-3461, Proceedings of Machine Learning Research, (Editors: Salakhutdinov, Ruslan and Kolter, Zico and Heller, Katherine and Weller, Adrian and Oliver, Nuria and Scarlett, Jonathan and Berkenkamp, Felix), PMLR, July 2024, *equal contribution (Published) URL BibTeX
Empirical Inference Conference Paper Unveiling CLIP Dynamics: Linear Mode Connectivity and Generalization Abdolahpourrostam, A., Sanyal, A., Moosavi-Dezfooli, S. ICML 2024 Workshop on Foundation Models in the Wild, July 2024 (Published) URL BibTeX
Empirical Inference Conference Paper What Makes Safety Fine-tuning Methods Safe? A Mechanistic Study Jain, S., Lubana, E. S., Oksuz, K., Joy, T., Torr, P. H. S., Sanyal, A., Dokania, P. K. ICML 2024 Workshop on Mechanistic Interpretability (Spotlight), July 2024 (Published) URL BibTeX
Deep Models and Optimization Article An accelerated Lyapunov function for Polyak’s Heavy-ball on convex quadratics Orvieto, A. Optimization Letters, June 2024 (Published) BibTeX
Deep Models and Optimization Article Gradient Descent on Logistic Regression with Non-Separable Data and Large Step Sizes Yi Meng, S., Orvieto, A., Yiming Cao, D., De Sa, C. June 2024 (Submitted) BibTeX
Deep Models and Optimization Conference Paper Universality of Linear Recurrences Followed by Non-linear Projections: Finite-Width Guarantees and Benefits of Complex Eigenvalues Orvieto, A., De, S., Gulcehre, C., Pascanu, R., Smith, S. L. In Proceedings of Machine Learning Research, Proceedings of the Forty-First International Conference on Machine Learning , Forty-First International Conference on Machine Learning , June 2024 (Published) URL BibTeX