Relax, it doesn't matter how you get there!

Mehdi Azabou, Michael Mendelson, Maks Sorokin, Shantanu Thakoor, Nauman Ahad, Carolina Urzay, Eva L Dyer

Neural Information Processing Systems (NeurIPS) 2023 - Spotlight

Abstract

We introduce Bootstrap Across Multiple Scales (BAMS), a multi-scale self-supervised representation learning model for behavior analysis. We combine a pooling module that aggregates features extracted over encoders with different temporal receptive fields, and design latent objectives to bootstrap the representations in each respective space to encourage disentanglement across different timescales.