hunoutl/paperlists huggingface dataset:
Title: Sub-Linear Memory: How to Make Performers SLiM
Authors: Valerii Likhosherstov, Krzysztof Choromanski, Jared Quincy Davis, Xingyou Song, Adrian Weller
Affiliations: University of Cambridge & Alan Turing Institute; DeepMind & Stanford University; University of Cambridge; Google Brain & Columbia University; Google Brain
Conference: nips 2021 (main track)
Keywords: transformer;performer;slim-performer;memory efficient;linear transformer
Decision: Poster
Title: Photonic Differential Privacy with Direct Feedback Alignment
Authors: Ruben Ohana, Hamlet Medina, Julien Launay, Alessandro Cappelli, Iacopo Poli, Liva Ralaivola, Alain Rakotomamonjy
Affiliations: LightOn, Paris, France; LPENS, École Normale Supérieure, Paris, France; Criteo AI Lab, Paris, France; LightOn, Paris, France
Conference: nips 2021 (main track)
Keywords: differential privacy;direct feedback alignment;optical computing;deep learning;alternative training methods
Decision: Poster
Title: Prototypical Cross-Attention Networks for Multiple Object Tracking and Segmentation
Authors: Lei Ke, Xia Li, Martin Danelljan, Yu-Wing Tai, Chi-Keung Tang, Fisher Yu
Affiliations: ETH Zürich, HKUST; ETH Zürich; HKUST; Kuaishou Technology
Conference: nips 2021 (main track)
Keywords: multiple object tracking and segmentation;video instance segmentation;efficient cross-attention networks;space-time memory
Decision: Spotlight
Title: On the Power of Edge Independent Graph Models
Authors: Sudhanshu Chanpuriya, Cameron Musco, Konstantinos Sotiropoulos, Charalampos Tsourakakis
Affiliations: University of Massachusetts Amherst; Boston University; Boston University & ISI Foundation
Conference: nips 2021 (main track)
Keywords: graph generative models;random graphs;edge independent models;node embeddings;triangle density
Decision: Poster
Title: Learning Robust Hierarchical Patterns of Human Brain across Many fMRI Studies
Authors: Dushyant Sahoo, Christos Davatzikos
Affiliations: Department of Radiology, University of Pennsylvania; Department of Electrical Engineering, University of Pennsylvania
Conference: nips 2021 (main track)
Keywords: Hierarchical Latent Factor Modeling;Matrix Factorization;Domain Adaptation;fMRI analysis
Decision: Poster
Title: Alias-Free Generative Adversarial Networks
Authors: Tero Karras, Miika Aittala, Samuli Laine, Erik Härkönen, Janne Hellsten, Jaakko Lehtinen, Timo Aila
Affiliations: Aalto University and NVIDIA; NVIDIA; NVIDIA and Aalto University
Conference: nips 2021 (main track)
Keywords: GAN;CNN;signal processing;aliasing;image synthesis
Decision: Oral
Title: Differentially Private Multi-Armed Bandits in the Shuffle Model
Authors: Jay Tenenbaum, Haim Kaplan, Yishay Mansour, Uri Stemmer
Affiliations: Blavatnik School of Computer Science, Tel Aviv University and Google Research; Google Research
Conference: nips 2021 (main track)
Keywords: multi-armed bandits;differential privacy;shuffle model
Decision: Poster
Title: Convolutional Normalization: Improving Deep Convolutional Network Robustness and Training
Authors: Sheng Liu, Xiao Li, Simon Zhai, Chong You, Zhihui Zhu, Carlos Fernandez-Granda, Qing Qu
Affiliations: New York University; University of Michigan; University of Denver; Google Research; UC Berkeley
Conference: nips 2021 (main track)
Keywords: network architecture design;convolutional sparse coding;weight normalization
Decision: Poster
Title: AugMax: Adversarial Composition of Random Augmentations for Robust Training
Authors: Haotao Wang, Chaowei Xiao, Jean Kossaifi, Zhiding Yu, Anima Anandkumar, Zhangyang Wang
Affiliations: NVIDIA, Arizona State University; NVIDIA; Department of Electrical and Computer Engineering, University of Texas at Austin; NVIDIA, California Institute of Technology
Conference: nips 2021 (main track)
Keywords: Model robustness;natural corruptions;data augmentation;adversarial training
Decision: Poster
Title: Taxonomizing local versus global structure in neural network loss landscapes
Authors: Yaoqing Yang, Liam Hodgkinson, Ryan Theisen, Joe Zou, Joseph Gonzalez, Kannan Ramchandran, Michael Mahoney
Affiliations: University of California, Berkeley, International Computer Science Institute; University of California, Berkeley
Conference: nips 2021 (main track)
Keywords: Loss landscape;energy landscape;deep learning
Decision: Poster
Title: General Low-rank Matrix Optimization: Geometric Analysis and Sharper Bounds
Authors: Haixiang Zhang, Yingjie Bi, Javad Lavaei
Affiliations: Department of IEOR, University of California, Berkeley, Berkeley, CA 94704; Department of Mathematics, University of California, Berkeley, Berkeley, CA 94704
Conference: nips 2021 (main track)
Keywords: Low-rank matrix optimization;global convergence;non-convex optimization;geometric analysis
Decision: Poster
Title: Learning to Adapt via Latent Domains for Adaptive Semantic Segmentation
Authors: Yunan Liu, Shanshan Zhang, Yang Li, Jian Yang
Affiliations: PCA Lab, Key Lab of Intelligent Perception and Systems for High-Dimensional Information of Ministry of Education, Jiangsu Key Lab of Image and Video Understanding for Social Security, School of Computer Science and Engineering, Nanjing University of Science and Technology, Nanjing, China
Conference: nips 2021 (main track)
Keywords: Meta-learning;domain adaptation;semantic segmentation
Decision: Poster
Title: General Nonlinearities in SO(2)-Equivariant CNNs
Authors: Daniel Franzen, Michael Wand
Affiliations: Institute of Computer Science, Johannes Gutenberg University Mainz, Staudingerweg 9, 55122 Mainz, Germany
Conference: nips 2021 (main track)
Keywords: deep learning;equivariance;steerable CNNs;group convolution;harmonic distortion analysis
Decision: Poster
Title: Explaining Latent Representations with a Corpus of Examples
Authors: Jonathan Crabbe, Zhaozhi Qian, Fergus Imrie, Mihaela van der Schaar
Affiliations: University of Cambridge; University of Cambridge, The Alan Turing Institute, UCLA; UCLA
Conference: nips 2021 (main track)
Keywords: explainability;interpretability;latent;representation;decomposition;exampled-based;explanation;feature-based;feature;importance
Decision: Spotlight
Title: NEO: Non Equilibrium Sampling on the Orbits of a Deterministic Transform
Authors: Achille Thin, Yazid Janati El Idrissi, Sylvain Le Corff, Charles Ollion, Eric Moulines, Arnaud Doucet, Alain Durmus, Christian X Robert
Affiliations: Centre de Mathématiques Appliquées, École polytechnique, Palaiseau, France; Université Paris-Saclay, ENS Paris-Saclay, CNRS, Centre Borelli, F-91190 Gif-sur-Yvette, France; Ceremade, Université Paris-Dauphine, France & Department of Statistics, Warwick University, UK; Department of Statistics, University of Oxford, UK; Samovar, Télécom SudParis, Département CITI, Palaiseau, France
Conference: nips 2021 (main track)
Keywords: Importance Sampling;Monte Carlo;Markov chain Monte Carlo
Decision: Poster
Title: Robustness via Uncertainty-aware Cycle Consistency
Authors: Uddeshya Upadhyay, Yanbei Chen, Zeynep Akata
Affiliations: University of Tübingen, Max Planck Institute for Intelligent Systems; University of Tübingen
Conference: nips 2021 (main track)
Keywords: Robustness;Uncertainty;Image-to-Image translation;Cycle Consistency
Decision: Poster
Title: Neural Hybrid Automata: Learning Dynamics With Multiple Modes and Stochastic Transitions
Authors: Michael Poli, Stefano Massaroli, Luca Scimeca, Sanghyuk Chun, Seong Joon Oh, Atsushi Yamashita, Hajime Asama, Jinkyoo Park, Animesh Garg
Affiliations: University of Tokyo; NAVER AI Lab, DiffEqML; NAVER AI Lab; University of Toronto; KAIST; University of Tokyo, DiffEqML
Conference: nips 2021 (main track)
Keywords: dynamical systems;time series;neural differential equations;control;stochastic hybrid systems
Decision: Poster
Title: QuPeD: Quantized Personalization via Distillation with Applications to Federated Learning
Authors: Kaan Ozkara, Navjot Singh, Deepesh Data, Suhas Diggavi
Affiliations: University of California, Los Angeles
Conference: nips 2021 (main track)
Keywords: Personalized Federated Learning;Distributed Optimization;Model Compression;Knowledge Distillation
Decision: Poster
Title: Co-evolution Transformer for Protein Contact Prediction
Authors: He Zhang, Fusong Ju, Jianwei Zhu, Liang He, Bin Shao, Nanning Zheng, Tie-Yan Liu
Affiliations: Microsoft Research Asia; Xi’an Jiaotong University
Conference: nips 2021 (main track)
Keywords: protein contact prediction;transformer;co-evolution principle
Decision: Poster
Title: LSH-SMILE: Locality Sensitive Hashing Accelerated Simulation and Learning
Authors: Chonghao Sima, Yexiang Xue
Affiliations: Department of Computer Science, Purdue University, West Lafayette, IN, USA, 47907
Conference: nips 2021 (main track)
Keywords: Partial Differential Equation;Locality Sensitive Hashing;Learning-driven Scientific Discovery;Learning Physics Systems;Acceleration
Decision: Poster
Title: Catalytic Role Of Noise And Necessity Of Inductive Biases In The Emergence Of Compositional Communication
Authors: Łukasz Kuciński, Tomasz Korbak, Paweł Kołodziej, Piotr Miłoś
Affiliations: Polish Academy of Sciences; Polish Academy of Sciences, deepsense.ai; University of Sussex
Conference: nips 2021 (main track)
Keywords: compositionality;signaling games;noisy channel;deep learning
Decision: Poster
Title: Combining Human Predictions with Model Probabilities via Confusion Matrices and Calibration
Authors: Gavin Kerrigan, Padhraic Smyth, Mark Steyvers
Affiliations: Department of Computer Science, University of California, Irvine; Department of Cognitive Sciences, University of California, Irvine
Conference: nips 2021 (main track)
Keywords: human-machine;human-AI;human-in-the-loop;calibration;classification
Decision: Poster
Title: Scaling up Continuous-Time Markov Chains Helps Resolve Underspecification
Authors: Alkis Gotovos, Rebekka Burkholz, John Quackenbush, Stefanie Jegelka
Affiliations: Harvard University; MIT
Conference: nips 2021 (main track)
Keywords: discrete probabilistic models;continuous-time Markov chains;underspecification;approximate inference;cancer genomics
Decision: Poster
Title: Minibatch and Momentum Model-based Methods for Stochastic Weakly Convex Optimization
Authors: Qi Deng, Wenzhi Gao
Affiliations: School of Information Management and Engineering, Shanghai University of Finance and Economics
Conference: nips 2021 (main track)
Keywords: model-based optimization;weakly convex optimization;stochastic optimization;algorithm stability;momentum methods
Decision: Poster
Title: Stability and Generalization of Bilevel Programming in Hyperparameter Optimization
Authors: Fan Bao, Guoqiang Wu, Chongxuan LI, Jun Zhu, Bo Zhang
Affiliations: Gaoling School of AI, Renmin University of China (formerly at Tsinghua University); Dept. of Comp. Sci. & Tech., Institute for AI, Tsinghua-Huawei Joint Center for AI, BNRist Center, State Key Lab for Intell. Tech. & Sys., Tsinghua University, Beijing, China; School of Software, Shandong University (formerly at Tsinghua University)
Conference: nips 2021 (main track)
Keywords: hyperparameter optimization;generalization;bilevel optimization;stability
Decision: Poster
Title: Noisy Adaptation Generates Lévy Flights in Attractor Neural Networks
Authors: Xingsi Dong, Tianhao Chu, Tiejun Huang, Zilong Ji, Si Wu
Affiliations: School of Psychology and Cognitive Sciences, Peking Univerisity; IDG/McGovern Institute for Brain Research, Peking University; PKU-Tsinghua Center for Life Sciences, Academy for Advanced Interdisciplinary Studies, Peking University.; School of Electronics Engineering and Computer Science, Peking University.
Conference: nips 2021 (main track)
Keywords: Lévy flights;Neural adaptation;Attractor neural networks;Information searching;Free memory retrieval
Decision: Poster
Title: A novel notion of barycenter for probability distributions based on optimal weak mass transport
Authors: Elsa Cazelles, Felipe Tobar, Joaquin Fontbona
Affiliations: CMM, Universidad de Chile; IDIA & CMM, Universidad de Chile; IRIT, Université de Toulouse, CNRS
Conference: nips 2021 (main track)
Keywords: Optimal transport;Optimal weak transport;Barycenter of probability measures
Decision: Poster
Title: Overparameterization Improves Robustness to Covariate Shift in High Dimensions
Authors: Nilesh Tripuraneni, Ben Adlam, Jeffrey Pennington
Affiliations: Brain Team, Google Research; U.C. Berkeley
Conference: nips 2021 (main track)
Keywords: Deep Learning Theory;Distribution Shift;Random Matrices;High-Dimensional Statistics
Decision: Poster
Title: Learning Theory Can (Sometimes) Explain Generalisation in Graph Neural Networks
Authors: Pascal Esser, Leena Chennuru Vankadara, Debarghya Ghoshdastidar
Affiliations: Technical University of Munich; Technical University of Munich, Munich Data Science Institute; University of Tübingen
Conference: nips 2021 (main track)
Keywords: Learning Theory;Generalisation;Graph Neural Networks;Transductive Learning;Rademacher Complexity
Decision: Poster
Title: MetaAvatar: Learning Animatable Clothed Human Models from Few Depth Images
Authors: Shaofei Wang, Marko Mihajlovic, Qianli Ma, Andreas Geiger, Siyu Tang
Affiliations: ETH Zürich; Max Planck Institute for Intelligent Systems, Tübingen; University of Tübingen; Max Planck Institute for Intelligent Systems, Tübingen
Conference: nips 2021 (main track)
Keywords: Neural Implict Functions;3D Computer Vision;Clothed Human Modeling;Meta-Learning;Cloth Modeling;HyperNetworks
Decision: Poster
Title: Faster Directional Convergence of Linear Neural Networks under Spherically Symmetric Data
Authors: Dachao Lin, Ruoyu Sun, Zhihua Zhang
Affiliations: School of Mathematical Sciences, Peking University; Department of Industrial and Enterprise Engineering, Coordinate Science Lab (affiliated), University of Illinois Urbana-Champaign; Academy for Advanced Interdisciplinary Studies, Peking University
Conference: nips 2021 (main track)
Keywords: optimization for deep linear networks;global directional convergence
Decision: Poster
Title: Pruning Randomly Initialized Neural Networks with Iterative Randomization
Authors: Daiki Chijiwa, Shin'ya Yamaguchi, Yasutoshi Ida, Kenji Umakoshi, Tomohiro INOUE
Affiliations: NTT Social Informatics Laboratories, NTT Corporation; NTT Computer and Data Science Laboratories, NTT Corporation
Conference: nips 2021 (main track)
Keywords: lottery ticket hypothesis;approximation theorem;neural network pruning
Decision: Spotlight
Title: Dynamical Wasserstein Barycenters for Time-series Modeling
Authors: Kevin Cheng, Shuchin Aeron, Michael Hughes, Eric L Miller
Affiliations: Tufts University
Conference: nips 2021 (main track)
Keywords: time series;transition;optimal transport;Wasserstein barycenter;displacement interpolation;simplex random walk;state space;dynamical model;Riemannian optimization;human activity recognition
Decision: Poster
Title: Fair Scheduling for Time-dependent Resources
Authors: Bo Li, Minming Li, Ruilong Zhang
Affiliations: Department of Computer Science, City University of Hong Kong, Kowloon Tang, Hong Kong; Department of Computing, The Hong Kong Polytechnic University, Hung Hom, Hong Kong
Conference: nips 2021 (main track)
Keywords: Fairness;Time-dependent resource;Maximin share;Envy-freeness
Decision: Poster
Title: Revisiting the Calibration of Modern Neural Networks
Authors: Matthias Minderer, Josip Djolonga, Rob Romijnders, Frances Hubis, Xiaohua Zhai, Neil Houlsby, Dustin Tran, Mario Lucic
Affiliations: Google Research, Brain Team
Conference: nips 2021 (main track)
Keywords: uncertainty;calibration;image classification
Decision: Poster
Title: Framing RNN as a kernel method: A neural ODE approach
Authors: Adeline Fermanian, Pierre Marion, Jean-Philippe Vert, Gérard Biau
Affiliations: Google Research, Brain team, Paris, France; Sorbonne Université, CNRS, Laboratoire de Probabilités, Statistique et Modélisation, LPSM, F-75005 Paris, France
Conference: nips 2021 (main track)
Keywords: recurrent neural networks;neural ODE;kernel method;theory of deep learning;generalization bounds
Decision: Oral
Title: Non-approximate Inference for Collective Graphical Models on Path Graphs via Discrete Difference of Convex Algorithm
Authors: Yasunori Akagi, Naoki Marumo, Hideaki Kim, Takeshi Kurashima, Hiroyuki Toda
Affiliations: NTT Communication Science Laboratories, NTT Corporation; NTT Human Informatics Laboratories, NTT Corporation
Conference: nips 2021 (main track)
Keywords: Collective Graphical Model;Aggregated Data;DC Algorithm;Minimum Cost Flow
Decision: Poster
Title: WikiChurches: A Fine-Grained Dataset of Architectural Styles with Real-World Challenges
Affiliations: Computer Vision Group, Friedrich Schiller University Jena, Jena, Germany
Conference: nips 2021 (Datasets & Benchmarks track)
Keywords: Architectural Style Recognition;Computer Vision;Image Dataset;Fine-Grained Visual Categorization;Fine-Grained Visual Recognition;Hierarchical Classification;Class Hierarchy;Data-efficient Deep Learning;Imprecise Labels;Imbalanced Classes
Decision: Poster
Title: Why Generalization in RL is Difficult: Epistemic POMDPs and Implicit Partial Observability
Authors: Dibya Ghosh, Jad Rahme, Aviral Kumar, Amy Zhang, Ryan Adams, Sergey Levine
Affiliations: Facebook AI Research; Princeton University; UC Berkeley
Conference: nips 2021 (main track)
Keywords: Reinforcement Learning;generalization
Decision: Poster
Title: Mixed Supervised Object Detection by Transferring Mask Prior and Semantic Similarity
Authors: Yan Liu, Zhijie Zhang, Li Niu, Junjie Chen, Liqing Zhang
Affiliations: MoE Key Lab of Artificial Intelligence, Department of Computer Science and Engineering, Shanghai Jiao Tong University; Department of Computer Science and Engineering, Shanghai Jiao Tong University
Conference: nips 2021 (main track)
Keywords: object detection;weak-shot learning;transfer learning
Decision: Poster
Title: FINE Samples for Learning with Noisy Labels
Authors: Taehyeon Kim, Jongwoo Ko, sangwook Cho, JinHwan Choi, Se-Young Yun
Affiliations: KAIST AI, KAIST, Daejeon, South Korea
Conference: nips 2021 (main track)
Keywords: Learning with noisy labels;Image Classification;Deep Neural Networks;Eigen Decomposition
Decision: Poster
Title: Stochastic Optimization of Areas Under Precision-Recall Curves with Provable Convergence
Authors: Qi Qi, Youzhi Luo, Zhao Xu, Shuiwang Ji, Tianbao Yang
Affiliations: Department of Computer Science & Engineering, Texas A&M University; Department of Computer Science, The University of Iowa
Conference: nips 2021 (main track)
Keywords: AUPRC;StochastiC Optimization;Graph Neural Network;Image Classification
Decision: Poster
Title: Beyond Pinball Loss: Quantile Methods for Calibrated Uncertainty Quantification
Authors: Youngseog Chung, Willie Neiswanger, Ian Char, Jeff Schneider
Affiliations: Department of Computer Science, Stanford University, Stanford, CA 94305; Machine Learning Department, Carnegie Mellon University, Pittsburgh, PA 15213; Robotics Institute, Carnegie Mellon University, Pittsburgh, PA 15213
Conference: nips 2021 (main track)
Keywords: uncertainty quantification;calibration;pinball loss;quantile regression
Decision: Poster
Title: Structured Dropout Variational Inference for Bayesian Neural Networks
Authors: Son Nguyen, Duong Nguyen, Khai Nguyen, Khoat Than, Hung Bui, Nhat Ho
Affiliations: University of Texas, Austin; Hanoi University of Science and Technology; VinAI Research, Viet Nam
Conference: nips 2021 (main track)
Keywords: Bayesian neural networks;Variational Dropout;Structured Approximate inference
Decision: Poster
Title: Space-time Mixing Attention for Video Transformer
Authors: Adrian Bulat, Juan Manuel Perez Rua, Swathikiran Sudhakaran, Brais Martinez, Georgios Tzimiropoulos
Affiliations: Samsung AI Cambridge, Queen Mary University of London; Samsung AI Cambridge
Conference: nips 2021 (main track)
Keywords: video recognition;transformers;efficient networks
Decision: Poster
Title: Fast Certified Robust Training with Short Warmup
Authors: Zhouxing Shi, Yihan Wang, Huan Zhang, Jinfeng Yi, Cho-Jui Hsieh
Affiliations: University of California, Los Angeles; University of California, Los Angeles and Carnegie Mellon University; JD AI Research
Conference: nips 2021 (main track)
Keywords: Certified robustness;Adversarial robustness
Decision: Poster
Title: Adaptive Proximal Gradient Methods for Structured Neural Networks
Authors: Jihun Yun, Aurelie Lozano, Eunho Yang
Affiliations: KAIST; IBM T.J. Watson Research Center; KAIST, AITRICS
Conference: nips 2021 (main track)
Keywords: Proximal Gradient Descent for Adaptive Methods;Stochastic Optimization;Non-convex Optimization
Decision: Poster
Title: Partial success in closing the gap between human and machine vision
Authors: Robert Geirhos, Kantharaju Narayanappa, Benjamin Mitzkus, Tizian Thieringer, Matthias Bethge, Felix A. Wichmann, Wieland Brendel
Affiliations: University of Tübingen, International Max Planck Research School for Intelligent Systems; University of Tübingen
Conference: nips 2021 (main track)
Keywords: psychophysics;machine vision;human vision;out-of-distribution generalisation;visual perception;robustness;human behaviour
Decision: Oral
Title: Model-Based Episodic Memory Induces Dynamic Hybrid Controls
Authors: Hung Le, Thommen Karimpanal George, Majid Abdolshah, Truyen Tran, Svetha Venkatesh
Affiliations: Applied AI Institute, Deakin University, Geelong, Australia
Conference: nips 2021 (main track)
Keywords: Reinforcement learning;episodic memory;sample-efficiency
Decision: Poster
Title: RelaySum for Decentralized Deep Learning on Heterogeneous Data
Authors: Thijs Vogels, Lie He, Anastasiia Koloskova, Sai Praneeth Karimireddy, Tao Lin, Sebastian Stich, Martin Jaggi
Affiliations: EPFL
Conference: nips 2021 (main track)
Keywords: decentralized optimization;distributed optimization;consensus;deep learning
Decision: Poster
Title: Determinantal point processes based on orthogonal polynomials for sampling minibatches in SGD
Authors: Rémi Bardenet, Subhroshekhar Ghosh, Meixia LIN
Affiliations: Université de Lille, CNRS, Centrale Lille UMR 9189 – CRIStAL, F-59000 Lille, France; National University of Singapore, Institute of Operations Research and Analytics, 10 Lower Kent Ridge Road, 119076, Singapore; National University of Singapore, Department of Mathematics, 10 Lower Kent Ridge Road, 119076, Singapore
Conference: nips 2021 (main track)
Keywords: determinantal point processes;variance reduction;stochastic gradient descent;orthogonal polynomials
Decision: Spotlight
Title: Discerning Decision-Making Process of Deep Neural Networks with Hierarchical Voting Transformation
Authors: Ying Sun, Hengshu Zhu, Chuan Qin, Fuzhen Zhuang, Qing He, Hui Xiong
Affiliations: Baidu Talent Intelligence Center, Baidu Inc.; Institute of Artiﬁcial Intelligence, Beihang University; Artiﬁcial Intelligence Thrust, The Hong Kong University of Science and Technology; IIP, Institute of Computing Technology, Chinese Academy of Sciences
Conference: nips 2021 (main track)
Keywords: Explainable Neural Networks
Decision: Poster
Title: The Tufts fNIRS Mental Workload Dataset & Benchmark for Brain-Computer Interfaces that Generalize
Affiliations: Dept. of Computer Engineering, Univ. of Maryland Baltimore County; Dept. of Computer Science, Tufts University; Dept. of Biomedical Engineering, Tufts University
Conference: nips 2021 (Datasets & Benchmarks track)
Keywords: time-series classification;fine-tuning;supervised domain adaptation;brain-computer interface;functional near-infrared spectroscopy;n-back;mental workload;cognitive workload;working memory workload
Decision: Poster
Title: Do Vision Transformers See Like Convolutional Neural Networks?
Authors: Maithra Raghu, Thomas Unterthiner, Simon Kornblith, Chiyuan Zhang, Alexey Dosovitskiy
Affiliations: Google Research, Brain Team
Conference: nips 2021 (main track)
Keywords: Vision Transformers;Representation Analysis;Representation Learning;Representation Similarity;Computer Vision;Convolutional Neural Networks
Decision: Poster
Title: Learnable Fourier Features for Multi-dimensional Spatial Positional Encoding
Authors: Yang Li, Si Si, Gang Li, Cho-Jui Hsieh, Samy Bengio
Affiliations: Google Research, Mountain View, CA; UCLA, Los Angeles, CA
Conference: nips 2021 (main track)
Keywords: Positional encoding;Transformer;Fourier features;multi-dimensional spatial tasks;image classification;image generation;object detection;widget captioning;UI modeling
Decision: Poster