hunoutl/paperlists huggingface dataset:
Title: Missingness Bias in Model Debugging
Authors: Saachi Jain, Hadi Salman, Eric Wong, Pengchuan Zhang, Vibhav Vineet, Sai Vemprala, Aleksander Madry
Affiliations: Massachusetts Institute of Technology; Microsoft Research
Conference: iclr 2022 (main track)
Keywords: model debugging;vision transformers;missingness
Decision: Poster
Title: SURF: Semi-supervised Reward Learning with Data Augmentation for Feedback-efficient Preference-based Reinforcement Learning
Authors: Jongjin Park, Younggyo Seo, Jinwoo Shin, Honglak Lee, Pieter Abbeel, Kimin Lee
Affiliations: KAIST; UC Berkeley; University of Michigan, LG AI Research
Conference: iclr 2022 (main track)
Keywords: preference-based reinforcement learning;human-in-the-loop reinforcement learning;deep reinforcement learning;semi-supervised learning
Decision: Poster
Title: Learning Distributionally Robust Models at Scale via Composite Optimization
Authors: Farzin Haddadpour, Mohammad Mahdi Kamani, Mehrdad Mahdavi, Amin Karbasi
Affiliations: Wyze Labs Inc.; Yale Institute for Network Science, Yale University; Department of Computer Science & Engineering, The Pennsylvania State University
Conference: iclr 2022 (main track)
Keywords: Composite Optimization;Distributionally Robust Optimization
Decision: Poster
Title: Curriculum learning as a tool to uncover learning principles in the brain
Authors: Daniel R Kepple, Rainer Engelken, Kanaka Rajan
Affiliations: Friedman Brain Institute, Icahn School of Medicine at Mount Sinai, New York, NY 10029, USA; Department of Neuroscience, Zuckerman Institute, Columbia University, New York, NY 10027, USA
Conference: iclr 2022 (main track)
Keywords: curriculum learning;neuroscience
Decision: Poster
Title: Axiomatic Explanations for Visual Search, Retrieval, and Similarity Learning
Authors: Mark Hamilton, Scott Lundberg, Stephanie Fu, Lei Zhang, William Freeman
Affiliations: MIT, Google; MIT; Microsoft
Conference: iclr 2022 (main track)
Keywords: Model Interpretability;Shapley Values;Search Engines;Information Retrieval;Visual Search;Similarity Learning;Metric Learning;Black-box explanations
Decision: Poster
Title: Backdoor Defense via Decoupling the Training Process
Authors: Kunzhe Huang, Yiming Li, Baoyuan Wu, Zhan Qin, Kui Ren
Affiliations: School of Cyber Science and Technology, Zhejiang University; Tsinghua Shenzhen International Graduate School, Tsinghua University; School of Data Science, Shenzhen Research Institute of Big Data, The Chinese University of Hong Kong, Shenzhen
Conference: iclr 2022 (main track)
Keywords: Backdoor Defense;Backdoor Learning
Decision: Poster
Title: T-WaveNet: A Tree-Structured Wavelet Neural Network for Time Series Signal Analysis
Authors: Minhao LIU, Ailing Zeng, Qiuxia LAI, Ruiyuan Gao, Min Li, Jing Qin, Qiang Xu
Affiliations: Department of Computer Science & Engineering, The Chinese University of Hong Kong; School of Nursing, The Hong Kong Polytechnic University
Conference: iclr 2022 (main track)
Decision: Poster
Title: Provably Robust Adversarial Examples
Authors: Dimitar I. Dimitrov, Gagandeep Singh, Timon Gehr, Martin Vechev
Affiliations: University of Illinois, Urbana Champaign; ETH Zurich
Conference: iclr 2022 (main track)
Keywords: Adversarial attacks;Robustness Certification;Abstract Interpretation;Deep Learning
Decision: Poster
Title: Information Gain Propagation: a New Way to Graph Active Learning with Soft Labels
Authors: Wentao Zhang, Yexin Wang, Zhenbang You, Meng Cao, Ping Huang, Jiulong Shan, Zhi Yang, Bin CUI
Affiliations: School of CS, Peking University; National Engineering Laboratory for Big Data Analysis and Applications; Institute of Computational Social Science, Peking University (Qingdao), China; School of CS, Peking University; Apple; School of CS, Peking University; National Engineering Laboratory for Big Data Analysis and Applications
Conference: iclr 2022 (main track)
Keywords: Active Learning;Graph;Information Gain
Decision: Poster
Title: Graph-based Nearest Neighbor Search in Hyperbolic Spaces
Authors: Liudmila Prokhorenkova, Dmitry Baranchuk, Nikolay Bogachev, Yury Demidovich, Alexander Kolpakov
Affiliations: Université de Neuchâtel, Neuchâtel, Switzerland; Yandex Research, Moscow, Russia; MIPT, Moscow, Russia; IITP RAS; MIPT, Moscow, Russia
Conference: iclr 2022 (main track)
Keywords: similarity search;nearest neighbor search;hyperbolic space;graph-based nearest neighbor search
Decision: Poster
Title: Fine-Tuning can Distort Pretrained Features and Underperform Out-of-Distribution
Authors: Ananya Kumar, Aditi Raghunathan, Robbie Jones, Tengyu Ma, Percy Liang
Affiliations: Stanford University, Computer Science Department
Conference: iclr 2022 (main track)
Keywords: fine-tuning theory;transfer learning theory;fine-tuning;distribution shift;implicit regularization
Decision: Oral
Title: What Makes Better Augmentation Strategies? Augment Difficult but Not too Different
Authors: Jaehyung Kim, Dongyeop Kang, Sungsoo Ahn, Jinwoo Shin
Affiliations: University of Minnesota (UMN); Korea Advanced Institute of Science and Technology (KAIST); Pohang University of Science and Technology (POSTECH)
Conference: iclr 2022 (main track)
Keywords: NLP;data augmentation;learning augmentation policy;text classification
Decision: Poster
Title: Minimax Optimization with Smooth Algorithmic Adversaries
Authors: Tanner Fiez, Chi Jin, Praneeth Netrapalli, Lillian J Ratliff
Affiliations: Google Research, India; Princeton University; University of Washington, Seattle
Conference: iclr 2022 (main track)
Keywords: Minimax optimization;two player zero sum games;generative adversarial networks;adversarial training
Decision: Poster
Title: MIDI-DDSP: Detailed Control of Musical Performance via Hierarchical Modeling
Authors: Yusong Wu, Ethan Manilow, Yi Deng, Rigel Swavely, Kyle Kastner, Timotheus Cooijmans, Aaron Courville, Anna Huang, Jesse Engel
Affiliations: Mila, Quebec Artiﬁcial Intelligence Institute, Universit ´e de Montr ´eal; Northwestern University; Google Brain; New York University
Conference: iclr 2022 (main track)
Keywords: Audio Synthesis;Generative Model;Hierarchical;DDSP;Music;Audio;Structured Models
Decision: Oral
Title: Measuring CLEVRness: Black-box Testing of Visual Reasoning Models
Authors: Spyridon Mouselinos, Henryk Michalewski, Mateusz Malinowski
Affiliations: University of Warsaw, Warsaw, Poland; University of Warsaw, Google, Oxford, U.K.; DeepMind, London, U.K.
Conference: iclr 2022 (main track)
Keywords: Visual Reasoning;Visual Question Answering;Black Box Testing;Computer Vision
Decision: Poster
Title: Tuformer: Data-driven Design of Transformers for Improved Generalization or Efficiency
Authors: Xiaoyu Liu, Jiahao Su, Furong Huang
Affiliations: Department of Computer Science, University of Maryland, College Park, MD 20740, USA
Conference: iclr 2022 (main track)
Keywords: Attention Modules;Transformers;Data-driven Model Design;Trainable Heads;Expressive Power;Tensor Methods.
Decision: Poster
Title: Exploring the Limits of Large Scale Pre-training
Authors: Samira Abnar, Mostafa Dehghani, Behnam Neyshabur, Hanie Sedghi
Affiliations: Google Research
Conference: iclr 2022 (main track)
Keywords: Scaling law;Pre-training;Transfer learning;Large Scale;Vision Transformer;Few Shot;Empirical Investigation
Decision: Spotlight
Title: The Unreasonable Effectiveness of Random Pruning: Return of the Most Naive Baseline for Sparse Training
Authors: Shiwei Liu, Tianlong Chen, Xiaohan Chen, Li Shen, Decebal Mocanu, Zhangyang Wang, Mykola Pechenizkiy
Affiliations: University of Texas at Austin; JD Explore Academy; Eindhoven University of Technology; University of Twente
Conference: iclr 2022 (main track)
Keywords: random pruning;sparse training;static sparse training;layer-wise sparsities;dynamic sparse training
Decision: Poster
Title: Implicit Bias of MSE Gradient Optimization in Underparameterized Neural Networks
Authors: Benjamin Bowman, Guido Montufar
Affiliations: UCLA Departments of Mathematics and Statistics and MPI MIS; UCLA Departments of Mathematics
Conference: iclr 2022 (main track)
Keywords: underparameterized regime;spectral bias;neural tangent kernel;implicit bias;implicit regularization;gradient flow
Decision: Poster
Title: Self-Supervised Inference in State-Space Models
Authors: David Ruhe, Patrick Forré
Affiliations: AI4Science, AMLab, University of Amsterdam, The Netherlands; AI4Science, AMLab, Anton Pannekoek Institute, University of Amsterdam, The Netherlands
Conference: iclr 2022 (main track)
Keywords: self-supervision;inference;state-space model;Kalman filter;recurrent neural network
Decision: Poster
Title: Why Propagate Alone? Parallel Use of Labels and Features on Graphs
Authors: Yangkun Wang, Jiarui Jin, Weinan Zhang, Yang Yongyi, Jiuhai Chen, Quan Gan, Yong Yu, Zheng Zhang, Zengfeng Huang, David Wipf
Affiliations: Amazon; Shanghai Jiao Tong University; University of Maryland; Fudan University
Conference: iclr 2022 (main track)
Decision: Poster
Title: DEGREE: Decomposition Based Explanation for Graph Neural Networks
Authors: Qizhang Feng, Ninghao Liu, Fan Yang, Ruixiang Tang, Mengnan Du, Xia Hu
Affiliations: Department of Computer Science, University of Georgia; Department of Computer Science, Rice University; Department of Computer Science and Engineering, Texas A&M University
Conference: iclr 2022 (main track)
Keywords: XAI;GNN
Decision: Poster
Title: Proving the Lottery Ticket Hypothesis for Convolutional Neural Networks
Authors: Arthur da Cunha, Emanuele Natale, Laurent Viennot
Affiliations: Inria Paris, IRIF, Paris, France; Inria Sophia Antipolis, Sophia Antipolis, France
Conference: iclr 2022 (main track)
Keywords: lottery ticket hypothesis;convolutional neural network;network pruning;random subset sum;random neural network
Decision: Poster
Title: Hindsight: Posterior-guided training of retrievers for improved open-ended generation
Authors: Ashwin Paranjape, Omar Khattab, Christopher Potts, Peter Bailis, Christopher Manning
Affiliations: Stanford University
Conference: iclr 2022 (main track)
Keywords: retrieval;generation;retrieval-augmented generation;open-ended generation;informative conversations;free-form QA;posterior distribution;ELBo
Decision: Poster
Title: Entroformer: A Transformer-based Entropy Model for Learned Image Compression
Authors: Yichen Qian, Xiuyu Sun, Ming Lin, Zhiyu Tan, Rong Jin
Affiliations: Alibaba Group, Bellevue, WA, 98004, USA; Alibaba Group, Hangzhou, China
Conference: iclr 2022 (main track)
Keywords: Image compression;Entropy Model;Global Dependencies
Decision: Poster
Title: Encoding Weights of Irregular Sparsity for Fixed-to-Fixed Model Compression
Authors: baeseong park, Se Jung Kwon, Daehwan Oh, Byeonguk Kim, Dongsoo Lee
Affiliations: NAVER CLOVA; Samsung Research
Conference: iclr 2022 (main track)
Keywords: Sparse Neural Network;Fixed-to-fixed data compression;Unstructured Pruning
Decision: Poster
Title: ExT5: Towards Extreme Multi-Task Scaling for Transfer Learning
Authors: Vamsi Aribandi, Yi Tay, Tal Schuster, Jinfeng Rao, Huaixiu Steven Zheng, Sanket Vaibhav Mehta, Honglei Zhuang, Vinh Tran, Dara Bahri, Jianmo Ni, Jai Gupta, Kai Hui, Sebastian Ruder, Donald Metzler
Affiliations: Carnegie Mellon University (CMU); Not provided; Google Research, previously DeepMind; Google Research
Conference: iclr 2022 (main track)
Keywords: Natural Language Processing;Transfer Learning;Multi-task Learning
Decision: Poster
Title: How to Robustify Black-Box ML Models? A Zeroth-Order Optimization Perspective
Authors: Yimeng Zhang, Yuguang Yao, Jinghan Jia, Jinfeng Yi, Mingyi Hong, Shiyu Chang, Sijia Liu
Affiliations: Michigan State University; University of Minnesota; UC Santa Barbara; JD AI Research
Conference: iclr 2022 (main track)
Keywords: Zeroth-Order Optimization;Black-Box Defense;Gradient-Free;Adversarial Robustness;Certified Defense
Decision: Spotlight
Title: Sparse Communication via Mixed Distributions
Authors: António Farinhas, Wilker Aziz, Vlad Niculae, Andre Martins
Affiliations: IvI, University of Amsterdam; Unbabel; Instituto de Telecomunicações, Instituto Superior Técnico (Lisbon ELLIS Unit); ILLC, University of Amsterdam
Conference: iclr 2022 (main track)
Decision: Oral
Title: Learning Prototype-oriented Set Representations for Meta-Learning
Authors: Dandan Guo, Long Tian, Minghe Zhang, Mingyuan Zhou, Hongyuan Zha
Affiliations: The Chinese University of Hong Kong, Shenzhen; Georgia Institute of Technology; The University of Texas at Austin; Xidian University
Conference: iclr 2022 (main track)
Keywords: Summary Networks;Distribution Matching;Optimal Transport;Few-shot Classification;Meta Generative Models
Decision: Poster
Title: Federated Learning from Only Unlabeled Data with Class-conditional-sharing Clients
Authors: Nan Lu, Zhao Wang, Xiaoxiao Li, Gang Niu, Qi Dou, Masashi Sugiyama
Affiliations: The University of Tokyo; RIKEN; The Chinese University of Hong Kong; The University of British Columbia
Conference: iclr 2022 (main track)
Keywords: unsupervised federated learning;unlabeled data;class prior shift
Decision: Poster
Title: CodeTrek: Flexible Modeling of Code using an Extensible Relational Representation
Authors: Pardis Pashakhanloo, Aaditya Naik, Yuepeng Wang, Hanjun Dai, Petros Maniatis, Mayur Naik
Affiliations: Simon Fraser University; Google Research; University of Pennsylvania
Conference: iclr 2022 (main track)
Keywords: relational database;code representation;knowledge graph reasoning;program understanding
Decision: Poster
Title: Robust Learning Meets Generative Models: Can Proxy Distributions Improve Adversarial Robustness?
Authors: Vikash Sehwag, Saeed Mahloujifar, Tinashe Handina, Sihui Dai, Chong Xiang, Mung Chiang, Prateek Mittal
Affiliations: Princeton University; Caltech; Purdue University
Conference: iclr 2022 (main track)
Keywords: adversarial robustness;certified adversarial robustness;adversarial attacks;generative models;proxy distribution
Decision: Poster
Title: An Unconstrained Layer-Peeled Perspective on Neural Collapse
Authors: Wenlong Ji, Yiping Lu, Yiliang Zhang, Zhun Deng, Weijie J Su
Affiliations: Stanford University; Harvard University; Peking University; University of Pennsylvania
Conference: iclr 2022 (main track)
Keywords: neural collapse;uncostrained model;implicit regularization
Decision: Poster
Title: Scene Transformer: A unified architecture for predicting future trajectories of multiple agents
Authors: Jiquan Ngiam, Vijay Vasudevan, Benjamin Caine, Zhengdong Zhang, Hao-Tien (Lewis) Chiang, Jeffrey Ling, Rebecca Roelofs, Alex Bewley, Chenxi Liu, Ashish Venugopal, David Weiss, Ben Sapp, Zhifeng Chen, Jonathon Shlens
Affiliations: Waymo; Google Research, Brain Team
Conference: iclr 2022 (main track)
Keywords: trajectory prediction;motion forecasting;multi-task learning;attention;autonomous vehicles
Decision: Poster
Title: Model-augmented Prioritized Experience Replay
Authors: Youngmin Oh, Jinwoo Shin, Eunho Yang, Sung Ju Hwang
Affiliations: Korea Advanced Institute of Science and Technology, AITRICS; Korea Advanced Institute of Science and Technology; Samsung Advanced Institute of Technology
Conference: iclr 2022 (main track)
Keywords: RL;Reinforcement Learning;Replay Buffer
Decision: Poster
Title: Assessing Generalization of SGD via Disagreement
Authors: Yiding Jiang, Vaishnavh Nagarajan, Christina Baek, Zico Kolter
Affiliations: Carnegie Mellon University; Google Research
Conference: iclr 2022 (main track)
Keywords: Generalization;Deep Learning;Empirical Phenomenon;Accuracy Estimation;Stochastic Gradient Descent
Decision: Spotlight
Title: Expressivity of Emergent Languages is a Trade-off between Contextual Complexity and Unpredictability
Authors: Shangmin Guo, YI REN, Kory Mathewson, Simon Kirby, Stefano Albrecht, Kenny Smith
Affiliations: DeepMind; University of British Columbia; University of Edinburgh
Conference: iclr 2022 (main track)
Keywords: Emergent Language;Expressivity
Decision: Poster
Title: HyperDQN: A Randomized Exploration Method for Deep Reinforcement Learning
Authors: Ziniu Li, Yingru Li, Yushun Zhang, Tong Zhang, Zhi-Quan Luo
Affiliations: Hong Kong University of Science and Technology; Shenzhen Research Institute of Big Data, The Chinese University of Hong Kong, Shenzhen, China
Conference: iclr 2022 (main track)
Keywords: exploration;reinforcement learning
Decision: Poster
Title: Planning in Stochastic Environments with a Learned Model
Authors: Ioannis Antonoglou, Julian Schrittwieser, Sherjil Ozair, Thomas Hubert, David Silver
Affiliations: DeepMind, London, UK and University College London; DeepMind, London, UK
Conference: iclr 2022 (main track)
Keywords: model-based reinforcement learning;deep reinforcement learning;tree based search;MCTS
Decision: Spotlight
Title: Dealing with Non-Stationarity in MARL via Trust-Region Decomposition
Authors: Wenhao Li, Xiangfeng Wang, Bo Jin, Junjie Sheng, Hongyuan Zha
Affiliations: School of Computer Science and Technology, East China Normal University, Shanghai, China; School of Data Science, The Chinese University of Hong Kong (Shenzhen), Shenzhen Institute of Artiﬁcial Intelligence and Robotics for Society, Shenzhen, China
Conference: iclr 2022 (main track)
Keywords: Nonstationarity;Trust-Region Methods;Multi-Agent Reinforcement Learning
Decision: Poster
Title: Cross-Trajectory Representation Learning for Zero-Shot Generalization in RL
Authors: Bogdan Mazoure, Ahmed Ahmed, R Devon Hjelm, Andrey Kolobov, Patrick MacAlpine
Affiliations: Sony AIR; Université de Montréal, Quebec AI Institute, Microsoft Research; McGill University, Quebec AI Institute; Stanford University; Microsoft Research
Conference: iclr 2022 (main track)
Keywords: reinforcement learning;representation learning;self-supervised learning;procgen
Decision: Poster
Title: Contrastive Fine-grained Class Clustering via Generative Adversarial Networks
Authors: Yunji Kim, Jung-Woo Ha
Affiliations: NAVER AI Lab & NAVER CLOVA; NAVER AI Lab
Conference: iclr 2022 (main track)
Keywords: Unsupervised Fine-grained Class Clustering;Disentangled Representation Learning;Generative Adversarial Networks
Decision: Spotlight
Title: EE-Net: Exploitation-Exploration Neural Networks in Contextual Bandits
Authors: Yikun Ban, Yuchen Yan, Arindam Banerjee, Jingrui He
Affiliations: University of Illinois at Urbana-Champaign
Conference: iclr 2022 (main track)
Keywords: Contextual Bandits;Exploration Strategy;Neural Networks
Decision: Spotlight
Title: Predicting Physics in Mesh-reduced Space with Temporal Attention
Authors: XU HAN, Han Gao, Tobias Pfaff, Jian-Xun Wang, Liping Liu
Affiliations: University of Notre Dame; DeepMind; Tufts University
Conference: iclr 2022 (main track)
Keywords: fluid dynamics;graph neural network;attention neural network
Decision: Poster
Title: A Unified Contrastive Energy-based Model for Understanding the Generative Ability of Adversarial Training
Authors: Yifei Wang, Yisen Wang, Jiansheng Yang, Zhouchen Lin
Affiliations: Pazhou Lab, Guangzhou, 510330, China; School of Mathematical Sciences, Peking University; Key Lab. of Machine Perception (MoE), School of Artiﬁcial Intelligence, Peking University; Institute for Artiﬁcial Intelligence, Peking University
Conference: iclr 2022 (main track)
Keywords: Generative Models;Energy-based Models;Sampling;Adversarial Training
Decision: Poster
Title: An Agnostic Approach to Federated Learning with Class Imbalance
Authors: Zebang Shen, Juan Cervino, Hamed Hassani, Alejandro Ribeiro
Affiliations: Department of Electrical and Systems Engineering, University of Pennsylvania, Philadelphia, PA 19104, USA
Conference: iclr 2022 (main track)
Keywords: Federated Learning;Class Imbalance
Decision: Poster
Title: Coordination Among Neural Modules Through a Shared Global Workspace
Authors: Anirudh Goyal, Aniket Didolkar, Alex Lamb, Kartikeya Badola, Nan Rosemary Ke, Nasim Rahaman, Jonathan Binas, Charles Blundell, Michael Mozer, Yoshua Bengio
Affiliations: Microsoft Research, New York, NY; Mila, University of Montreal, Max Planck Institute Germany; Indian Institute of Technology, Delhi; Google Deepmind; Google Research, Brain Team; Mila, University of Montreal
Conference: iclr 2022 (main track)
Keywords: slot based recurrent architectures;attention;transformers;latent bottleneck.
Decision: Oral
Title: Pessimistic Bootstrapping for Uncertainty-Driven Offline Reinforcement Learning
Authors: Chenjia Bai, Lingxiao Wang, Zhuoran Yang, Zhihong Deng, Animesh Garg, Peng Liu, Zhaoran Wang
Affiliations: Princeton University; University of Technology Sydney; Northwestern University; University of Toronto, Vector Institute, NVIDIA; Harbin Institute of Technology
Conference: iclr 2022 (main track)
Keywords: Pessimistic Bootstrapping;Bootstrapped Q-functions;Uncertainty Estimation;Offline Reinforcement Learning
Decision: Spotlight
Title: Reinforcement Learning with Sparse Rewards using Guidance from Offline Demonstration
Authors: Desik Rengarajan, Gargi Vaidya, Akshay Sarvesh, Dileep Kalathil, Srinivas Shakkottai
Affiliations: Department of Electrical and Computer Engineering, Texas A&M University
Conference: iclr 2022 (main track)
Keywords: Reinforcement Learning;Sparse Rewards;Learning from Demonstrations
Decision: Spotlight
Title: A Relational Intervention Approach for Unsupervised Dynamics Generalization in Model-Based Reinforcement Learning
Authors: Jiaxian Guo, Mingming Gong, Dacheng Tao
Affiliations: The University of Melbourne; The University of Sydney; JD Explore Academy
Conference: iclr 2022 (main track)
Keywords: Model-Based Reinforcement Learning;Unsupervised Dynamics Generalization
Decision: Poster
Title: Scale Mixtures of Neural Network Gaussian Processes
Authors: Hyungi Lee, Eunggu Yun, Hongseok Yang, Juho Lee
Affiliations: AITRICS, Seoul, South Korea; Kim Jaechul Graduate School of AI, KAIST, South Korea; School of Computing, KAIST, South Korea
Conference: iclr 2022 (main track)
Keywords: Neural Network Gaussian Processes;Infinitely-wide Neural Networks;Scale Mixtures of Gaussians;Heavy-tailed Stochastic Processes
Decision: Poster
Title: Neural Structured Prediction for Inductive Node Classification
Authors: Meng Qu, Huiyu Cai, Jian Tang
Affiliations: Mila - Qu ´ebec AI Institute, Universit ´e de Montr ´eal; Mila - Qu ´ebec AI Institute, HEC Montr ´eal, Canadian Institute for Advanced Research (CIFAR)
Conference: iclr 2022 (main track)
Decision: Oral
Title: A Johnson-Lindenstrauss Framework for Randomly Initialized CNNs
Authors: Ido Nachum, Jan Hązła, Michael Gastpar, Anatoly Khina
Affiliations: School of Electrical Engineering, Tel Aviv University, Tel Aviv 6997801, Israel; School of Computer and Communication Sciences, École Polytechnique Fédérale de Lausanne, 1015 Lausanne, Switzerland
Conference: iclr 2022 (main track)
Keywords: convolutional neural networks;Johnson-Lindenstrauss lemma;initialization;isometry;theory.
Decision: Poster
Title: On the Convergence of Certified Robust Training with Interval Bound Propagation
Authors: Yihan Wang, Zhouxing Shi, Quanquan Gu, Cho-Jui Hsieh
Affiliations: University of California, Los Angeles
Conference: iclr 2022 (main track)
Keywords: Certified robustness;Adversarial robustness;Convergence
Decision: Poster
Title: Towards Building A Group-based Unsupervised Representation Disentanglement Framework
Authors: Tao Yang, Xuanchi Ren, Yuwang Wang, Wenjun Zeng, Nanning Zheng
Affiliations: Microsoft Research Asia; Xi’an Jiaotong University; EIT; HKUST
Conference: iclr 2022 (main track)
Keywords: Disentangled representation learning;Group theory;VAE
Decision: Poster
Title: How Low Can We Go: Trading Memory for Error in Low-Precision Training
Authors: Chengrun Yang, Ziyang Wu, Jerry Chee, Christopher De Sa, Madeleine Udell
Affiliations: Cornell University
Conference: iclr 2022 (main track)
Keywords: low-precision training;meta-learning;Pareto frontier;error-memory tradeoff;active learning;matrix factorization
Decision: Poster
Title: Learning Audio-Visual Speech Representation by Masked Multimodal Cluster Prediction
Authors: Bowen Shi, Wei-Ning Hsu, Kushal Lakhotia, Abdelrahman Mohamed
Affiliations: Meta AI; Toyota Technological Institute at Chicago
Conference: iclr 2022 (main track)
Keywords: audio-visual speech recognition;lip reading;speech recognition;self-supervised learning
Decision: Poster