hunoutl/paperlists huggingface dataset:
Title: Benchmarks for Deep Off-Policy Evaluation
Authors: Justin Fu, Mohammad Norouzi, Ofir Nachum, George Tucker, ziyu wang, Alexander Novikov, Sherry Yang, Michael Zhang, Yutian Chen, Aviral Kumar, Cosmin Paduraru, Sergey Levine, Thomas Paine
Affiliations: DeepMind; Google Brain; UC Berkeley
Conference: iclr 2021 (main track)
Keywords: reinforcement learning;off-policy evaluation;benchmarks
Decision: Poster
Title: Augmenting Physical Models with Deep Networks for Complex Dynamics Forecasting
Authors: Yuan Yin, Vincent Le Guen, Jérémie DONA, Emmanuel d Bezenac, Ibrahim Ayed, Nicolas THOME, patrick gallinari
Affiliations: Conservatoire National des Arts et Métiers, CEDRIC, Paris, France; Sorbonne Université, CNRS, LIP6, Paris, France
Conference: iclr 2021 (main track)
Keywords: spatio-temporal forecasting;deep learning;physics;differential equations;hybrid systems
Decision: Oral
Title: Autoregressive Dynamics Models for Offline Policy Evaluation and Optimization
Authors: Michael Zhang, Thomas Paine, Ofir Nachum, Cosmin Paduraru, George Tucker, ziyu wang, Mohammad Norouzi
Affiliations: DeepMind; University of Toronto; Google Brain
Conference: iclr 2021 (main track)
Keywords: Off-policy policy evaluation;autoregressive models;offline reinforcement learning;policy optimization
Decision: Poster
Title: Towards Robustness Against Natural Language Word Substitutions
Authors: Xinshuai Dong, Anh Tuan Luu, Rongrong Ji, Hong Liu
Affiliations: Nanyang Technological University, Singapore; VinAI Research, Vietnam; Xiamen University, China; National Institute of Informatics, Japan; Nanyang Technological University, Singapore
Conference: iclr 2021 (main track)
Keywords: Natural Language Processing;Adversarial Defense
Decision: Spotlight
Title: Variational Information Bottleneck for Effective Low-Resource Fine-Tuning
Authors: Rabeeh Karimi Mahabadi, Yonatan Belinkov, James Henderson
Affiliations: Technion – Israel Institute of Technology; Idiap Research Institute, Switzerland; EPFL, Switzerland
Conference: iclr 2021 (main track)
Keywords: Transfer learning;NLP;large-scale pre-trained language models;over-fitting;robust;biases;variational information bottleneck
Decision: Poster
Title: GraPPa: Grammar-Augmented Pre-Training for Table Semantic Parsing
Authors: Tao Yu, Chien-Sheng Wu, Xi V Lin, bailin wang, Yi Tan, Xinyi Yang, Dragomir Radev, Richard Socher, Caiming Xiong
Affiliations: §Salesforce Research; †Yale University, §Salesforce Research; †Yale University; ‡University of Edinburgh
Conference: iclr 2021 (main track)
Keywords: text-to-sql;semantic parsing;pre-training;nlp
Decision: Poster
Title: Mixed-Features Vectors and Subspace Splitting
Authors: Alejandro Pimentel-Alarcón, Daniel L Pimentel-Alarcón
Affiliations: IIMAS, Universidad Nacional Autónoma de México, UNAM, Mexico City, Mexico; Department of Biostatistics, Wisconsin Institute for Discovery, UW-Madison, WI, 53715
Conference: iclr 2021 (main track)
Decision: Poster
Title: Combining Physics and Machine Learning for Network Flow Estimation
Authors: Arlei Lopes da Silva, Furkan Kocayusufoglu, Saber Jafarpour, Francesco Bullo, Ananthram Swami, Ambuj K Singh
Affiliations: Mechanical Engineering Department and the Center of Control, Dynamical Systems and Computation, UC Santa Barbara, CA 93106-5070, USA; U.S. Army Research Lab, Adelphi, MD 20783, USA; Computer Science Department, UC Santa Barbara, CA 93106-5110, USA
Conference: iclr 2021 (main track)
Keywords: graphs;networks;bilevel optimization;metalearning;flow graphs
Decision: Poster
Title: Intrinsic-Extrinsic Convolution and Pooling for Learning on 3D Protein Structures
Authors: Pedro Hermosilla Casajus, Marco Schäfer, Matej Lang, Gloria Fackelmann, Pere-Pau Vázquez, Barbora Kozlikova, Michael Krone, Tobias Ritschel, Timo Ropinski
Affiliations: Ulm University; Tübingen University; University of Catalonia; University College London; Masaryk University
Conference: iclr 2021 (main track)
Keywords: classification;bioinformatics
Decision: Poster
Title: A Hypergradient Approach to Robust Regression without Correspondence
Authors: Yujia Xie, Yixiu Mao, Simiao Zuo, Hongteng Xu, Xiaojing Ye, Tuo Zhao, Hongyuan Zha
Affiliations: School of Data Science, Shenzhen Institute of Artiﬁcial Intelligence and Robotics for Society, the Chinese University of Hong Kong, Shenzhen; Georgia Institute of Technology; Gaoling School of Artiﬁcial Intelligence, Renmin University of China, and Beijing Key Laboratory of Big Data Management and Analysis Methods; Georgia State University; Shanghai Jiao Tong University
Conference: iclr 2021 (main track)
Keywords: Regression without correspondence;differentiable programming;first-order optimization;Sinkhorn algorithm
Decision: Poster
Title: Taking Notes on the Fly Helps Language Pre-Training
Authors: Qiyu Wu, Chen Xing, Yatao Li, Guolin Ke, Di He, Tie-Yan Liu
Affiliations: College of Compute Science, Nankai University; Peking University; Microsoft Research
Conference: iclr 2021 (main track)
Keywords: Natural Language Processing;Pre-training
Decision: Poster
Title: Predicting Infectiousness for Proactive Contact Tracing
Authors: Yoshua Bengio, Prateek Gupta, Tegan Maharaj, Nasim Rahaman, Martin Weiss, Tristan Deleu, Eilif B Muller, Meng Qu, victor schmidt, Pierre-luc St-charles, hannah alsdurf, Olexa Bilaniuk, david buckeridge, Gaétan Marceau Caron, pierre carrier, Joumana Ghosn, satya gagne, Chris J Pal, Irina Rish, Bernhard Schoelkopf, abhinav sharma, Jian Tang, Andrew Williams
Affiliations: University of Oxford; École Polytechnique de Montreal; McGill University; HEC Montréal; University of Ottawa; Max-Planck Institute for Intelligent Systems Tübingen; Université de Montreal; Mila, Québec
Conference: iclr 2021 (main track)
Keywords: covid-19;contact tracing;distributed inference;set transformer;deepset;epidemiology;applications;domain randomization;retraining;simulation
Decision: Spotlight
Title: Unsupervised Discovery of 3D Physical Objects from Video
Authors: Yilun Du, Kevin A Smith, Tomer Ullman, Joshua B Tenenbaum, Jiajun Wu
Affiliations: Stanford University; Harvard University; MIT
Conference: iclr 2021 (main track)
Keywords: unsupervised object discovery;surprisal;scene decomposition;physical scene understanding
Decision: Poster
Title: Bayesian Few-Shot Classification with One-vs-Each Pólya-Gamma Augmented Gaussian Processes
Authors: Jake Snell, Richard Zemel
Affiliations: University of Toronto, Vector Institute, Canadian Institute for Advanced Research; University of Toronto, Vector Institute
Conference: iclr 2021 (main track)
Keywords: few-shot learning;gaussian processes;bayesian deep learning;uncertainty estimation
Decision: Poster
Title: Discovering Diverse Multi-Agent Strategic Behavior via Reward Randomization
Authors: Zhenggang Tang, Chao Yu, Boyuan Chen, Huazhe Xu, Xiaolong Wang, Fei Fang, Simon Du, Yu Wang, Yi Wu
Affiliations: University of Washington; CMU; Shanghai Qi Zhi Institute; Tsinghua University; UCSD; UC Berkeley
Conference: iclr 2021 (main track)
Keywords: strategic behavior;multi-agent reinforcement learning;reward randomization;diverse strategies
Decision: Poster
Title: Mind the Pad -- CNNs Can Develop Blind Spots
Authors: Bilal Alsallakh, Narine Kokhlikyan, Vivek Miglani, Jun Yuan, Orion Reblitz-Richardson
Affiliations: Facebook AI; NYU
Conference: iclr 2021 (main track)
Keywords: CNN;convolution;spatial bias;blind spots;foveation;padding;exposition;debugging;visualization
Decision: Spotlight
Title: Knowledge Distillation as Semiparametric Inference
Authors: Tri Dao, Govinda Kamath, Vasilis Syrgkanis, Lester Mackey
Affiliations: Department of Computer Science, Stanford University; Microsoft Research, New England
Conference: iclr 2021 (main track)
Keywords: knowledge distillation;semiparametric inference;generalization bounds;model compression;cross-fitting;orthogonal machine learning;loss correction
Decision: Poster
Title: Deep symbolic regression: Recovering mathematical expressions from data via risk-seeking policy gradients
Authors: Brenden Petersen, Mikel Landajuela Larma, Terrell N Mundhenk, Claudio Santiago, Soo Kim, Joanne Kim
Affiliations: Lawrence Livermore National Laboratory, Livermore, CA, USA
Conference: iclr 2021 (main track)
Keywords: symbolic regression;reinforcement learning;automated machine learning
Decision: Oral
Title: Heteroskedastic and Imbalanced Deep Learning with Adaptive Regularization
Authors: Kaidi Cao, Yining Chen, Junwei Lu, Nikos Arechiga, Adrien Gaidon, Tengyu Ma
Affiliations: Stanford University; Harvard University; Toyota Research Institute
Conference: iclr 2021 (main track)
Keywords: deep learning;noise robust learning;imbalanced learning
Decision: Poster
Title: Recurrent Independent Mechanisms
Authors: Anirudh Goyal, Alex Lamb, Jordan Hoffmann, Shagun Sodhani, Sergey Levine, Yoshua Bengio, Bernhard Schoelkopf
Affiliations: Mila, University of Montreal; Harvard University; MPI for Intelligent Systems, Tübingen; University of California, Berkeley
Conference: iclr 2021 (main track)
Keywords: modular representations;better generalization;learning mechanisms
Decision: Spotlight
Title: Predicting Inductive Biases of Pre-Trained Models
Authors: Charles Lovering, Rohan Jha, Tal Linzen, Ellie Pavlick
Affiliations: Brown University, Department of Computer Science; New York University, Department of Linguistics and Center for Data Science
Conference: iclr 2021 (main track)
Keywords: information-theoretical probing;probing;challenge sets;natural language processing
Decision: Poster
Title: Understanding and Improving Encoder Layer Fusion in Sequence-to-Sequence Learning
Authors: Xuebo Liu, Longyue Wang, Derek Wong, Liang Ding, Lidia Chao, Zhaopeng Tu
Affiliations: NLP2CT Lab, Department of Computer and Information Science, University of Macau; The University of Sydney; Tencent AI Lab
Conference: iclr 2021 (main track)
Keywords: Encoder layer fusion;Transformer;Sequence-to-sequence learning;Machine translation;Summarization;Grammatical error correction
Decision: Poster
Title: Adaptive Universal Generalized PageRank Graph Neural Network
Authors: Eli Chien, Jianhao Peng, Pan Li, Olgica Milenkovic
Affiliations: Department of Computer Science, Purdue University, USA; Department of Electrical and Computer Engineering, University of Illinois Urbana-Champaign, USA
Conference: iclr 2021 (main track)
Keywords: Graph Neural Networks;Generalized PageRank;Heterophily;Homophily;Over-smoothing
Decision: Poster
Title: Auxiliary Learning by Implicit Differentiation
Authors: Aviv Navon, Idan Achituve, Haggai Maron, Gal Chechik, Ethan Fetaya
Affiliations: Bar-Ilan University, Israel; NVIDIA, Israel; NVIDIA, Israel; Bar-Ilan University, Israel
Conference: iclr 2021 (main track)
Keywords: Auxiliary Learning;Multi-task Learning
Decision: Poster
Title: What Matters for On-Policy Deep Actor-Critic Methods? A Large-Scale Study
Authors: Marcin Andrychowicz, Anton Raichuk, Piotr Stanczyk, Manu Orsini, Sertan Girgin, Raphaël Marinier, Léonard Hussenot-Desenonges, Matthieu Geist, Olivier Pietquin, Marcin Michalski, Sylvain Gelly, Olivier Bachem
Affiliations: Google Research, Brain Team
Conference: iclr 2021 (main track)
Keywords: Reinforcement learning;continuous control
Decision: Oral
Title: Fast and Complete: Enabling Complete Neural Network Verification with Rapid and Massively Parallel Incomplete Verifiers
Authors: Kaidi Xu, Huan Zhang, Shiqi Wang, Yihan Wang, Suman Jana, Xue Lin, Cho-Jui Hsieh
Affiliations: Northeastern University; Columbia University; UCLA
Conference: iclr 2021 (main track)
Keywords: neural network verification;branch and bound
Decision: Poster
Title: On the Stability of Fine-tuning BERT: Misconceptions, Explanations, and Strong Baselines
Authors: Marius Mosbach, Maksym Andriushchenko, Dietrich Klakow
Affiliations: Spoken Language Systems (LSV), Saarland Informatics Campus, Saarland University; Theory of Machine Learning Lab, École polytechnique fédérale de Lausanne
Conference: iclr 2021 (main track)
Keywords: fine-tuning stability;transfer learning;pretrained language model;BERT
Decision: Poster
Title: Bidirectional Variational Inference for Non-Autoregressive Text-to-Speech
Authors: Yoonhyung Lee, Joongbo Shin, Kyomin Jung
Affiliations: Department of Electrical and Computer Engineering, Seoul National University, Seoul, South Korea
Conference: iclr 2021 (main track)
Keywords: text-to-speech;speech synthesis;non-autoregressive;VAE
Decision: Poster
Title: On Fast Adversarial Robustness Adaptation in Model-Agnostic Meta-Learning
Authors: Ren Wang, Kaidi Xu, Sijia Liu, Pin-Yu Chen, Tsui-Wei Weng, Chuang Gan, Meng Wang
Affiliations: Rensselaer Polytechnic Institute, USA; Northeastern University, USA; MIT-IBM Watson AI Lab, IBM Research, USA
Conference: iclr 2021 (main track)
Decision: Poster
Title: Overfitting for Fun and Profit: Instance-Adaptive Data Compression
Authors: Ties van Rozendaal, Iris Huijben, Taco Cohen
Affiliations: Qualcomm AI Research; Qualcomm AI Research, Department of Electrical Engineering, Eindhoven University of Technology
Conference: iclr 2021 (main track)
Keywords: Neural data compression;Learned compression;Generative modeling;Overfitting;Finetuning;Instance learning;Instance adaptation;Variational autoencoders;Rate-distortion optimization;Model compression;Weight quantization
Decision: Poster
Title: Wandering within a world: Online contextualized few-shot learning
Authors: Mengye Ren, Michael L Iuzzolino, Michael Mozer, Richard Zemel
Affiliations: University of Toronto, Vector Institute, CIFAR; Google Research, University of Colorado, Boulder; University of Toronto, Vector Institute
Conference: iclr 2021 (main track)
Keywords: Few-shot learning;continual learning;lifelong learning
Decision: Poster
Title: Self-Supervised Policy Adaptation during Deployment
Authors: Nicklas Hansen, Rishabh Jangir, Yu Sun, Guillem Alenyà, Pieter Abbeel, Alexei Efros, Lerrel Pinto, Xiaolong Wang
Affiliations: IRI, CSIC-UPC; UC San Diego; NYU; Technical University of Denmark; UC Berkeley
Conference: iclr 2021 (main track)
Keywords: reinforcement learning;robotics;self-supervised learning;generalization;sim2real
Decision: Spotlight
Title: Sample weighting as an explanation for mode collapse in generative adversarial networks
Conference: iclr 2021 (main track)
Keywords: GAN;generative adversarial networks;generative model;image synthesis;sample weighting;importance weighting;cost function;loss;mode collapse;mode dropping;coverage;divergence;FID;training dynamics;NS-GAN;MM-GAN;non-saturating;minimax
Decision: Reject
Title: On Position Embeddings in BERT
Authors: Wang Benyou, Lifeng Shang, Christina Lioma, Xin Jiang, Hao Yang, Qun Liu, Jakob Simonsen
Affiliations: University of Padova; Huawei Noah’s Ark Lab; Huawei Technologies Co., Ltd.; University of Copenhagen
Conference: iclr 2021 (main track)
Keywords: Position Embedding;BERT;pretrained language model.
Decision: Poster
Title: Model-based micro-data reinforcement learning: what are the crucial model properties and which model to choose?
Authors: Balázs Kégl, Gabriel Hurtado, Albert Thomas
Affiliations: Huawei Noah's Ark Lab, Paris, France
Conference: iclr 2021 (main track)
Keywords: model-based reinforcement learning;generative models;mixture density nets;dynamic systems;heteroscedasticity
Decision: Poster
Title: Learning Neural Generative Dynamics for Molecular Conformation Generation
Authors: Minkai Xu, Shitong Luo, Yoshua Bengio, Jian Peng, Jian Tang
Affiliations: University of Illinois at Urbana-Champaign, USA; Mila - Quebec AI Institute, Universite de Montreal, Canada; Peking University, China; Mila - Quebec AI Institute, Universite de Montreal, Canadian Institute for Advanced Research (CIFAR), Canada; Mila - Quebec AI Institute, Universite de Montreal, HEC Montreal, Canada
Conference: iclr 2021 (main track)
Keywords: Molecular conformation generation;deep generative models;continuous normalizing flow;energy-based models
Decision: Poster
Title: Sparse Quantized Spectral Clustering
Authors: Zhenyu Liao, Romain Couillet, Michael W Mahoney
Affiliations: ICSI and Department of Statistics, University of California, Berkeley, USA; G-STATS Data Science Chair, GIPSA-lab, University Grenobles-Alpes, France
Conference: iclr 2021 (main track)
Keywords: Eigenspectrum;high-dimensional statistic;random matrix theory;spectral clustering
Decision: Spotlight
Title: Explainable Subgraph Reasoning for Forecasting on Temporal Knowledge Graphs
Authors: Zhen Han, Peng Chen, Yunpu Ma, Volker Tresp
Affiliations: Corporate Technology, Siemens AG; Department of Informatics, Technical University of Munich; Institute of Informatics, LMU Munich; Institute of Informatics, LMU Munich; Corporate Technology, Siemens AG
Conference: iclr 2021 (main track)
Keywords: Temporal knowledge graph;future link prediction;graph neural network;subgraph reasoning.
Decision: Poster
Title: HyperDynamics: Meta-Learning Object and Agent Dynamics with Hypernetworks
Authors: Zhou Xian, Shamit Lal, Hsiao-Yu Tung, Anthony Platanios, Katerina Fragkiadaki
Affiliations: School of Computer Science, Carnegie Mellon University, Pittsburgh, PA 15213, USA
Conference: iclr 2021 (main track)
Decision: Poster
Title: FastSpeech 2: Fast and High-Quality End-to-End Text to Speech
Authors: Yi Ren, Chenxu Hu, Xu Tan, Tao Qin, Sheng Zhao, Zhou Zhao, Tie-Yan Liu
Affiliations: Microsoft Research Asia; Zhejiang University; Microsoft Azure Speech
Conference: iclr 2021 (main track)
Keywords: text to speech;speech synthesis;non-autoregressive generation;one-to-many mapping;end-to-end
Decision: Poster
Title: NeMo: Neural Mesh Models of Contrastive Features for Robust 3D Pose Estimation
Authors: Angtian Wang, Adam Kortylewski, Alan Yuille
Affiliations: Department of Computer Science, Johns Hopkins University, Maryland, MD 21218, USA
Conference: iclr 2021 (main track)
Keywords: Pose Estimation;Robust Deep Learning;Contrastive Learning;Render-and-Compare
Decision: Poster
Title: Batch Reinforcement Learning Through Continuation Method
Authors: Yijie Guo, Shengyu Feng, Nicolas Le Roux, Ed H. Chi, Honglak Lee, Minmin Chen
Affiliations: Google AI; University of Michigan, Google AI; University of Michigan
Conference: iclr 2021 (main track)
Keywords: batch reinforcement learning;continuation method;relaxed regularization
Decision: Poster
Title: Policy-Driven Attack: Learning to Query for Hard-label Black-box Adversarial Examples
Authors: Ziang Yan, Yiwen Guo, Jian Liang, Changshui Zhang
Affiliations: Alibaba Group; Institute for Artiﬁcial Intelligence, Tsinghua University (THUAI), Beijing National Research Center for Information Science and Technology (BNRist), Department of Automation, Tsinghua University, Beijing, P.R.China; ByteDance AI Lab
Conference: iclr 2021 (main track)
Keywords: hard-label attack;black-box attack;adversarial attack;reinforcement learning
Decision: Poster
Title: Conformation-Guided Molecular Representation with Hamiltonian Neural Networks
Authors: Ziyao Li, Shuwen Yang, Guojie Song, Lingsheng Cai
Affiliations: Key Laboratory of Machine Perception and Intelligence (MOE), Peking University, Beijing, China; Center for Data Science, Peking University, Beijing, China
Conference: iclr 2021 (main track)
Keywords: Molecular Representation;Neural Physics Engines;Molecular Dynamics;Graph Neural Networks
Decision: Poster
Title: Practical Real Time Recurrent Learning with a Sparse Approximation
Authors: Jacob Menick, Erich Elsen, Utku Evci, Simon Osindero, Karen Simonyan, Alex Graves
Affiliations: DeepMind, University College London; Google; DeepMind
Conference: iclr 2021 (main track)
Keywords: recurrent neural networks;backpropagation;biologically plausible;forward mode;real time recurrent learning;rtrl;bptt
Decision: Spotlight
Title: Neural Mechanics: Symmetry and Broken Conservation Laws in Deep Learning Dynamics
Authors: Daniel Kunin, Javier Sagastuy-Brena, Surya Ganguli, Daniel L Yamins, Hidenori Tanaka
Affiliations: Stanford University; Physics & Informatics Laboratories, NTT Research, Inc.
Conference: iclr 2021 (main track)
Keywords: learning dynamics;symmetry;loss landscape;stochastic differential equation;modified equation analysis;conservation law;hessian;geometry;physics;gradient flow
Decision: Poster
Title: Long Range Arena : A Benchmark for Efficient Transformers
Authors: Yi Tay, Mostafa Dehghani, Samira Abnar, Yikang Shen, Dara Bahri, Philip Pham, Jinfeng Rao, Liu Yang, Sebastian Ruder, Donald Metzler
Affiliations: Google DeepMind; Google Research
Conference: iclr 2021 (main track)
Keywords: Transformers;Attention;Deep Learning
Decision: Poster
Title: Differentiable Trust Region Layers for Deep Reinforcement Learning
Authors: Fabian Otto, Philipp Becker, Vien A Ngo, Hanna Ziesche, Gerhard Neumann
Affiliations: Bosch Center for Artiﬁcial Intelligence, University of Tübingen; Bosch Center for Artiﬁcial Intelligence; Karlsruhe Institute of Technology
Conference: iclr 2021 (main track)
Keywords: reinforcement learning;trust region;policy gradient;projection;Wasserstein distance;Kullback-Leibler divergence;Frobenius norm
Decision: Poster
Title: The Traveling Observer Model: Multi-task Learning Through Spatial Variable Embeddings
Authors: Elliot Meyerson, Risto Miikkulainen
Affiliations: Cognizant AI Labs; UT Austin & Cognizant AI Labs
Conference: iclr 2021 (main track)
Keywords: Multi-task;Many-task;Multi-domain;Cross-domain;Variable Embeddings;Task Embeddings;Tabular;Analogies
Decision: Spotlight
Title: The role of Disentanglement in Generalisation
Authors: Milton Montero, Casimir JH Ludwig, Rui Ponte Costa, Gaurav Malhotra, Jeffrey Bowers
Affiliations: Computational Neuroscience Unit, Department of Computer Science, University of Bristol, Bristol, United Kingdom; School of Psychological Science, University of Bristol, Bristol, United Kingdom; School of Psychological Science and Computational Neuroscience Unit, Department of Computer Science, University of Bristol, Bristol, United Kingdom
Conference: iclr 2021 (main track)
Keywords: disentanglement;compositionality;compositional generalization;generalisation;generative models;variational autoencoders
Decision: Poster
Title: Contrastive Behavioral Similarity Embeddings for Generalization in Reinforcement Learning
Authors: Rishabh Agarwal, Marlos C. Machado, Pablo Samuel Castro, Marc G Bellemare
Affiliations: Google Research, Brain Team; Now at DeepMind; Google Research, Brain Team; Also at Mila, Université de Montréal; Google Research, Brain Team
Conference: iclr 2021 (main track)
Keywords: Reinforcement;Generalization;Contrastive learning;Bisimulation;Representation Learning
Decision: Spotlight
Title: Repurposing Pretrained Models for Robust Out-of-domain Few-Shot Learning
Authors: Namyeong Kwon, Hwidong Na, Gabriel Huang, Simon Lacoste-Julien
Affiliations: Mila, Universit ´e de Montr ´eal, SAIT AI Lab, Montreal; Mila, Universit ´e de Montr ´eal; Samsung Advanced Institute of Technology (SAIT), South Korea
Conference: iclr 2021 (main track)
Keywords: Meta-learning;Few-shot learning;Out-of-domain;Uncertainty;Ensemble;Adversarial training;Stepsize optimization
Decision: Poster
Title: GShard: Scaling Giant Models with Conditional Computation and Automatic Sharding
Authors: Dmitry Lepikhin, HyoukJoong Lee, Yuanzhong Xu, Dehao Chen, Orhan Firat, Yanping Huang, Maxim Krikun, Noam Shazeer, Zhifeng Chen
Affiliations: Google
Conference: iclr 2021 (main track)
Decision: Poster
Title: Sharper Generalization Bounds for Learning with Gradient-dominated Objective Functions
Authors: Yunwen Lei, Yiming Ying
Affiliations: Department of Mathematics and Statistics, State University of New York at Albany, USA; School of Computer Science, University of Birmingham, Birmingham B15 2TT, United Kingdom; Department of Computer Science, TU Kaiserslautern, Kaiserslautern 67653, Germany
Conference: iclr 2021 (main track)
Keywords: generalization bounds;non-convex learning
Decision: Poster
Title: Learning to Reach Goals via Iterated Supervised Learning
Authors: Dibya Ghosh, Abhishek Gupta, Ashwin D Reddy, Justin Fu, Coline M Devin, Benjamin Eysenbach, Sergey Levine
Affiliations: Carnegie Mellon University; UC Berkeley
Conference: iclr 2021 (main track)
Keywords: goal reaching;reinforcement learning;behavior cloning;goal-conditioned RL
Decision: Oral