Package: awesome-autodl
Awesome AutoDLA curated list of automated deep learning related resources. Inspired byawesome-deep-vision,awesome-adversarial-machine-learning,awesome-deep-learning-papers, andawesome-architecture-search.Please feel free topull requestsoropen an issueto add papers.Table of ContentsAwesome BlogsAwesome AutoDL LibraiesAwesome BenchmarksDeep Learning-based NAS and HPO2021 Venues2020 Venues2019 Venues2018 Venues2017 VenuesPrevious VenuesarXivAwesome SurveysAwesome BlogsAutoML infoandAutoML Freiburg-HannoverWhat’s the deal with Neural Architecture Search?Google Could AutoMLandPocketFlowAutoML ChallengeandAutoDL ChallengeIn Defense of Weight-sharing for Neural Architecture Search: an optimization perspectiveAwesome AutoDL LibraiesPyGloveNASLibKeras TunerNNIAutoGluonAuto-PyTorchAutoDL-Projectsaw_nasDeterminedTPOTAwesome BenchmarksTitleVenueCodeNAS-Bench-101: Towards Reproducible Neural Architecture SearchICML 2019GitHubNAS-Bench-201: Extending the Scope of Reproducible Neural Architecture SearchICLR 2020GithubNAS-Bench-301 and the Case for Surrogate Benchmarks for Neural Architecture SearcharXiv 2020GitHubNAS-Bench-1Shot1: Benchmarking and Dissecting One-shot Neural Architecture SearchICLR 2020GitHubNATS-Bench: Benchmarking NAS Algorithms for Architecture Topology and SizeTPAMI 2021GitHubNAS-Bench-ASR: Reproducible Neural Architecture Search for Speech RecognitionICLR 2021-HW-NAS-Bench: Hardware-Aware Neural Architecture Search BenchmarkICLR 2021GitHubNAS-Bench-NLP: Neural Architecture Search Benchmark for Natural Language ProcessingarXiv 2020GitHubNAS-Bench-x11 and the Power of Learning CurvesNeurIPS 2021GitHubDeep Learning-based NAS and HPOTypeGRLEAPDOtherExplanationgradient-basedreinforcement learningevolutionary algorithmperformance predictionother types2021 VenuesTitleVenueTypeCodeCATE: Computation-aware Neural Architecture Encoding with TransformersICMLOGitHubSearching by Generating: Flexible and Efficient One-Shot NAS with Architecture GeneratorCVPRGGithubZen-NAS: A Zero-Shot NAS for High-Performance Deep Image RecognitionICCVEAGithubAutoFormer: Searching Transformers for Visual RecognitionICCVEAGitHubLightTrack: Finding Lightweight Neural Networks for Object Tracking via One-Shot Architecture SearchCVPREAGitHubOne-Shot Neural Ensemble Architecture Search by Diversity-Guided Search Space ShrinkingCVPREAGitHubDARTS-: Robustly Stepping out of Performance Collapse Without IndicatorsICLRGGitHubZero-Cost Proxies for Lightweight NASICLROGitHubNeural Architecture Search on ImageNet in Four GPU Hours: A Theoretically Inspired PerspectiveICLR-GitHubDrNAS: Dirichlet Neural Architecture SearchICLRGGitHubRethinking Architecture Selection in Differentiable NASICLROGitHubEvolving Reinforcement Learning AlgorithmsICLREAGitHubAutoHAS: Differentiable Hyper-parameter and Architecture SearchICLR-WG-FBNetV3: Joint Architecture-Recipe Search using Neural Acquisition FunctionCVPRPDgithub2020 VenuesTitleVenueTypeCodeCream of the Crop: Distilling Prioritized Paths For One-Shot Neural Architecture SearchNeurIPS-GitHubPyGlove: Symbolic Programming for Automated Machine LearningNeurIPSlibrary-Does Unsupervised Architecture Representation Learning Help Neural Architecture SearchNeurIPSPDGitHubRandAugment: Practical Automated Data Augmentation with a Reduced Search SpaceNeurIPSGitHubDelta-STN: Efficient Bilevel Optimization for Neural Networks using Structured Response JacobiansNeurIPSGGitHubA Study on Encodings for Neural Architecture SearchNeurIPSGitHubAutoBSS: An Efficient Algorithm for Block Stacking Style SearchNeurIPSBridging the Gap between Sample-based and One-shot Neural Architecture Search with BONASNeurIPSGGitHubInterstellar: Searching Recurrent Architecture for Knowledge Graph EmbeddingNeurIPSRevisiting Parameter Sharing for Automatic Neural Channel Number SearchNeurIPSLearning Search Space Partition for Black-box Optimization using Monte Carlo Tree SearchNeurIPSMCTSGitHubNeural Architecture Search using Deep Neural Networks and Monte Carlo Tree SearchAAAIMCTSGitHubRepresentation Sharing for Fast Object Detector Search and BeyondECCVGGitHubAre Labels Necessary for Neural Architecture Search?ECCVG-Single Path One-Shot Neural Architecture Search with Uniform SamplingECCVEA-Neural Predictor for Neural Architecture SearchECCVO-BigNAS: Scaling Up Neural Architecture Search with Big Single-Stage ModelsECCVG-BATS: Binary ArchitecTure SearchECCV--AttentionNAS: Spatiotemporal Attention Cell Search for Video ClassificationECCV--Search What You Want: Barrier Panelty NAS for Mixed Precision QuantizationECCV--Angle-based Search Space Shrinking for Neural Architecture SearchECCV--Anti-Bandit Neural Architecture Search for Model DefenseECCV--TF-NAS: Rethinking Three Search Freedoms of Latency-Constrained Differentiable Neural Architecture SearchECCVGGitHubFair DARTS: Eliminating Unfair Advantages in Differentiable Architecture SearchECCVGGitHubOff-Policy Reinforcement Learning for Efficient and Effective GAN Architecture SearchECCVRL-DA-NAS: Data Adapted Pruning for Efficient Neural Architecture SearchECCVG-Optimizing Millions of Hyperparameters by Implicit DifferentiationAISTATSG-Evolving Machine Learning Algorithms From ScratchICMLEA-Stabilizing Differentiable Architecture Search via Perturbation-based RegularizationICMLGGitHubNADS: Neural Architecture Distribution Search for Uncertainty AwarenessICML--Generative Teaching Networks: Accelerating Neural Architecture Search by Learning to Generate Synthetic Training DataICML--Neural Architecture Search in a Proxy Validation Loss LandscapeICML--Hit-Detector: Hierarchical Trinity Architecture Search for Object DetectionCVPR-GitHubDesigning Network Design SpacesCVPR-GitHubUNAS: Differentiable Architecture Search Meets Reinforcement LearningCVPRG/RLGitHubMiLeNAS: Efficient Neural Architecture Search via Mixed-Level ReformulationCVPRGGitHubA Semi-Supervised Assessor of Neural ArchitecturesCVPRPD-Binarizing MobileNet via Evolution-based SearchingCVPREA-Rethinking Performance Estimation in Neural Architecture SearchCVPR-GitHubAPQ: Joint Search for Network Architecture, Pruning and Quantization PolicyCVPRGGitHubSGAS: Sequential Greedy Architecture SearchCVPRGGithubCan Weight Sharing Outperform Random Architecture Search? An Investigation With TuNASCVPRRL-FBNetV2: Differentiable Neural Architecture Search for Spatial and Channel DimensionsCVPRGGithubAdversarialNAS: Adversarial Neural Architecture Search for GANsCVPRGGithubWhen NAS Meets Robustness: In Search of Robust Architectures against Adversarial AttacksCVPRGGithubBlock-wisely Supervised Neural Architecture Search with Knowledge DistillationCVPRGGithubOvercoming Multi-Model Forgetting in One-Shot NAS with Diversity MaximizationCVPRGGithubDensely Connected Search Space for More Flexible Neural Architecture SearchCVPRGGithubEfficientDet: Scalable and Efficient Object DetectionCVPRRL-NAS-BENCH-201: Extending the Scope of Reproducible Neural Architecture SearchICLR-GithubUnderstanding Architectures Learnt by Cell-based Neural Architecture SearchICLRGGitHubEvaluating The Search Phase of Neural Architecture SearchICLR-AtomNAS: Fine-Grained End-to-End Neural Architecture SearchICLRGitHubFast Neural Network Adaptation via Parameter Remapping and Architecture SearchICLR-GitHubOnce for All: Train One Network and Specialize it for Efficient DeploymentICLRGGitHubEfficient Transformer for Mobile ApplicationsICLR--PC-DARTS: Partial Channel Connections for Memory-Efficient Architecture SearchICLRGGitHubAdversarial AutoAugmentICLR--NAS evaluation is frustratingly hardICLR-GitHubFasterSeg: Searching for Faster Real-time Semantic SegmentationICLRGGitHubComputation Reallocation for Object DetectionICLR--Towards Fast Adaptation of Neural Architectures with Meta LearningICLR-GitHubAssembleNet: Searching for Multi-Stream Neural Connectivity in Video ArchitecturesICLREA-How to Own the NAS in Your Spare TimeICLR--Fast, Accurate and Lightweight Super-Resolution with Neural Architecture SearchICPRGgithub2019 VenuesTitleVenueTypeCodeSelf-Tuning Networks: Bilevel Optimization of Hyperparameters using Structured Best-Response FunctionsICLR--DATA: Differentiable ArchiTecture ApproximationNeurIPS--Random Search and Reproducibility for Neural Architecture SearchUAIGGitHubImproved Differentiable Architecture Search for Language Modeling and Named Entity RecognitionEMNLPG-Continual and Multi-Task Architecture SearchACLRL-Progressive Differentiable Architecture Search: Bridging the Depth Gap Between Search and EvaluationICCVGGitHubMultinomial Distribution Learning for Effective Neural Architecture SearchICCV-GitHubSearching for MobileNetV3ICCVEA-Multinomial Distribution Learning for Effective Neural Architecture SearchICCV-GitHubFast and Practical Neural Architecture SearchICCVTeacher Guided Architecture SearchICCV-AutoDispNet: Improving Disparity Estimation With AutoMLICCVG-Resource Constrained Neural Network Architecture Search: Will a Submodularity Assumption Help?ICCVEA-One-Shot Neural Architecture Search via Self-Evaluated Template NetworkICCVGGithubEvolving Space-Time Neural Architectures for VideosICCVEAGitHubAutoGAN: Neural Architecture Search for Generative Adversarial NetworksICCVRLgithubDiscovering Neural WiringsNeurIPSGGithubTowards modular and programmable architecture searchNeurIPSOtherGithubNetwork Pruning via Transformable Architecture SearchNeurIPSGGithubDeep Active Learning with a NeuralArchitecture SearchNeurIPS--DetNAS: Backbone Search for Object DetectionNeurIPSEAGitHubSpArSe: Sparse Architecture Search for CNNs on Resource-Constrained MicrocontrollersNeurIPS--Efficient Forward Architecture SearchNeurIPSGGithubEfficient Neural ArchitectureTransformation Search in Channel-Level for Object DetectionNeurIPSG-XNAS: Neural Architecture Search with Expert AdviceNeurIPSGGitHubDARTS: Differentiable Architecture SearchICLRGgithubProxylessNAS: Direct Neural Architecture Search on Target Task and HardwareICLRRL/GgithubGraph HyperNetworks for Neural Architecture SearchICLRG-Learnable Embedding Space for Efficient Neural Architecture CompressionICLROthergithubEfficient Multi-Objective Neural Architecture Search via Lamarckian EvolutionICLREA-SNAS: stochastic neural architecture searchICLRG-NetTailor: Tuning the Architecture, Not Just the WeightsCVPRGGithubSearching for A Robust Neural Architecture in Four GPU HoursCVPRGGithubChamNet: Towards Efficient Network Design through Platform-Aware Model AdaptationCVPR--Partial Order Pruning: for Best Speed/Accuracy Trade-off in Neural Architecture SearchCVPREAgithubFBNet: Hardware-Aware Efficient ConvNet Design via Differentiable Neural Architecture SearchCVPRG-RENAS: Reinforced Evolutionary Neural Architecture SearchCVPRG-Auto-DeepLab: Hierarchical Neural Architecture Search for Semantic Image SegmentationCVPRGGitHubMnasNet: Platform-Aware Neural Architecture Search for MobileCVPRRLGithubMFAS: Multimodal Fusion Architecture SearchCVPREA-A Neurobiological Evaluation Metric for Neural Network Model SearchCVPROther-Fast Neural Architecture Search of Compact Semantic Segmentation Models via Auxiliary CellsCVPRRL-Customizable Architecture Search for Semantic SegmentationCVPR--Regularized Evolution for Image Classifier Architecture SearchAAAIEA-AutoAugment: Learning Augmentation Policies from DataCVPRRL-Population Based Augmentation: Efficient Learning of Augmentation Policy SchedulesICMLEA-The Evolved TransformerICMLEAGithubEfficientNet: Rethinking Model Scaling for Convolutional Neural NetworksICMLRL-NAS-Bench-101: Towards Reproducible Neural Architecture SearchICMLOtherGithubOn Network Design Spaces for Visual RecognitionICCVGGithub2018 VenuesTitleVenueTypeCodeTowards Automatically-Tuned Deep Neural NetworksBOOK-GitHubNetAdapt: Platform-Aware Neural Network Adaptation for Mobile ApplicationsECCV-githubEfficient Architecture Search by Network TransformationAAAIRLgithubLearning Transferable Architectures for Scalable Image RecognitionCVPRRLgithubN2N learning: Network to Network Compression via Policy Gradient Reinforcement LearningICLRRL-A Flexible Approach to Automated RNN Architecture GenerationICLRRL/PD-Practical Block-wise Neural Network Architecture GenerationCVPRRL-Path-Level Network Transformation for Efficient Architecture SearchICMLRLgithubHierarchical Representations for Efficient Architecture SearchICLREA-Understanding and Simplifying One-Shot Architecture SearchICMLG-SMASH: One-Shot Model Architecture Search through HyperNetworksICLRGgithubNeural Architecture OptimizationNeurIPSGgithubSearching for efficient multi-scale architectures for dense image predictionNeurIPSOther-Progressive Neural Architecture SearchECCVPDgithubNeural Architecture Search with Bayesian Optimisation and Optimal TransportNeurIPSOthergithubDifferentiable Neural Network Architecture SearchICLR-WG-Accelerating Neural Architecture Search using Performance PredictionICLR-WPD-2017 VenuesTitleVenueTypeCodeNeural Architecture Search with Reinforcement LearningICLRRL-Designing Neural Network Architectures using Reinforcement LearningICLRRL-Neural Optimizer Search with Reinforcement LearningICMLRL-Learning Curve Prediction with Bayesian Neural NetworksICLRPD-Hyperband: A Novel Bandit-Based Approach to Hyperparameter OptimizationICLRPD-Hyperparameter Optimization: A Spectral ApproachNeurIPS-WOthergithubLearning to Compose Domain-Specific Transformations for Data AugmentationNeurIPS--Previous Venues2012-2016TitleVenueTypeCodeSpeeding up Automatic Hyperparameter Optimization of Deep Neural Networksby Extrapolation of Learning CurvesIJCAIPDgithubarXivTitleDateTypeCodeNSGA-NET: A Multi-Objective Genetic Algorithm for Neural Architecture Search2018.10EA-Training Frankenstein’s Creature to Stack: HyperTree Architecture Search2018.10G-Population Based Training of Neural Networks2017.11EAGitHubAwesome SurveysTitleVenueYearCodeA Comprehensive Survey of Neural Architecture Search: Challenges and SolutionsACM Computing Surveys2021-Automated Machine Learning on Graphs: A SurveyICLR-W2021GitHubOn Hyperparameter Optimization of Machine Learning Algorithms: Theory and PracticeNeurocomputing2020githubAutonoML: Towards an Integrated Framework for Autonomous Machine LearningarXiv2020-Automated Machine LearningSpringer Book2019-Neural architecture search: A surveyJMLR2019-AutoML: A Survey of the State-of-the-ArtarXiv2019GitHubA Survey on Neural Architecture SearcharXiv2019-Taking human out of learning applications: A survey on automated machine learningarXiv2018-