In this task, you are given the abstract of a research paper. Your task is to generate a summary of this abstract. Your summary should not be very short, but it's better if it's not more than 30 words.

Input: Consider Input: We introduce an attention mechanism to improve feature extraction for deep active learning (AL) in the semi-supervised setting. The proposed attention mechanism is based on recent methods to visually explain predictions made by DNNs. We apply the proposed explanation-based attention to MNIST and SVHN classification. The conducted experiments show accuracy improvements for the original and class-imbalanced datasets with the same number of training examples and faster long-tail convergence compared to uncertainty-based methods.

Output: We introduce an attention mechanism to improve feature extraction for deep active learning (AL) in the semi-supervised setting.


Input: Consider Input: Most existing deep reinforcement learning (DRL) frameworks consider action spaces that are either
 discrete or continuous space. Motivated by the project of design Game AI for King of Glory
 (KOG), one the world’s most popular mobile game, we consider the scenario with the discrete-continuous
 hybrid action space. To directly apply existing DLR frameworks, existing approaches
 either approximate the hybrid space by a discrete set or relaxing it into a continuous set, which is
 usually less efficient and robust. In this paper, we propose a parametrized deep Q-network (P-DQN)
 for the hybrid action space without approximation or relaxation. Our algorithm combines DQN and
 DDPG and can be viewed as an extension of the DQN to hybrid actions. The empirical study on the
 game KOG validates the efficiency and effectiveness of our method.

Output: A DQN and DDPG hybrid algorithm is proposed to deal with the discrete-continuous hybrid action space.


Input: Consider Input: Careful tuning of the learning rate, or even schedules thereof, can be crucial to effective neural net training. There has been much recent interest in gradient-based meta-optimization, where one tunes hyperparameters, or even learns an optimizer, in order to minimize the expected loss when the training procedure is unrolled. But because the training procedure must be unrolled thousands of times, the meta-objective must be defined with an orders-of-magnitude shorter time horizon than is typical for neural net training. We show that such short-horizon meta-objectives cause a serious bias towards small step sizes, an effect we term short-horizon bias. We introduce a toy problem, a noisy quadratic cost function, on which we analyze short-horizon bias by deriving and comparing the optimal schedules for short and long time horizons. We then run meta-optimization experiments (both offline and online) on standard benchmark datasets, showing that meta-optimization chooses too small a learning rate by multiple orders of magnitude, even when run with a moderately long time horizon (100 steps) typical of work in the area. We believe short-horizon bias is a fundamental problem that needs to be addressed if meta-optimization is to scale to practical neural net training regimes.


Output: We investigate the bias in the short-horizon meta-optimization objective.