question: Where is EarlyStopping searching for metrics?
context: Where is EarlyStopping search for metrics?
  Code
      def validation_end(self, outputs):
          ...
          metrics = {
          'val_acc': val_acc,
          'val_loss': val_loss
          }
          ...
          output = OrderedDict({
              'val_acc':  torch.tensor(metrics['val_acc']),
              'val_loss': torch.tensor(metrics['val_loss']),
              'progress_bar': metrics,
              'log': metrics
          })
          return output
  
  if I attempt to early stop according to val_acc I get the following error:
  RuntimeWarning: Early stopping conditioned on metric 'val_acc' which is not available. Available metrics are: loss,train_loss
  
  The metrics mentioned (loss,train_loss) are from training_step from what I could find.
  I guess I'm doing something wrong, could anyone point me in the correct direction?
  
  OS: Ubuntu
  Packaging: pip
  Version 0.5.3.2
  
  
  Update #1: the same code works with version 0.5.1. Bug in 0.5.3?
  Update #2:
  I found that this line in trainer/training_loop.py:
  self.callback_metrics = {k: v for d in all_callback_metrics for k, v in d.items()}
  
  From what I see, before this line is executed, self.callback_metrics contains val_acc. After this line values that were put in callback_metrics after validation are gone, therefore EarlyStopping can't find them. Can anyone confirm this is an issue?
answer: If I understand correctly it is a known issue. Please look at #490. #492 fixes this in master.