Backfill & Checkpoints on Discovery
Channel: NMSU_HPC
Date: 2021-07-28

Ever been caught up in situations where your jobs remain in the queue for so long waiting for resources to be allocated? In this 2-hour workshop, you will learn how to get your jobs to run on restricted idle nodes via the Backfill partition and how to add checkpoints to your codes, so as to save the current processed state of your program in the event your job gets kicked out from the Backfill partition.

0:00 Introduction
0:09 - Objectives
1:15 - Introduction to Backfill
2:23 - Purpose of Backfill
3:48 - Drawbacks of Backfill
6:52 - How to use Backfill
7:16 - Introduction to Checkpoint
8:30 - Purpose of Checkpoint
8:56 - Goals and Benefits of Checkpoint
10:56 - Example Python Script