The agile point system is a method for estimating the effort involved in tasks or user stories by assigning points. These points reflect the relative difficulty or size of the work rather than specific timeframes, allowing for more flexible planning.