A utility-based agent evaluates actions based on a utility function, which assigns numerical values to potential outcomes, allowing the agent to select actions that maximize its overall utility.