A Power Supply is a dedicated unit, usually inside of a desktop PC, that provides power to everything else inside the PC.
Things like All-In-One PCs and monitors may also have external power supplies, which are usually just regular old power bricks that need to be plugged into the wall.