The smallest unit of data in a computer is a binary digit, commonly known as a "bit." A bit can have a value of either 0 or 1, representing the most basic form of data in computing.