Originally, White cowboys were called cowhands, and African Americans were pejoratively referred to as “cowboys.” African American men being called “boy” regardless of their age stems from slavery and the plantation era in the South.