Difficulty retracting the foreskin of an uncircumcised penis is the characteristic sign of phimosis.