The plasma membrane, nucleus, and mitochondria are the cell organelles that have clear-cut double-membrane structures.