One of the biggest challenges of building a quantum computer is maintaining coherence, which refers to the ability of qubits to maintain their quantum state over a period of time. Other challenges include controlling and measuring qubits, dealing with quantum noise and errors, and scaling up the technology to support more qubits.