You should remove snow from your roof when it's 6" to 12" thick. When a layer of snow 2' to 4' thick builds up on your roof, then the extra weight of it makes the roof collapse.
The roof will start sagging, leaking, and showing cracks in the plaster or drywall when it has too much snow on it.