Even though you can have the physical silence and physical solitude, that doesn't mean you're going to be silent. If you have a mind that is unforgiving, if you have thoughts that are just racing on all the things you have to do all the time, that isn't silence.
Silence has to come from inside.
It really does. We create most of the noise within ourselves. Our minds are just constantly jumping all the time. Leave everything else be so that we can enter into this communion time with God. The Father has told us that He wants His house to be a house of prayer.