Some can read with quiet music playing, others have no problems sitting on a park bench next to a noisy playground while others are only comfortable reading in a quiet, peaceful library. You should realise that you can read different types of material at different speeds and still be reading both efficiently. Your biology textbook may slow you down a lot more than the suspense novel you got out of the library. New concepts and technical detail will take more time for your mind to absorb than will easy vocabulary and a familiar subject. You can get rid of your distractions if you are really willing to read the text.
Some people have the bad habit of reading aloud silently.
To find out if you are one of these, put your finger on your lips while you read. If you feel your lips moving, you are subconsciously sounding out every word you read. Since we all talk slower than we read, this will always slow you down. Always try to read silently in your mind. This will help you to read faster and concentrate better.