Not only in October but there are some free museums that you can visit all throughout the year including the British Museum, National Gallery, Museum of London and National History Museum.
Also Checkout: Things To Do This Weekend In London