If you make only a single side trip from Madrid, the legendary city of Toledo, home to El Greco and a Middle Ages melting pot of diverse cultures, should be the one.
Toledo is a place that needs to be seen.