The places you spend the money are also taxed. That cost is pasted to you. The cost is passed to them and to you. Paying for roads with a gas tax is the right idea but they fall short. There are so many subsidies that everyone is helped by many and hurt by many.
Subsidies disguise the true cost of the things they affect.
It is deplorable to use tax money to support the arts, city beautification projects in nice areas, scientific curiosity such as astronomy or anthropology. This is robbing from the poor to give to the rich. It is justified in that the rich pay more tax. The system balances one wrong with another. Like evolution, the social mind does not have perspective to redesign, only to patch.