Because it drives you away from your site. When you click through the debug toolbar this links sends you to a dead end page. But we could move the button on the configuration view up. A modal with the phpinfo() contents would be nice here, btw.

And IMO it's also more intuitive to have just one destination for the links in the toolbar, it's way easier to recognize how the toolbar is connected to the views.