Remove the viewport notion again and use the one SDL set for us