Fix a newly introduced issue where the listview would be expanded even when it shouldn't because it was already on its full size