Number four seed Williams , who won doubles gold with her sister Venus at the Sydney Games but missed Athens four years ago through injury , went down 6-3 , 4-6 , 3-6 to this year 's Wimbledon semi-finalist .