Specify castle as just O-O and O-O-O and let board figure out the correct side based on turn order.