Use separate sequences for different frame rates. Or interpret all the footage to a common rate. Just be careful when interpreting higher rates downward, as you may lose frames.