Add constraints only after backfilling existing data.
[#82406674] https://www.pivotaltracker.com/story/show/82406674

Signed-off-by: Madhura Bhave <mbhave@pivotal.io>