The first 30 you collect are used towards unlocking Desmond Memories on Animus Island. Once 50 Animus Data Fragments are found the remaining 50 appear on your map. Finding all 100 of them earn you the Capped trophy/achievement.