Caching annotations

First attempt at speeding this thing up