Unfollow means you won't see their posts on your news feed. But they can see your posts on their timelines.