fixed various issues with data / date sorting and reliability. still slow, needs caching.