use consistent function names
fix mysql error handling bugs
automatically add columns to idp and sp tables to store extra metadata
fix undefined metadata for category Unknown entities
prepare for inter-day aggregation: save metadata about processed chunks
add inter-day aggregation
be a bit more verbose in mysql errors
insert values by column name