aodn/harvesters — pull request #113 by xhoenner (2014-11-14 00:27:12+00:00)
Title: SOOP_XBT_NRT csv harvest

Updated SOOP_XBT_NRT harvester to index csv files created by @pmbohm with his python script, which removes its previous dependency to the legacy_soop schema.

Schema needs to be dropped, data bags need to be updated. SourceDir should be (@smancini and @pmbohm to confirm): 10-nsp-mel.emii.org.au:/mnt/imos-t4/IMOS/public/SOOP/XBT/realtime.

@smancini in the legacy_soop schema there's quite a bit of data for 2010, whereas in public the earliest real-time profile is on 05/10/2011. Any idea why there's such a discrepancy (e.g. have some files been deleted?)?

@smancini you're going to have to update the online inventory for `soop_xbt_realtime_manual` as the latest end_date is 26/08/2013 as this harvester still relies on the content of that table.

@pmbohm your script to populate the legacy_soop schema is now obsolete.