Added a TODO for the regression spotted by @yalisassoon
Updated with TODOs
Some updates
Scala Common Enrich: fixed issue where unset double fields throw an NPE (fixes #1062)
Scala Common Enrich: added tests for ConversionUtils.stringToJInteger (closes #1064)
Scala Common Enrich: fixed issue where unset integer fields throw an NPE (fixes #570)
Scala Common Enrich: now enforcing Java 7 for compilation (closes #1065)
Scala Hadoop Enrich: now enforcing Java 7 for compilation (closes #1066)
Scala Hadoop Enrich: update test jobs to reflect updated useragent parsing (fixes #1070)
Updated test to include a querystring-based &ua= override
Scala Hadoop Enrich: added test for empty integer and double fields to ensure no NPE thrown (#1063)
@yalisassoon - I've added the test and improved the null handling for integers and doubles (see previous commits). The odd thing is that the improved null handling seems somehow orthogonal to this test case. You can see from the validation errors that both of the missing fields were processed as empty strings, not nulls. It's odd. I think something must have changed between Hadoop 0.6.0 and 0.8.0 (this release) to prevent the NPE issues. I have done some deep digging and can't figure out what, but it looks like the problem is gone. Software huh?
EmrEtlRunner: fixed bug where --process-enrich doesn't work, thanks @kingo55! (fixes #1089)
Scala Common Enrich: added Adapter to pre-process AD-X Tracking events (closes #1060)
Redshift: added Redshift DDL for AD-X Tracking's app_install (closes #1037)
StorageLoader: wrote JSON Path file for AD-X Tracking's app_install (closes #1038)
Bumped Scala Common Enrich to 0.8.0-M1