HPCC-12588 Fix a spurious assert hit during compactRows

Also make compactRows return # of freed pages instead of boolean

Signed-off-by: Jake Smith <jake.smith@lexisnexis.com>