add single TSV of massgis parcels' assess.dbf, including LOC_ID which has lat/lon


Former-commit-id: 0f1262ac019ada4563d27156e8f72c74b92bc470
add assess.csv style town id and plaid english name of town to massgis_urls.csv


Former-commit-id: 31b9806e34920a16f2a4a1da1231af4d586434b6
expand readme


Former-commit-id: 671718f93cb464d02b063a2127126384154a1486
remove records that do not what town info, address street name, or address number


Former-commit-id: 2586e250114fe4a521cf0303832d3067fbf5e86d
note that some lat lon might be mass islands rather than mass mainland


Former-commit-id: a43ec6f82087e6b9e0946e74be43700b31ac9753
use LOC_ID to get lon and lat in meters state plane.
had to multiply when LOC_ID started with 'F_' which stands for US survey feet.

$ cat assess.csv | sed '1d' | tawk '{OFS="\t";x=$1;if(x ~ /^F/)gsub(/^F_/,"",x)split(x,f,"_");if(x ~ /^M/)gsub(/^M_/,"",x)split(x,m,"_");if($1 ~ /^F/)print f[1]*0.3048006096,f[2]*0.3048006096,$0; else if($1 ~ /^M/)print m[1],m[2],$0}' | sponge assess.csv


Former-commit-id: 1aa5c8e47003a6516a64c9aa33b6129e4cb642b2
update readme


Former-commit-id: a99eb1ab4b33873efa1cb7937d19a80fb0ce0991
add list of 22 towns that do not have separate FULL_STR and ADDR_NUM fields.
they just have SITE_ADDR.
can be hard to parse '#1', 'UNIT 3', etc


Former-commit-id: cf2a9c8c6ff94b02a80cdf1890b54e438292083d
need to add to assess where towns had SITE_ADDR but not FULL_STR and ADDR_NUM
but not where LOC_ID is already in use!


Former-commit-id: d27471d39a1e403aff5d07239401cff17546e13d
guess at splitting street name and number for cases where this was not done already.
just take the start of the address if there's a number and go until you find a space.
very poor match because of "#5" and "UNIT 3" etc


Former-commit-id: 398e968f89f75e2beb35686d9f8a506bb2e748cb
add additional towns to assess.csv


Former-commit-id: 23fd19b1611c0e9c828509c913a3e2113c33a365
add x_meters and y_meters to additional towns
NB: additional towns use SITE_ADDR field which has been poorly split.
there is a field that notes this - used_SITE_ADDR

cat assess.csv | sed '1d' | tawk '{OFS="\t";x=$3;if(x ~ /^F/ && $1 ~ /^$/)gsub(/^F_/,"",x)split(x,f,"_");if(x ~ /^M/ && $1 ~ /^$/)gsub(/^M_/,"",x)split(x,m,"_");if($3 ~ /^F/ && $1 ~ /^$/)print f[1]*0.3048006096,f[2]*0.3048006096,$3,$4,$5,$6,$7; else if($3 ~ /^M/ && $1 ~ /^$/)print m[1],m[2],$3,$4,$5,$6,$7; else print $0}'|sponge assess.csv


Former-commit-id: fa25269f02e4bac297f8d64ae3506b0a87e00750
add codes for towns that we still don't have addresses for


Former-commit-id: e18e55997dc7c47032df642a745d2eee4451d02d
add the town M150,M086


Former-commit-id: 69715cc5d4b379cf6c6fa6dfd11802b39f8b8d2e
reformat addresses for two new towns


Former-commit-id: b569f4b1fa8b8067b1fb46271fad51c2c7b29dde
get x/y in m for new towns

$ cat assess.csv | sed '1d' | tawk '{OFS="\t";x=$3;if(x ~ /^F/ && $1 ~ /^$/)gsub(/^F_/,"",x)split(x,f,"_");if(x ~ /^M/ && $1 ~ /^$/)gsub(/^M_/,"",x)split(x,m,"_");if($3 ~ /^F/ && $1 ~ /^$/)print f[1]*0.3048006096,f[2]*0.3048006096,$3,$4,$5,$6,$7; else if($3 ~ /^M/ && $1 ~ /^$/)print m[1],m[2],$3,$4,$5,$6,$7; else print $0}'|sponge assess.csv


Former-commit-id: 6caaa7f54218707894927acdd5ed3234aca1af56
if any field is blank except for used_SITE_ADDR then remove record
that's 12k records!


Former-commit-id: 2a8c4a4a7e0af5c801fef3b9250a4b0239d33408
rm head txt
NB: ~12k records have addr_num as '0'

Former-commit-id: d2d28250871fd6e7ca8365ceae0e1504e3ae2d91
fix town for M_241600_902515


Former-commit-id: ac5430fcc9d9d6596056dda5ff5c9cdb06ebfafc
change null used_SITE_ADDR to '0'

$ cat assess.csv | tawk '{OFS="\t";if($7 ~ /^$/)$7="0";print $0}'|sponge assess.csv


Former-commit-id: d83a73efd377bde16b37a85a1f4db153b24f2b9c