remove broken files
add mof.s3_name column
generate s3 url based on s3_name
filter out unavailable documents
fix bug in log message
upload to s3