make metadata storage pluggable

any reason we use only the first 100 chars for index? We don't for other connectors.