only use param fetcher with validator when listener enabled

Fixing #717 

Moved ParamFetcher to param_fetcher_listener.xml which is only loaded when listener enabled.