done with portal crawling, some performance improvent is required