libraries change
tests for duplication added
folder spider logic update
code duplication added