Make test loader not break if the directory the lib is placed in is not "Ask"

Change-Id: I9652e46ed27e584193d11a22fb47cd5677839fbf