finished implementign idfs. should rework regex to do better filtering