The watchdog said that it would take legal action against four groups and was assessing others for being too quick to take court action , unfairly imposing fees and not taking borrowers ' circumstances into account .