From the File Management screen click the trashcan icon next to the Folder you want to remove.
A pop up will ask you to verify you want to delete the Folder.
Just like with Files, when you delete a Folder it and all of its contents are removed from the Collection and your AI permanently.