Move immutable items into its own directory