Perform matrix decomposition for each component, rather for all components after the difficult one.