Revert "add more optimization for shadows"

This reverts commit 2f44f898533a14356b0cf8c07c098860fea169ac.