Revert "[PATCH] softirq: reduce latencies"

This reverts commit 099984da1768f7ab4b5d361b960c90926be70986.

Seems to cause problems with streaming video.