Some more performance improvements
Remove operation fusion; ~5% speedup