It is on Linux, and maybe window manager related. The create with minimized/maximized/fullscreen also fail for me, and I have had similar problems with some of the chrome.windows API tests related to minimized/maximized/fullscreen. In this case I think the problem is that the onMinimized event is not firing, preventing the test from completing. I will on comment and remove the TODO.