In the scenes where there were the colour issues, this game first loads whole 0x400 bytes, then loads 0x20 (which is exactly how many it will use) "unused" bytes again before setting the texture. The similar thing happens in SRWZ2 too.