Turns out my sync outputs were flipped, so they would display 1 when it should be 0 and 0 when it should be 1.  In addition, my hsync and vsync wires got switched in the vga_sync, causing everything to get all weird.  Next thing is to get the pixel gen to work correctly.