Of course you can decoupage comic books. This whole tutorial does just that. What you want to keep in mind, though, is you want to use thin layers of everything: a thin layer of Mod Podge and a thin layer of glaze. If you use too much Mod Podge, your comic book will wrinkle and won't look great. If you use too much glaze, the images from the back of the page will show through.