Attention spans are said to be measured in nanoseconds, which is only a bit of an overstatement. The business person who comes to your site probably wants information, not entertainment. They don't want fluff. Give visitors anything else and they'll be unhappy. If the graphic adds nothing that's essential to your site, it shouldn't be there.
Some purists recommend eliminating all such graphics.
I take a more pragmatic view. Just as food prepared without spices is bland, a Web site with no graphics is too plain. How to reduce load time Examine every image on your site with an eye to making the file size smaller. Experiment with various quality settings because some images can accept a lot of degradation without showing it. Conversely, other images can accept very little degradation before the quality becomes unacceptable.