Original: In literature, particularly in literary criticism, "mainstream" is used to designate traditional realistic or mimetic fiction, as opposed to genre fictions such as science fiction, romance novels and mysteries, as well as to experimental fiction.
Simplified: In literature, "mainstream" refers to traditional realistic fiction, as opposed to genre fictions such as science fiction or mysteries.