The primary toxic ingredients in adhesives are the solvents. Usually they evaporate very quickly into the air. Solvent-based glues give off toxic vapors which can have a narcotic effect or cause illness when inhaled in sufficient quantity. Many are extremely flammable. Rubber cement, a popular glue for bonding paper, is particularly nasty because it contains hexane or heptane, nervous system depressants which can also cause nerve damage.
Rubber cement is also extremely flammable.
A glue stick is a safer choice. One of the advantages of rubber cement, of course, is that you can move items you have attached. If you absolutely must use rubber cement, use one based on heptane rather than hexane, because it is somewhat less toxic. Young children should not use any type of rubber cement. White and yellow wood glues, such as Elmer's, have very low toxicity.