Not as long as you know what type of mushrooms you are growing!  Several types of mushrooms are considered poisonous or not edible, but growing other mushrooms like enoki, cremini, and shiitake have very little risk.  So if you enjoy using mushrooms in your kitchen, grow some at home today!