The reason it’s best to remove the stems is because they can cause headaches, sore throats, and a coughing fit. Some people who’ve tried smoking the stems might also have stomach pain and nausea and taste like wood chips. So, it’s best to avoid them.