I wouldn't recommend tossing everything in at once since the ingredients cook for different lengths of time to get done. Shrimp cooks quickly, so stir fry it first, then add it back to the wok after the broccoli has cooked a few minutes to ensure everything comes together perfectly at the end.