Absolutely! Physically-wise, that shouldn't be an issue. However, some of them are a lot better left on the side, especially if they’re not waterproof. Also, if the bag has a lure section it might be hard to reach while it's on your back.