Sure thing! The best banana bread is made with bananas that have brown peels. However, if the inside of your banana is brown, slimy, or moldy, it's no longer safe to use.