Built in window box