The best way to hang flower planter boxes without drilling is to purchase hooks that you can attach to the box and then later hang on to your window.
This means that you can move your hanging planter box from window to window without needing to drill holes or use any other kind of permanent fixing.