That is mainly caused by incorrect Quality settings on Handbrake while converting. A specific quality level is the aim of Constant Quality RF (CRF). A more outstanding bitrate must be employed to achieve that quality level at a lower CRF, increasing the output file size.