But like anything worth doing, the initial stage is often a struggle. But you can't button your shirt wearing boxing gloves. That is, you can't tap into the Torah's sweetness while steeped in physical desires. Torah's true sweetness is spiritual, so it takes a certain amount of refinement to achieve. That is, pray not to be overpowered by physical drives.
Enjoyment starts with clarity and discovery.
If you study too fast and get confused, or too slow and get bored, then you can't enjoy it. You need to discover the learning technique right for you. And finally, prayer is vital to success in learning. The great Torah scholar Rabbi Yonasan Eibshitz, zatzal, attributed all his success in Torah study to his prayer. An encouraging point.