Set yourself upwind or upstream. This will help you keep control of your kayak and make it less likely that you’ll scare the fish away.
Use an anchor to keep your kayak in one place so you can focus on fishing instead of drifting.
In the end, kayak fishing requires knowing how to cast, knowing how to use different baits and lures, being able to read the water and find fish, and knowing how to position the kayak and where to put the anchor. You can become a good kayak angler if you practise these techniques and try out different methods.