A method for controlling a hearing device, the hearing device comprising a housing with a first and a second sound inlet (3a, 3b), a first microphone arranged at the first sound inlet and a second microphone arranged at the second sound inlet, a signal processing unit for processing the signal from the first microphone and the second microphone to provide a processed signal and an output transducer for converting the processed signal into a signal perceivable by a wearer of the hearing device, the method comprising the steps of: - detecting a touch gesture carried out by the wearer of the hearing device using a finger, wherein as part of the touch gesture the finger is swiped across the first sound inlet and the second sound inlet, by determining if a first output signal from the first microphone contains a component caused by the finger touching the hearing device at the first sound inlet and if a second output signal from the second microphone contains a component caused by the finger touching the hearing device at the second sound inlet; - selecting a control signal from a plurality of control signals based on the step of detecting; - providing the selected control signal to the signal processing unit; - changing at least one processing parameter or setting of the signal processing unit dependent on the selected control signal; and - applying touch noise cancellation to a signal derived from the first output signal and/or the second output signal and providing a resulting signal to the output transducer when having detected that the first output signal contains a component caused by the finger touching the hearing device at the first sound inlet and/or that the second output signal contains a component caused by the finger touching the hearing device at the second sound inlet, the applying touch noise cancellation being in particular attenuating a signal provided to the output transducer. - detecting a touch gesture carried out by the wearer of the hearing device using a finger, wherein as part of the touch gesture the finger is swiped across the first sound inlet and the second sound inlet, by determining if a first output signal from the first microphone contains a component caused by the finger touching the hearing device at the first sound inlet and if a second output signal from the second microphone contains a component caused by the finger touching the hearing device at the second sound inlet; - selecting a control signal from a plurality of control signals based on the step of detecting; - providing the selected control signal to the signal processing unit; - changing at least one processing parameter or setting of the signal processing unit dependent on the selected control signal; and - applying touch noise cancellation to a signal derived from the first output signal and/or the second output signal and providing a resulting signal to the output transducer when having detected that the first output signal contains a component caused by the finger touching the hearing device at the first sound inlet and/or that the second output signal contains a component caused by the finger touching the hearing device at the second sound inlet, the applying touch noise cancellation being in particular attenuating a signal provided to the output transducer.