At first I was actually returning True, which is perfectly ok with the standard and is coherent with the current behaviour of oauthlib, but then I thought this would be an assumption of the server and wasn't sure what to do...
For me it's ok returning true since, as you say, I could easily implement my logic inside my validator.