At best, the design falls into the dubious category of security through obscurity, which means it will be exploited when someone feels like it's worthwhile.
You're blocking vision- and mobility-impaired users from basic tasks that would allow them to live unassisted.