configure: Fix a typo (CLFLAGS) and make sure the -O logic always sets the visibility

Signed-off-by: Lauri Kasanen <cand@gmx.com>
Signed-off-by: Eduardo Silva <edsiper@gmail.com>