Set apc.enable_cli = 1

Without this Symfony2 will not use APC cache for Doctrine metadata annotations.

More info here: http://gogs.info/2013/05/using-apc-cache-with-doctrine-symfony/