In DMC 3 he carried them in holsters straped to his red coat, but in other games and even the anime it was inconsistant. Dante would always look as though he was either drawing them out of his belt from behind or from under his coat despite not having any holsters in either of those places on his character models.