He married Sybilla Crelin in 1584 with whom he had six sons and one daughter. Their sons Alexander (1587-1661), Vincent (1595–1675) and Niclaes (1598–1658) became respectively a still life painter, a battle painter and a portrait painter. Prior to the Fall of Antwerp, Emmanuel was likely a Calvinist as he only had his first son baptised in a Catholic after the Fall of Antwerp. He was registered as a Catholic in the "purge records" of the Antwerp civic guard after the Fall of Antwerp. His wealth and good connections with the higher circles of Anwerp society may have protected him. Emmanuel was later appointed captain of the civic guard, an activity providing a regular income. In 1595 he took part in the liberation of the neighboring town of Lier, which had been occupied by troops of the Dutch Republic.