In 1830, he married Johanna Henrika Christiane Nissen (1789–1865), a seamstress never previously married, who was seventeen years older than he was.
Brahmsov oče, Johann Jakob Brahms (1806-1872), je prišel do Hamburga iz Dithmarschen, kjer je delal kariero mestnega glasbenika.