Set up skeleton for residual models

Signed-off-by: Phillipp Ohl <phillippohl@gmail.com>