Only add direct children as panels