composite: Avoid deadlock in unhandle port

Change-Id: I8fc0d5aa7f24cec10c8b2cf99c78cdaeba8ca518
composite: Limit queue size

Change-Id: If4499ae46c7642ece65b9b1305944e36e0b9da74