Fix port activation for portless sinks/sources