Patent ID: 11875510
Assignee: ADOBE INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 10:
11. A system comprising:
at least one memory device comprising a segmentation refinement neural network comprising:
a shared encoder that extracts encoded feature maps from a digital visual media item; and
a recursive decoder that generates a refined segmentation mask for the digital visual media item based on the encoded feature maps, the recursive decoder comprising:
a deconvolution branch that generates decoded feature maps based on the encoded feature maps; and
a refinement branch comprising a hierarchy of hierarchical point-wise refining blocks having:
a first hierarchical point-wise refining block that generates an initial segmentation mask corresponding to the digital visual media item based on at least one encoded feature map from the shared encoder and at least one decoded feature map from the deconvolution branch; and
additional hierarchical point-wise refining blocks that generate, based on additional encoded feature maps from the shared encoder and additional decoded feature maps from the deconvolution branch, the refined segmentation mask by recursively refining the initial segmentation mask corresponding to the digital visual media item,
wherein the recursively refining comprises refining the initial segmentation mask by each of the additional hierarchical point-wise refining blocks, and
wherein encodings of coarse-to-fine variations generated via the additional hierarchical point-wise refining blocks are provided back to the deconvolution branch such that at least some of the additional decoded feature maps are generated based on the generated encodings of coarse-to-fine variations; and

at least one computing device configured to cause the system to:
receive, at the segmentation refinement neural network, at least one digital visual media item; and
generate, utilizing the segmentation refinement neural network, one or more refined segmentation masks for the at least one digital visual media item.