Original: S-PIFu: Integrating Parametric Human Models with PIFu for Single-view Clothed Human Reconstruction
Revised: S-PIFu: Integrating Parametric Human Models with PIFu for Single-view Clothed Human Reconstruction

Original: Anonymous Author(s)
Revised: Anonymous Author(s)

Original: AffiliationAddress email
Revised: AffiliationAddress email

Original: Abstract
Revised: Abstract

Original: We present three novel strategies to incorporate a parametric body model into apixel-aligned implicit model for single-view clothed human reconstruction.
Revised: We present three novel strategies to incorporate a parametric body model into apixel-aligned implicit model for single-view clothed human reconstruction.

Original: Firstly,we introduce ray-based sampling, a novel technique that transforms a parametricmodel into a set of highly informative, pixel-aligned 2D feature maps.
Revised: Firstly,we introduce ray-based sampling, a novel technique that transforms a parametricmodel into a set of highly informative, pixel-aligned 2D feature maps.

Original: Next,we propose a new type of feature based on blendweights.
Revised: Next,we propose a new type of feature based on blendweights.

Original: Blendweight-basedlabels serve as soft human parsing and can help to significantly improve thestructural fidelity of reconstructed meshes.
Revised: Blendweight-basedlabels serve as soft human parsing and can help to significantly improve thestructural fidelity of reconstructed meshes.

Original: Finally, we show how we can extractand capitalize on body part orientation information from a parametric model tofurther improve reconstruction quality.
Revised: Finally, we show how we can extractand capitalize on body part orientation information from a parametric model tofurther improve reconstruction quality.

Original: Together, these three techniques form our
Revised: Together, these three techniques form our

Original: S-PIFu framework, which significantly outperforms state-of-the-arts methods in allmetrics.
Revised: S-PIFu framework, which significantly outperforms state-of-the-arts methods in allmetrics.

Original:  Introduction
Revised:  Introduction

Original: Human digitization is an important topic that has application in areas like virtual reality, robotnavigation, and medical imaging.
Revised: Human digitization is an important topic that has application in areas like virtual reality, robotnavigation, and medical imaging.

Original: While there exist high-end, multi-view capturing systems that canaccurately digitalize and reconstruct 3D human bodies (3; 4; 12), they are largely inaccessible togeneral consumers.
Revised: While there exist high-end, multi-view capturing systems that canaccurately digitalize and reconstruct 3D human bodies (3; 4; 12), they are largely inaccessible togeneral consumers.

Original: In search of more accessible methods, the research community has delved intohuman digitization approaches that use simple inputs such as a single image (2; 15; 21; 20).
Revised: In search of more accessible methods, the research community has delved intohuman digitization approaches that use simple inputs such as a single image (2; 15; 21; 20).

Original: Various methods have been proposed for single-image clothed human digitization, but one classof approaches that has gained notable attention is pixel-aligned implicit models (19; 5; 20), whichare relatively lightweight and could capture fine-level geometric details such as clothes wrinkles.
Revised: Various methods have been proposed for single-image clothed human digitization, but one classof approaches that has gained notable attention is pixel-aligned implicit models (19; 5; 20), whichare relatively lightweight and could capture fine-level geometric details such as clothes wrinkles.

Original: But these models are prone to depth ambiguity (causing unnaturally elongated body parts) and toproducing human meshes with broken limbs (7; 17).
Revised: But these models are prone to depth ambiguity (causing unnaturally elongated body parts) and toproducing human meshes with broken limbs (7; 17).

Original: In order to overcome these two limitations, He et al.
Revised: In order to overcome these two limitations, He et al.

Original: (6) designed ARCH++, a model which combinesa pixel-aligned implicit model with a parametric human body model.
Revised: (6) designed ARCH++, a model which combinesa pixel-aligned implicit model with a parametric human body model.

Original: However, ARCH++ dependsheavily on having a near-perfect mapping between the canonical and posed spaces, which is ofteninfeasible to attain due to the varied clothing of human meshes.
Revised: However, ARCH++ dependsheavily on having a near-perfect mapping between the canonical and posed spaces, which is ofteninfeasible to attain due to the varied clothing of human meshes.

Original: Another problem with ARCH++ isthat it only uses the (x,y,z) coordinate information of the parametric model, ignoring other informationthat could well prove useful.
Revised: Another problem with ARCH++ isthat it only uses the (x,y,z) coordinate information of the parametric model, ignoring other informationthat could well prove useful.

Original: In order to overcome these issues, we propose S-PIFu, a pixel-aligned implicit model that utilizes aparametric human body model without requiring a mapping between the canonical and posed spaces.
Revised: In order to overcome these issues, we propose S-PIFu, a pixel-aligned implicit model that utilizes aparametric human body model without requiring a mapping between the canonical and posed spaces.

Original: S-PIFu transforms a parametric body model into a set of pixel-aligned 2D feature maps, which cancontain more information than just the (x,y,z) coordinate information.
Revised: S-PIFu transforms a parametric body model into a set of pixel-aligned 2D feature maps, which cancontain more information than just the (x,y,z) coordinate information.

Original: In its essence, S-PIFu is a newmethod of incorporating a SMPL-X (16) parametric body model into a PIFu (which is a pixel-alignedimplicit model).
Revised: In its essence, S-PIFu is a newmethod of incorporating a SMPL-X (16) parametric body model into a PIFu (which is a pixel-alignedimplicit model).

Original: The ‘S’ stands for SMPL-X.
Revised: The ‘S’ stands for SMPL-X.

Original: The main contributions of our work are
Revised: The main contributions of our work are

Original: [Figure]
Revised: [Figure]

Original: We introduce ray-based sampling (RBS), a novel technique that transforms a parametricmodel into a set of highly informative, pixel-aligned 2D feature maps.
Revised: We introduce ray-based sampling (RBS), a novel technique that transforms a parametricmodel into a set of highly informative, pixel-aligned 2D feature maps.

Original: We find that applying RBS on coordinate information alone can already propel a vanilla PIFu to SOTAperformances.2.
Revised: We find that applying RBS on coordinate information alone can already propel a vanilla PIFu to SOTAperformances.2.

Original: Furthermore, we propose a new type of feature based on blendweights.
Revised: Furthermore, we propose a new type of feature based on blendweights.

Original: Blendweight-basedlabels serve as soft human parsing labels and lead to a significant improvement over thebaseline model.3.
Revised: Blendweight-basedlabels serve as soft human parsing labels and lead to a significant improvement over thebaseline model.3.

Original: Thirdly, we show how we can extract and capitalize on body part orientation informationfrom a parametric model.
Revised: Thirdly, we show how we can extract and capitalize on body part orientation informationfrom a parametric model.

Original: We show this can also improve the baseline model significantly.
Revised: We show this can also improve the baseline model significantly.

Original: Each of our contributions can be added to any existing pixel-aligned implicit model.
Revised: Each of our contributions can be added to any existing pixel-aligned implicit model.

Original:  Related Work2.1 Single-view Human Reconstruction
Revised:  Related Work2.1 Single-view Human Reconstruction

Original: Single-view human reconstruction (or digitalization) methods can be classified into parametric andnon-parametric approaches.
Revised: Single-view human reconstruction (or digitalization) methods can be classified into parametric andnon-parametric approaches.

Original: Parametric methods, such as (9; 11; 10), recover human body shapes byestimating the parameters of a parametric human body model (e.g. SMPL (13) or SMPLX (16))
Revised: Parametric methods, such as (9; 11; 10), recover human body shapes byestimating the parameters of a parametric human body model (e.g. SMPL (13) or SMPLX (16))

Original: froman input image.
Revised: froman input image.

Original: However, these parametric methods can only reconstruct clothless human meshes.
Revised: However, these parametric methods can only reconstruct clothless human meshes.

Original: On the other hand, non-parametric approaches do not require a parametric body model.
Revised: On the other hand, non-parametric approaches do not require a parametric body model.

Original: For example,(21) utilizes a 3D CNN to directly estimate a volumetric body shape from a single RGB image.
Revised: For example,(21) utilizes a 3D CNN to directly estimate a volumetric body shape from a single RGB image.

Original: Asubclass of non-parametric approaches that have generated significant interest is pixel-aligned implicitmodels (19; 7; 5; 20).
Revised: Asubclass of non-parametric approaches that have generated significant interest is pixel-aligned implicitmodels (19; 7; 5; 20).

Original: These methods model a human body as an implicit function, from which amesh can be obtained using Marching Cubes algorithm (14).
Revised: These methods model a human body as an implicit function, from which amesh can be obtained using Marching Cubes algorithm (14).

Original: One of the first pixel-aligned implicitmodels is the Pixel-Aligned Implicit Function (PIFu) (19).
Revised: One of the first pixel-aligned implicitmodels is the Pixel-Aligned Implicit Function (PIFu) (19).

Original: PIFu uses a multi-layer perceptron toestimate the occupancy of query points in a 3D space.
Revised: PIFu uses a multi-layer perceptron toestimate the occupancy of query points in a 3D space.

Original: Using Marching Cubes, PIFu can reconstructclothed human meshes effectively.
Revised: Using Marching Cubes, PIFu can reconstructclothed human meshes effectively.

Original: A short illustration of PIFu is shown in Fig.
Revised: A short illustration of PIFu is shown in Fig.

Original: 2 (See dotted box).
Revised: 2 (See dotted box).

Original: However, as aforementioned, pixel-aligned implicit models are prone to generating human mesheswith broken limbs or unnaturally elongated human body parts.
Revised: However, as aforementioned, pixel-aligned implicit models are prone to generating human mesheswith broken limbs or unnaturally elongated human body parts.

Original: In contrast, parametric methods donot suffer from these problems.
Revised: In contrast, parametric methods donot suffer from these problems.

Original: This observation led to hybrid methods that combine a pixel-alignedimplicit model with a parametric method.
Revised: This observation led to hybrid methods that combine a pixel-alignedimplicit model with a parametric method.

Original: 2.2 ARCH++
Revised: 2.2 ARCH++

Original: ARCH (8) is a hybrid method that uses a parametric body model to determine how a posed humanmesh (posed space) could be mapped into a common pose (canonical space).
Revised: ARCH (8) is a hybrid method that uses a parametric body model to determine how a posed humanmesh (posed space) could be mapped into a common pose (canonical space).

Original: A PIFu is then used to
Revised: A PIFu is then used to

Original: [Figure]
Revised: [Figure]

Original: train and infer a body mesh in the canonical space.
Revised: train and infer a body mesh in the canonical space.

Original: Another hybrid method, PaMIR (25), voxelizesan estimated SMPL (13) parametric body model before passing it through a 3D encoder to getvoxel-aligned features, which are passed into a PIFu.
Revised: Another hybrid method, PaMIR (25), voxelizesan estimated SMPL (13) parametric body model before passing it through a 3D encoder to getvoxel-aligned features, which are passed into a PIFu.

Original: ARCH++ (6) improves upon ARCH and PaMIR by jointly estimating the occupancy of points in boththe posed and canonical spaces.
Revised: ARCH++ (6) improves upon ARCH and PaMIR by jointly estimating the occupancy of points in boththe posed and canonical spaces.

Original: In addition, ARCH++ proposes using a PointNet++(18) to captureand encode the structural information of a parametric model.
Revised: In addition, ARCH++ proposes using a PointNet++(18) to captureand encode the structural information of a parametric model.

Original: But, as aforementioned, ARCH++ reliesheavily on having near-perfect mapping between the canonical and posed spaces and only uses the(x,y,z) coordinate information of the parametric model, ignoring other meaningful information.
Revised: But, as aforementioned, ARCH++ reliesheavily on having near-perfect mapping between the canonical and posed spaces and only uses the(x,y,z) coordinate information of the parametric model, ignoring other meaningful information.

Original: 2.3 Novelty of our Method
Revised: 2.3 Novelty of our Method

Original: Our paper introduces Ray-based sampling (RBS), which is a completely different way of extractinginformation from a SMPL-like mesh.
Revised: Our paper introduces Ray-based sampling (RBS), which is a completely different way of extractinginformation from a SMPL-like mesh.

Original: RBS directly generates pixel-aligned features from a SMPL-likemesh using rays that penetrate through the mesh.
Revised: RBS directly generates pixel-aligned features from a SMPL-likemesh using rays that penetrate through the mesh.

Original: While the ray penetrates through the mesh, itcollects meaningful information from the faces that it hit.
Revised: While the ray penetrates through the mesh, itcollects meaningful information from the faces that it hit.

Original: We will elaborate on this later.
Revised: We will elaborate on this later.

Original: RBS does not bear any similarity with ARCH (8), PaMIR (25), ARCH++ (6).
Revised: RBS does not bear any similarity with ARCH (8), PaMIR (25), ARCH++ (6).

Original: Compared with ARCHand ARCH++, RBS does not need the hard-to-obtain near-perfect mapping between canonical spaceand posed space (infeasible when human subject wears loose clothing like jacket or coat).
Revised: Compared with ARCHand ARCH++, RBS does not need the hard-to-obtain near-perfect mapping between canonical spaceand posed space (infeasible when human subject wears loose clothing like jacket or coat).

Original: Comparedwith PaMIR, RBS can generate features at much higher resolution (For height and width, RBSfeatures has a 512x512 resolution, which is 16 times bigger than the 128x128 voxel features used in
Revised: Comparedwith PaMIR, RBS can generate features at much higher resolution (For height and width, RBSfeatures has a 512x512 resolution, which is 16 times bigger than the 128x128 voxel features used in

Original: PaMIR), and RBS features can be used without crippling the GPU memory.
Revised: PaMIR), and RBS features can be used without crippling the GPU memory.

Original: Besides RBS, we also introduce blendweight-based labels and body orientation labels, both of whichwe will elaborate later.
Revised: Besides RBS, we also introduce blendweight-based labels and body orientation labels, both of whichwe will elaborate later.

Original:  Method
Revised:  Method

Original: An illustration of our S-PIFu is shown in Fig.
Revised: An illustration of our S-PIFu is shown in Fig.

Original: Similar to (20) and (6), we use a pix2pixHD network(22) to predict frontal and rear normal maps from an input RGB image.
Revised: Similar to (20) and (6), we use a pix2pixHD network(22) to predict frontal and rear normal maps from an input RGB image.

Original: In addition, S-PIFu uses
Revised: In addition, S-PIFu uses

Original: SMPLify-X (16) to estimate a SMPL-X parametric body model (16) from the input RGB image.
Revised: SMPLify-X (16) to estimate a SMPL-X parametric body model (16) from the input RGB image.

Original: In contrast to PaMIR and ARCH++, our method does not need to train a separate encoder to encode aparametric model.
Revised: In contrast to PaMIR and ARCH++, our method does not need to train a separate encoder to encode aparametric model.

Original: Instead, we directly transform a parametric model into a set of 2D feature maps(called coordinate maps) using what we call ray-based sampling (See Section 3.1).
Revised: Instead, we directly transform a parametric model into a set of 2D feature maps(called coordinate maps) using what we call ray-based sampling (See Section 3.1).

Original: The set of 2Dfeature maps is significantly more lightweight than voxels used by PaMIR, and, unlike ARCH and
Revised: The set of 2Dfeature maps is significantly more lightweight than voxels used by PaMIR, and, unlike ARCH and

Original: ARCH++, it does not require an error-free mapping between canonical and posed spaces.
Revised: ARCH++, it does not require an error-free mapping between canonical and posed spaces.

Original: Ray-based sampling captures (x,y,z) coordinate information from the SMPL-X model.
Revised: Ray-based sampling captures (x,y,z) coordinate information from the SMPL-X model.

Original: But it can alsobe used to capture blendweight-based soft human parsing information (See Section 3.2), which isrepresented as another set of 2D feature maps (called blendweight-based soft human parsing maps).
Revised: But it can alsobe used to capture blendweight-based soft human parsing information (See Section 3.2), which isrepresented as another set of 2D feature maps (called blendweight-based soft human parsing maps).

Original: Beside soft human parsing labels, S-PIFu also leverages on ray-based sampling to extract body partorientation information from a SMPL-X model (See Section 3.3), giving us an additional set of 2Dfeature maps called body part orientation maps.
Revised: Beside soft human parsing labels, S-PIFu also leverages on ray-based sampling to extract body partorientation information from a SMPL-X model (See Section 3.3), giving us an additional set of 2Dfeature maps called body part orientation maps.

Original: [Figure]
Revised: [Figure]

Original: The diagram assumes the SMPL-X model has been scaled, thus rays and projection lines are parallel.
Revised: The diagram assumes the SMPL-X model has been scaled, thus rays and projection lines are parallel.

Original: We concatenate coordinate maps, blendweight-based maps, body part orientation maps, frontal andrear normal maps, and a RGB input image together before feeding them into a PIFu, which willoutput occupancy predictions of query points in a 3D space.
Revised: We concatenate coordinate maps, blendweight-based maps, body part orientation maps, frontal andrear normal maps, and a RGB input image together before feeding them into a PIFu, which willoutput occupancy predictions of query points in a 3D space.

Original: The PIFu will be used to reconstructclothed human meshes, which are then refined with our normal maps using the mesh refinement
Revised: The PIFu will be used to reconstructclothed human meshes, which are then refined with our normal maps using the mesh refinement

Original: [Figure]
Revised: [Figure]

Original: technique employed in (6).
Revised: technique employed in (6).

Original: 3.1 Ray-based Sampling
Revised: 3.1 Ray-based Sampling

Original: After estimating a SMPL-X model from a RGB image, we use Ray-based Sampling (RBS) totransform the SMPL-X model into a set of 2D feature maps.
Revised: After estimating a SMPL-X model from a RGB image, we use Ray-based Sampling (RBS) totransform the SMPL-X model into a set of 2D feature maps.

Original: See an illustration of RBS in Fig.
Revised: See an illustration of RBS in Fig.

Original: In
Revised: In

Original: RBS, we project the SMPL-X model into an image plane.
Revised: RBS, we project the SMPL-X model into an image plane.

Original: We interpret the projection lines as rays (inblue in Fig. 3) that move towards the SMPL-X, and each ray is associated with a pixel location.
Revised: We interpret the projection lines as rays (inblue in Fig. 3) that move towards the SMPL-X, and each ray is associated with a pixel location.

Original: Any ray that hits the SMPL-X mesh will simply penetrate through the mesh and continue moving inits original direction.
Revised: Any ray that hits the SMPL-X mesh will simply penetrate through the mesh and continue moving inits original direction.

Original: Each ray will record the faces (more specifically, the face indices) of the meshthat it has penetrated through.
Revised: Each ray will record the faces (more specifically, the face indices) of the meshthat it has penetrated through.

Original: Using the face indices, we can identify the SMPL-X vertices that formthe penetrated faces.
Revised: Using the face indices, we can identify the SMPL-X vertices that formthe penetrated faces.

Original: The (x,y,z) values of the vertices are then placed in 2D feature maps.
Revised: The (x,y,z) values of the vertices are then placed in 2D feature maps.

Original: To be clearer, we will look at an example.
Revised: To be clearer, we will look at an example.

Original: Let us denote the lower ray (in blue) illustrated in‘Close-up’ of Fig. 3 as r .
Revised: Let us denote the lower ray (in blue) illustrated in‘Close-up’ of Fig. 3 as r .

Original: We see that ray r penetrates 4 faces ( f 1 , f 2 , f 3 , f 4 ) of the SMPL-X mesh.
Revised: We see that ray r penetrates 4 faces ( f 1 , f 2 , f 3 , f 4 ) of the SMPL-X mesh.

Original: Each face in SMPL-X is formed by three vertices.
Revised: Each face in SMPL-X is formed by three vertices.

Original: Thus, we can identify the 12 vertices that form f 1 ,f 2 , f 3 , and f 4 .
Revised: Thus, we can identify the 12 vertices that form f 1 ,f 2 , f 3 , and f 4 .

Original: If f 1 is formed by vertices v 11 , v 12 , and v 13 , then we will average up the coordinatesof v 11 , v 12 , and v 13 to obtain the face average coordinates ¯ x 1 , ¯ y 1 , ¯ z 1 .
Revised: If f 1 is formed by vertices v 11 , v 12 , and v 13 , then we will average up the coordinatesof v 11 , v 12 , and v 13 to obtain the face average coordinates ¯ x 1 , ¯ y 1 , ¯ z 1 .

Original: With 4 faces, the ray r willhave a total of 4 sets of face average coordinates.
Revised: With 4 faces, the ray r willhave a total of 4 sets of face average coordinates.

Original: Recall that each ray is associated with exactly onepixel location in the image plane (the image plane actually corresponds to a 2D feature map).
Revised: Recall that each ray is associated with exactly onepixel location in the image plane (the image plane actually corresponds to a 2D feature map).

Original: Thus,we will need 4x3 or 12 2D feature maps to store the information captured by the ray (4 refers to thenumber of face average coordinates, and 3 refers to the x,y,z coordinates).
Revised: Thus,we will need 4x3 or 12 2D feature maps to store the information captured by the ray (4 refers to thenumber of face average coordinates, and 3 refers to the x,y,z coordinates).

Original: Terminology:
Revised: Terminology:

Original: In someliterature, the 12 feature maps are also referred to as a feature map with 12 channels.
Revised: In someliterature, the 12 feature maps are also referred to as a feature map with 12 channels.

Original: We limit the number of faces that a ray can penetrate through to 6 faces as it is very unlikely for aray to penetrate more than 6 faces.
Revised: We limit the number of faces that a ray can penetrate through to 6 faces as it is very unlikely for aray to penetrate more than 6 faces.

Original: In total, RBS will compute 6x3 or 18 2D feature maps (if weonly use coordinate information).
Revised: In total, RBS will compute 6x3 or 18 2D feature maps (if weonly use coordinate information).

Original: If we specify the 2D feature maps to have a resolution of 512x512,then a total of 512x512 rays will be used.
Revised: If we specify the 2D feature maps to have a resolution of 512x512,then a total of 512x512 rays will be used.

Original: This is actually relatively lightweight in practice because
Revised: This is actually relatively lightweight in practice because

Original: RBS only need to be done once, and it can be done in pre-training.
Revised: RBS only need to be done once, and it can be done in pre-training.

Original: The 2D feature maps can beefficiently stored using sparse matrices as a significant number of rays will not hit the SMPL-X meshat all (Also, this means that zeroes will be inserted onto a pixel on the 2D feature map if a ray thatcorresponds to that pixel does not hit any surface.)
Revised: The 2D feature maps can beefficiently stored using sparse matrices as a significant number of rays will not hit the SMPL-X meshat all (Also, this means that zeroes will be inserted onto a pixel on the 2D feature map if a ray thatcorresponds to that pixel does not hit any surface.)

Original: PaMIR uses memory-intensive 3D voxels that are prone to quantization errors caused by the necessaryuse of low spatial resolution (to preserve memory) (6).
Revised: PaMIR uses memory-intensive 3D voxels that are prone to quantization errors caused by the necessaryuse of low spatial resolution (to preserve memory) (6).

Original: Compare to voxels, our set of 2D feature mapsis significantly more lightweight, making it possible to utilize a much higher resolution of the maps.
Revised: Compare to voxels, our set of 2D feature mapsis significantly more lightweight, making it possible to utilize a much higher resolution of the maps.

Original: In addition, unlike ARCH++, RBS does not require a mapping between canonical and posed spacesand is thus not prone to errors in the mapping.
Revised: In addition, unlike ARCH++, RBS does not require a mapping between canonical and posed spacesand is thus not prone to errors in the mapping.

Original: In Section 4.2.2, we show that RBS with coordinateinformation alone is able to significantly outperform ARCH++ in almost all metrics.
Revised: In Section 4.2.2, we show that RBS with coordinateinformation alone is able to significantly outperform ARCH++ in almost all metrics.

Original: In short, RBS generates 18 2D feature maps from a SMPL-X model.
Revised: In short, RBS generates 18 2D feature maps from a SMPL-X model.

Original: These feature maps areconcatenated with the original inputs of a PIFu and then fed into the PIFu as originally designed.
Revised: These feature maps areconcatenated with the original inputs of a PIFu and then fed into the PIFu as originally designed.

Original: The18 feature maps inform the PIFu of the structural information of a SMPL-X mesh.
Revised: The18 feature maps inform the PIFu of the structural information of a SMPL-X mesh.

Original: 3.2 Using Blendweight-based labels as a proxy to Soft Human Parsing Labels
Revised: 3.2 Using Blendweight-based labels as a proxy to Soft Human Parsing Labels

Original: In existing hybrid models, such as ARCH (8), PaMIR (25), and ARCH++ (6), the only information thatwas extracted from the predicted parametric human body model is the (x,y,z) coordinate information.
Revised: In existing hybrid models, such as ARCH (8), PaMIR (25), and ARCH++ (6), the only information thatwas extracted from the predicted parametric human body model is the (x,y,z) coordinate information.

Original: It is a waste as a parametric body model contains much more information than just the (x,y,z)coordinate information.
Revised: It is a waste as a parametric body model contains much more information than just the (x,y,z)coordinate information.

Original: One such information is the human parsing information contained in aparametric body model.
Revised: One such information is the human parsing information contained in aparametric body model.

Original: Parametric human models, such as SMPL(13) and SMPL-X(16), are formed by a predefined andfixed number of vertices.
Revised: Parametric human models, such as SMPL(13) and SMPL-X(16), are formed by a predefined andfixed number of vertices.

Original: Each of these vertices can be easily mapped to a discrete human parsinglabel (e.g. head, upper left arm, hip etc.).
Revised: Each of these vertices can be easily mapped to a discrete human parsinglabel (e.g. head, upper left arm, hip etc.).

Original: While the pose and shape of a parametric model can change,the discrete human parsing label for each of these vertices remain largely unchanged.
Revised: While the pose and shape of a parametric model can change,the discrete human parsing label for each of these vertices remain largely unchanged.

Original: For example, ifthe 50th vertex of the SMPL-X model has a human parsing label of ‘head’, it will retain this humanparsing label regardless of what pose and shape the SMPL-X model takes.
Revised: For example, ifthe 50th vertex of the SMPL-X model has a human parsing label of ‘head’, it will retain this humanparsing label regardless of what pose and shape the SMPL-X model takes.

Original: Using Ray-based Sampling (RBS), we can map the SMPL-X vertices to pixel locations of a 2Dfeature map.
Revised: Using Ray-based Sampling (RBS), we can map the SMPL-X vertices to pixel locations of a 2Dfeature map.

Original: Since we know the discrete human parsing label of each SMPL-X vertex, we canessentially create a 2D feature map that consists of the discrete human parsing labels that are given toeach SMPL-X vertex.
Revised: Since we know the discrete human parsing label of each SMPL-X vertex, we canessentially create a 2D feature map that consists of the discrete human parsing labels that are given toeach SMPL-X vertex.

Original: Please refer to Fig.
Revised: Please refer to Fig.

Original: 4a on more detail on how the 2D feature map is computed.
Revised: 4a on more detail on how the 2D feature map is computed.

Original: This 2D feature map can then be fed into a PIFu.
Revised: This 2D feature map can then be fed into a PIFu.

Original: (In reality, as explained in Section 3.1, we need atotal of 6 such 2D feature map because a ray can penetrate up to 6 faces.)
Revised: (In reality, as explained in Section 3.1, we need atotal of 6 such 2D feature map because a ray can penetrate up to 6 faces.)

Original: However, assigning a discrete human parsing label to each SMPL-X vertex can cause unnecessarynoise at the boundary between two different human body parts.
Revised: However, assigning a discrete human parsing label to each SMPL-X vertex can cause unnecessarynoise at the boundary between two different human body parts.

Original: For example, looking at Fig.
Revised: For example, looking at Fig.

Original: 4a, weobserve that at the boundary between two different body parts, the vertices can be assigned two verydifferent human parsing labels despite being very similar to one another.
Revised: 4a, weobserve that at the boundary between two different body parts, the vertices can be assigned two verydifferent human parsing labels despite being very similar to one another.

Original: Moreover, vertices that areassigned the same human parsing label (e.g. lower left leg), can actually be very different from oneanother.
Revised: Moreover, vertices that areassigned the same human parsing label (e.g. lower left leg), can actually be very different from oneanother.

Original: In order to resolve these shortcomings, we would require a method to give a form of soft humanparsing labels to each of the SMPL-X vertices.
Revised: In order to resolve these shortcomings, we would require a method to give a form of soft humanparsing labels to each of the SMPL-X vertices.

Original: This leads us to the concept of blendweight in the
Revised: This leads us to the concept of blendweight in the

Original: SMPL-X model.
Revised: SMPL-X model.

Original: Blendweight is a matrix of shape (N x K) where N is the total number of SMPL-Xvertices, and K is the number of joints in SMPL-X.
Revised: Blendweight is a matrix of shape (N x K) where N is the total number of SMPL-Xvertices, and K is the number of joints in SMPL-X.

Original: Essentially, the blendweight matrix contains a
Revised: Essentially, the blendweight matrix contains a

Original: K-length vector of values for each SMPL-X vertex.
Revised: K-length vector of values for each SMPL-X vertex.

Original: This vector determines how much each joint in
Revised: This vector determines how much each joint in

Original: SMPL-X would influence the position of a specific vertex when the SMPL-X model is transformedfrom a default pose to an arbitrary pose.
Revised: SMPL-X would influence the position of a specific vertex when the SMPL-X model is transformedfrom a default pose to an arbitrary pose.

Original: We can interpret this K-length vector as a vector of weightsthat determine the degree of association that a specific SMPL-X vertex has with the K different jointsin the SMPL-X body.
Revised: We can interpret this K-length vector as a vector of weightsthat determine the degree of association that a specific SMPL-X vertex has with the K different jointsin the SMPL-X body.

Original: In other words, if we consider joint locations to be a rough proxy for body partlocations, then we can use this K-length vector as a soft human parsing label for a vertex.
Revised: In other words, if we consider joint locations to be a rough proxy for body partlocations, then we can use this K-length vector as a soft human parsing label for a vertex.

Original: A simplistic visualization of how blendweight can be used as soft human parsing labels is shown in
Revised: A simplistic visualization of how blendweight can be used as soft human parsing labels is shown in

Original: Fig. 4b.
Revised: Fig. 4b.

Original: In reality, the blendweight is more complicated (and useful) than that as each vertex is givena K-length vector where K=55 in SMPL-X model.
Revised: In reality, the blendweight is more complicated (and useful) than that as each vertex is givena K-length vector where K=55 in SMPL-X model.

Original: Thus, unlike what is shown in the figure, the softhuman parsing label given to a vertex does not merely weigh the association of that vertex with twodifferent body parts (or joints).
Revised: Thus, unlike what is shown in the figure, the softhuman parsing label given to a vertex does not merely weigh the association of that vertex with twodifferent body parts (or joints).

Original: The soft human parsing label weighs the association of that vertexwith 55 different joints.
Revised: The soft human parsing label weighs the association of that vertexwith 55 different joints.

Original: In a broader sense, blendweight-based labelling is simply giving each vertexan unique ID, except that the ID is made up of mathematically meaningful values that tell us how avertex is similar to another vertex and in what aspects are they similar (e.g. Are two vertices bothinfluenced by the 10 th joint?).
Revised: In a broader sense, blendweight-based labelling is simply giving each vertexan unique ID, except that the ID is made up of mathematically meaningful values that tell us how avertex is similar to another vertex and in what aspects are they similar (e.g. Are two vertices bothinfluenced by the 10 th joint?).

Original: In addition, we provide a comparison between using discrete humanparsing labels and blendweight-based soft parsing labels in supplementary materials.
Revised: In addition, we provide a comparison between using discrete humanparsing labels and blendweight-based soft parsing labels in supplementary materials.

Original: In order to reduce computational cost, we utilize principal component analysis (PCA) to reduce thedimensions of the blendweight matrix from (N x 55) to (N x 24).
Revised: In order to reduce computational cost, we utilize principal component analysis (PCA) to reduce thedimensions of the blendweight matrix from (N x 55) to (N x 24).

Original: Thus, we can map each vertex toa 24-length vector.
Revised: Thus, we can map each vertex toa 24-length vector.

Original: Using RBS, we will generate 6 x 24 or 144 2D feature maps (As explained in
Revised: Using RBS, we will generate 6 x 24 or 144 2D feature maps (As explained in

Original: Section 3.1, a ray can penetrate up to 6 faces.).
Revised: Section 3.1, a ray can penetrate up to 6 faces.).

Original: An illustration on how we compute the 2D featuremaps is shown in Fig. 4b.
Revised: An illustration on how we compute the 2D featuremaps is shown in Fig. 4b.

Original: 3.3 Encoding the Orientation of Body Parts using Vertex Normal information
Revised: 3.3 Encoding the Orientation of Body Parts using Vertex Normal information

Original: With blendweight-based labels, our model will have fine-grained body part labels of a human body.
Revised: With blendweight-based labels, our model will have fine-grained body part labels of a human body.

Original: However, in both 2D and 3D spaces, the same body part can appear very different when it is orienteddifferently.
Revised: However, in both 2D and 3D spaces, the same body part can appear very different when it is orienteddifferently.

Original: For example, a closed fist and a wide open hand appear very differently despite belonging
Revised: For example, a closed fist and a wide open hand appear very differently despite belonging

Original: [Figure]
Revised: [Figure]

Original: v b v c v a
Revised: v b v c v a

Original: [Figure]
Revised: [Figure]

Original: f a v b v c v a f a
Revised: f a v b v c v a f a

Original: [Figure]
Revised: [Figure]

Original: v b v c v a f a
Revised: v b v c v a f a

Original: [Figure]
Revised: [Figure]

Original: v b v c v a f a
Revised: v b v c v a f a

Original: [Figure]
Revised: [Figure]

Original: to the same body part.
Revised: to the same body part.

Original: This limits the usefulness of having human parsing labels (even if it is soft or fine-grained labels) as any model would be confused by how the exact same human parsing label canhave vastly different appearances.
Revised: This limits the usefulness of having human parsing labels (even if it is soft orfine-grained labels) as any model would be confused by how the exact same human parsing label canhave vastly different appearances.

Original: Thus, we argue that it is important for human parsing labels to becomplemented with body part orientation information.
Revised: Thus, we argue that it is important for human parsing labels to becomplemented with body part orientation information.

Original: To extract body part orientation information from a predicted SMPL-X model, we start by applying
Revised: To extract body part orientation information from a predicted SMPL-X model, we start by applying

Original: Ray-based Sampling (RBS).
Revised: Ray-based Sampling (RBS).

Original: For each SMPL-X face f that is penetrated by a ray, we collect thevertex normal vectors of the three vertices that constitute that face.
Revised: For each SMPL-X face f that is penetrated by a ray, we collect thevertex normal vectors of the three vertices that constitute that face.

Original: We then compute the face averagenormal of f by taking the average of the three vertex normal vectors.
Revised: We then compute the face averagenormal of f by taking the average of the three vertex normal vectors.

Original: This face average normal vectortells us the current orientation of the body part (more accurately, the orientation of a face on that bodypart).
Revised: This face average normal vectortells us the current orientation of the body part (more accurately, the orientation of a face on that bodypart).

Original: In order to provide our model with more information about the body parts, we also provide theinitial orientation of the body parts (i.e. the face average normal of the same face f
Revised: In order to provide our model with more information about the body parts, we also provide theinitial orientation of the body parts (i.e. the face average normal of the same face f

Original: but when the
Revised: but when the

Original: SMPL-X model is in the initial or rest pose.
Revised: SMPL-X model is in the initial or rest pose.

Original: See Fig.
Revised: See Fig.

Original: 5 for an illustration).
Revised: 5 for an illustration).

Original: The reason for includingthe initial orientation is to allow our model to compute how different the current orientation (of abody part) is from its initial orientation.
Revised: The reason for includingthe initial orientation is to allow our model to compute how different the current orientation (of abody part) is from its initial orientation.

Original: If the difference is small, it tells our model that the body partshould appear similar to how it appears at rest pose.
Revised: If the difference is small, it tells our model that the body partshould appear similar to how it appears at rest pose.

Original: But if the difference is big, the body parts shouldappear more different from its rest pose.
Revised: But if the difference is big, the body parts shouldappear more different from its rest pose.

Original: (Refer to the short example in Fig.
Revised: (Refer to the short example in Fig.

Original: In other words, to helpour model interpret face average normals, we are giving our model a reference face average normalfor every face in the SMPL-X.
Revised: In other words, to helpour model interpret face average normals, we are giving our model a reference face average normalfor every face in the SMPL-X.

Original: In addition, the inclusion of face normals in RBS is important because, in RBS, a ray does not knowwhether a face it penetrated is a face that is facing towards the camera or a face that is facing awayfrom the camera.
Revised: In addition, the inclusion of face normals in RBS is important because, in RBS, a ray does not knowwhether a face it penetrated is a face that is facing towards the camera or a face that is facing awayfrom the camera.

Original: In the context of a PIFu, which is the base architecture of our S-PIFu, it is importantto know whether a face is facing towards or away from the camera.
Revised: In the context of a PIFu, which is the base architecture of our S-PIFu, it is importantto know whether a face is facing towards or away from the camera.

Original: This is because PIFu works bypredicting whether a query point is inside or outside a mesh.
Revised: This is because PIFu works bypredicting whether a query point is inside or outside a mesh.

Original: So when there is a face that is facingtowards the camera, it means that query points in front of this face is outside of the mesh.
Revised: So when there is a face that is facingtowards the camera, it means that query points in front of this face is outside of the mesh.

Original: Likewise,when there is a face facing away from camera, it means query points in front of the face surface areinside of the mesh.
Revised: Likewise,when there is a face facing away from camera, it means query points in front of the face surface areinside of the mesh.

Original: The face normals thus provide important hints to PIFu to aid its predictions.
Revised: The face normals thus provide important hints to PIFu to aid its predictions.

Original:  Experiments
Revised:  Experiments

Original: 4.1 Datasets
Revised: 4.1 Datasets

Original: We train our models and the competing models on the THuman2.0 dataset (23), which consistsof high-quality scans of human subjects.
Revised: We train our models and the competing models on the THuman2.0 dataset (23), which consistsof high-quality scans of human subjects.

Original: The subjects are primarily young Chinese adults.
Revised: The subjects are primarily young Chinese adults.

Original: We
Revised: We

Original: [Figure]
Revised: [Figure]

Original: F u r t
Revised: F u r t

Original: [Figure]
Revised: [Figure]

Original: r m
Revised: r m

Original: [Figure]
Revised: [Figure]

Original: i f i e d
Revised: i f i e d

Original: [Figure]
Revised: [Figure]

Original: f 0 nf 0 n 0 m ag n i f i ed
Revised: f 0 nf 0 n 0 m ag n i f i ed

Original: [Figure]
Revised: [Figure]

Original: fn ’
Revised: fn ’

Original: [Figure] [Figure]
Revised: [Figure] [Figure]

Original: n ’ exclude scans or meshes that have very obvious scanning errors.
Revised: n ’ exclude scans or meshes that have very obvious scanning errors.

Original: Meshes that suffer from extremeself-occlusion are also excluded because we do not hope to reduce the task into a guessing game.
Revised: Meshes that suffer from extremeself-occlusion are also excluded because we do not hope to reduce the task into a guessing game.

Original: Thisdata cleaning process is conducted before any of the models is trained so as to ensure fair comparisonbetween the different models.
Revised: Thisdata cleaning process is conducted before any of the models is trained so as to ensure fair comparisonbetween the different models.

Original: In all, we use 362 human meshes from the THuman2.0 dataset.
Revised: In all, we use 362 human meshes from the THuman2.0 dataset.

Original: A80-20 train-test split is used, and for each mesh, we render 10 RGB images at different yaw angleswith a weak-perspective camera.
Revised: A80-20 train-test split is used, and for each mesh, we render 10 RGB images at different yaw angleswith a weak-perspective camera.

Original: In addition, we include the BUFF dataset (24) as an additional evaluation dataset.
Revised: In addition, we include the BUFF dataset (24) as an additional evaluation dataset.

Original: No model is trainedusing the BUFF dataset.
Revised: No model is trainedusing the BUFF dataset.

Original: Systematic sampling based on sequence number is carried out on the BUFFdataset to obtain a total of 93 human meshes for testing.
Revised: Systematic sampling based on sequence number is carried out on the BUFFdataset to obtain a total of 93 human meshes for testing.

Original: We use systematic sampling to ensure that,for the same human subject, meshes of different poses are obtained and repeated (or near identical)poses are omitted.
Revised: We use systematic sampling to ensure that,for the same human subject, meshes of different poses are obtained and repeated (or near identical)poses are omitted.

Original: More implementation details is included in our supplementary materials.
Revised: More implementation details is included in our supplementary materials.

Original: 4.2 Comparison with State-of-the-art
Revised: 4.2 Comparison with State-of-the-art

Original: We compare S-PIFu against the existing models on single-view clothed human reconstructionqualitatively and quantitatively.
Revised: We compare S-PIFu against the existing models on single-view clothed human reconstructionqualitatively and quantitatively.

Original: For our quantitative evaluation, we follow the same metrics as usedin (19; 20; 6).
Revised: For our quantitative evaluation, we follow the same metrics as usedin (19; 20; 6).

Original: Specifically, we use Chamfer distance (CD), Point-to-Surface (P2S), and Normalreprojection error (Normal).
Revised: Specifically, we use Chamfer distance (CD), Point-to-Surface (P2S), and Normalreprojection error (Normal).

Original: Existing methods that we compared against include PIFu (19), ARCH++ (6), and PIFuHD (20).
Revised: Existing methods that we compared against include PIFu (19), ARCH++ (6), and PIFuHD (20).

Original: Weincluded PIFu as it is our base architecture and thus serve as an important baseline.
Revised: Weincluded PIFu as it is our base architecture and thus serve as an important baseline.

Original: ARCH++ is usedas it is the state-of-the-arts for incorporating a parametric human body model into a pixel-alignedimplicit model.
Revised: ARCH++ is usedas it is the state-of-the-arts for incorporating a parametric human body model into a pixel-alignedimplicit model.

Original: Also, in (6), He et al.
Revised: Also, in (6), He et al.

Original: demonstrated that ARCH++ is an improvement over both
Revised: demonstrated that ARCH++ is an improvement over both

Original: ARCH (8) and PaMIR (25), and this is our explanation for not including ARCH and PaMIR.
Revised: ARCH (8) and PaMIR (25), and this is our explanation for not including ARCH and PaMIR.

Original: Inaddition, another reason for not including PaMIR is that its authors did not demonstrate that PaMIRis able to outperform PIFuHD, which is the state-of-the-arts at that time.
Revised: Inaddition, another reason for not including PaMIR is that its authors did not demonstrate that PaMIRis able to outperform PIFuHD, which is the state-of-the-arts at that time.

Original: We include PIFuHD as it isstill one of the most effective methods for single-view clothed human reconstruction.
Revised: We include PIFuHD as it isstill one of the most effective methods for single-view clothed human reconstruction.

Original: 4.2.1 Qualitative Evaluation
Revised: 4.2.1 Qualitative Evaluation

Original: We present a qualitative comparison of our S-PIFu with the other existing methods in Fig.1 and Fig.6.
Revised: We present a qualitative comparison of our S-PIFu with the other existing methods in Fig.1 and Fig.6.

Original: In Fig.1, we observe that only our approach is able to capture the correct structure of the humansubject body.
Revised: In Fig.1, we observe that only our approach is able to capture the correct structure of the humansubject body.

Original: Other methods tend to produce unnaturally elongated body parts, missing body parts,or floating artefacts.
Revised: Other methods tend to produce unnaturally elongated body parts, missing body parts,or floating artefacts.

Original: Moreover, S-PIFu successfully reconstructs the fine details of the human body,such as the wrinkles on the long pants and the precise facial features.
Revised: Moreover, S-PIFu successfully reconstructs the fine details of the human body,such as the wrinkles on the long pants and the precise facial features.

Original: [Figure]
Revised: [Figure]

Original: [Table] [Table]
Revised: [Table] [Table]

Original: [Table]
Revised: [Table]

Original: + M + N
Revised: + M + N

Original: [Table]
Revised: [Table]

Original: (Ours) S-PIFu
Revised: (Ours) S-PIFu

Original: [Table]
Revised: [Table]

Original: In Fig.6, we observe that PIFu, ARCH++, and PIFuHD tend to generate broken limbs, floatingartefacts, or missing body parts.
Revised: In Fig.6, we observe that PIFu, ARCH++, and PIFuHD tend to generate broken limbs, floatingartefacts, or missing body parts.

Original: In contrast, S-PIFu is able to generate a clean, natural structureof human body.
Revised: In contrast, S-PIFu is able to generate a clean, natural structureof human body.

Original: We believe that ARCH++’s tendency to produce missing body parts is due to theimperfect mapping between the canonical and posed spaces.
Revised: We believe that ARCH++’s tendency to produce missing body parts is due to theimperfect mapping between the canonical and posed spaces.

Original: In (6), ARCH++ is trained using the
Revised: In (6), ARCH++ is trained using the

Original: RenderPeople dataset (1), which mainly consists of meshes in upright standing poses (5).
Revised: RenderPeople dataset (1), which mainly consists of meshes in upright standing poses (5).

Original: THuman2.0dataset, however, has more varied and complicated poses, making perfect mapping harder to achieve.
Revised: THuman2.0dataset, however, has more varied and complicated poses, making perfect mapping harder to achieve.

Original: 4.2.2 Quantitative Evaluation
Revised: 4.2.2 Quantitative Evaluation

Original: In addition, we provide a quantitative evaluation of our methods against the state-of-the-arts methodsin Tab. 1.
Revised: In addition, we provide a quantitative evaluation of our methods against the state-of-the-arts methodsin Tab. 1.

Original: The table shows that when a PIFu is incorporated with coordinates information extractedusing our ray-based sampling (‘PIFu + M + C’), it can achieve significant improvements and evenoutperforms current state-of-the-arts models in the THuman2.0 dataset.
Revised: The table shows that when a PIFu is incorporated with coordinates information extractedusing our ray-based sampling (‘PIFu + M + C’), it can achieve significant improvements and evenoutperforms current state-of-the-arts models in the THuman2.0 dataset.

Original: However, PIFu + M + C doesnot do as well in the BUFF dataset, indicating a lesser generalizability to a foreign dataset.
Revised: However, PIFu + M + C doesnot do as well in the BUFF dataset, indicating a lesser generalizability to a foreign dataset.

Original: In contrast, S-PIFu, which combine coordinates information (C), blendweight-based labels (B), andbody part orientation information (N) into a PIFu (together with frontal and rear normal maps M),outperforms the existing state-of-the-arts models in all metrics in both datasets.
Revised: In contrast, S-PIFu, which combine coordinates information (C), blendweight-based labels (B), andbody part orientation information (N) into a PIFu (together with frontal and rear normal maps M),outperforms the existing state-of-the-arts models in all metrics in both datasets.

Original: This suggests that theinclusion of B and N helps our model to learn more generalizable features from the training data.
Revised: This suggests that theinclusion of B and N helps our model to learn more generalizable features from the training data.

Original: 4.3 Ablation Studies
Revised: 4.3 Ablation Studies

Original: 4.3.1 Evaluation of using Ray-based Sampling to extract coordinate information
Revised: 4.3.1 Evaluation of using Ray-based Sampling to extract coordinate information

Original: In order to evaluate the benefits of using Ray-based sampling (RBS) to extract coordinate informationfrom a SMPL-X mesh, we train a PIFu that uses not only the RGB image, frontal normal map, andrear normal map, but also the additional input of coordinates (x,y,z) extracted via RBS.
Revised: In order to evaluate the benefits of using Ray-based sampling (RBS) to extract coordinate informationfrom a SMPL-X mesh, we train a PIFu that uses not only the RGB image, frontal normal map, andrear normal map, but also the additional input of coordinates (x,y,z) extracted via RBS.

Original: We comparethis model with a vanilla PIFu that is trained with only the RGB image and the frontal and rear normalmaps.
Revised: We comparethis model with a vanilla PIFu that is trained with only the RGB image and the frontal and rear normalmaps.

Original: See qualitative results in Fig.
Revised: See qualitative results in Fig.

Original: The PIFu with coordinates information can better capturethe structure of human meshes compared to the other PIFu, which often produces broken or missinglimbs, and floating artefacts.
Revised: The PIFu with coordinates information can better capturethe structure of human meshes compared to the other PIFu, which often produces broken or missinglimbs, and floating artefacts.

Original: Quantitatively, we can compare the two models using the second row (‘PIFu + M’) and the fifth row(‘PIFu + M + C’) of Tab. 1.
Revised: Quantitatively, we can compare the two models using the second row (‘PIFu + M’) and the fifth row(‘PIFu + M + C’) of Tab. 1.

Original: We find that although ‘PIFu + M + C’ fared marginally worse than ‘PIFu+ M’ in the CD of BUFF dataset, it significantly outperformed ‘PIFu + M’ in all other metrics.
Revised: We find that although ‘PIFu + M + C’ fared marginally worse than ‘PIFu+ M’ in the CD of BUFF dataset, it significantly outperformed ‘PIFu + M’ in all other metrics.

Original: As mentioned in Section 4.2.2, ‘PIFu + M + C’ also outperforms ARCH++ and other existingmethods.
Revised: As mentioned in Section 4.2.2, ‘PIFu + M + C’ also outperforms ARCH++ and other existingmethods.

Original: [Figure]
Revised: [Figure]

Original: 4.3.2 Evaluation of using Blendweight-based labels
Revised: 4.3.2 Evaluation of using Blendweight-based labels

Original: Similarly, in order to evaluate the effect of using Blendweight-based labels, we train a PIFu thattakes in Blendweight-based human parsing labels as the only additional inputs (besides RGB imageand frontal and rear normal maps).
Revised: Similarly, in order to evaluate the effect of using Blendweight-based labels, we train a PIFu thattakes in Blendweight-based human parsing labels as the only additional inputs (besides RGB imageand frontal and rear normal maps).

Original: We compare this model with a PIFu that is given only the RGBimage and the frontal and rear normal maps.
Revised: We compare this model with a PIFu that is given only the RGBimage and the frontal and rear normal maps.

Original: See the qualitative results in Fig.
Revised: See the qualitative results in Fig.

Original: We find thatusing blendweight-based labels helps to improve the structural fidelity of reconstructed meshes.
Revised: We find thatusing blendweight-based labels helps to improve the structural fidelity of reconstructed meshes.

Original: Specifically, it tackles the problems of unnaturally elongated human parts and floating artefacts.
Revised: Specifically, it tackles the problems of unnaturally elongated human parts and floating artefacts.

Original: Quantitatively, we can compare the two models using the second row (‘PIFu + M’) and the sixth row(‘PIFu + M + B’) of Tab. 1.
Revised: Quantitatively, we can compare the two models using the second row (‘PIFu + M’) and the sixth row(‘PIFu + M + B’) of Tab. 1.

Original: Similarly, we find that ‘PIFu + M + B’ only fared marginally worsethan ‘PIFu + M’ in the CD of BUFF dataset.
Revised: Similarly, we find that ‘PIFu + M + B’ only fared marginally worsethan ‘PIFu + M’ in the CD of BUFF dataset.

Original: For the rest of the metrics, ‘PIFu + M + B’ significantlyoutperformed ‘PIFu + M’.
Revised: For the rest of the metrics, ‘PIFu + M + B’ significantlyoutperformed ‘PIFu + M’.

Original: Also, in supplementary materials, we the results when we replace the ‘B’in ‘PIFu + M + B’ with discrete human parsing labels.
Revised: Also, in supplementary materials, we the results when we replace the ‘B’in ‘PIFu + M + B’ with discrete human parsing labels.

Original: 4.3.3 Evaluation of using Body Part Orientation Information
Revised: 4.3.3 Evaluation of using Body Part Orientation Information

Original: Lastly, we evaluate the merits of using body part orientation information by training a PIFu that usesthat as an additional input (besides RGB image, frontal and rear normal maps).
Revised: Lastly, we evaluate the merits of using body part orientation information by training a PIFu that usesthat as an additional input (besides RGB image, frontal and rear normal maps).

Original: We compare thismodel with a vanilla PIFu (given only RGB image, frontal and rear normal maps) qualitatively in
Revised: We compare thismodel with a vanilla PIFu (given only RGB image, frontal and rear normal maps) qualitatively in

Original: Fig.
Revised: Fig.

Original: We find that using body part orientation information helps to further reinforce the structuralaccuracy of reconstructed meshes by mitigating the occurrence of noisy artefacts in the reconstructionoutputs.
Revised: We find that using body part orientation information helps to further reinforce the structuralaccuracy of reconstructed meshes by mitigating the occurrence of noisy artefacts in the reconstructionoutputs.

Original: [Figure]
Revised: [Figure]

Original: Quantitatively, we can compare the two models using the second row (‘PIFu + M’) and the seventhrow (‘PIFu + M + N’) of Tab. 1.
Revised: Quantitatively, we can compare the two models using the second row (‘PIFu + M’) and the seventhrow (‘PIFu + M + N’) of Tab. 1.

Original: Except for the CD of the Buff dataset, for which ‘PIFu + M + N’performed marginally worse than ‘PIFu + M’, ‘PIFu + M + N’ significantly outperformed ’PIFu + M’in all other metrics.
Revised: Except for the CD of the Buff dataset, for which ‘PIFu + M + N’performed marginally worse than ‘PIFu + M’, ‘PIFu + M + N’ significantly outperformed ’PIFu + M’in all other metrics.

Original: In addition, in our supplementary materials, we compare the results when wereplace the ‘N’ in ‘PIFu + M + N’ with ‘N’ but without the initial orientation of body parts.
Revised: In addition, in our supplementary materials, we compare the results when wereplace the ‘N’ in ‘PIFu + M + N’ with ‘N’ but without the initial orientation of body parts.

Original: [Figure]
Revised: [Figure]

Original:  Conclusion
Revised:  Conclusion

Original: We introduced the S-PIFu framework, which consists of three novel strategies to incorporate aparametric human body model into a pixel-aligned implicit model.
Revised: We introduced the S-PIFu framework, which consists of three novel strategies to incorporate aparametric human body model into a pixel-aligned implicit model.

Original: Firstly, we proposed ray-basedsampling, a novel technique that can transform a parametric model into highly informative 2D featuremaps.
Revised: Firstly, we proposed ray-basedsampling, a novel technique that can transform a parametric model into highly informative 2D featuremaps.

Original: Next, we introduced a new type of feature based on blendweights.
Revised: Next, we introduced a new type of feature based on blendweights.

Original: This new feature serves assoft human parsing labels and can significantly improve the structural fidelity of the reconstructedhuman meshes.
Revised: This new feature serves assoft human parsing labels and can significantly improve the structural fidelity of the reconstructedhuman meshes.

Original: Finally, we showed how we can extract and capitalize on body part orientationinformation from a SMPL-X model to further improve reconstruction quality.
Revised: Finally, we showed how we can extract and capitalize on body part orientationinformation from a SMPL-X model to further improve reconstruction quality.

Original: Checklist
Revised: Checklist

Original: For all authors...
Revised: For all authors...

Original: (a) Do the main claims made in the abstract and introduction accurately reflect the paper’scontributions and scope?
Revised: (a) Do the main claims made in the abstract and introduction accurately reflect the paper’scontributions and scope?

Original: [Yes]
Revised: [Yes]

Original: (b) Did you describe the limitations of your work?
Revised: (b) Did you describe the limitations of your work?

Original: [Yes]
Revised: [Yes]

Original: (c) Did you discuss any potential negative societal impacts of your work?
Revised: (c) Did you discuss any potential negative societal impacts of your work?

Original: [N/A]
Revised: [N/A]

Original: (d) Have you read the ethics review guidelines and ensured that your paper conforms to
Revised: (d) Have you read the ethics review guidelines and ensured that your paper conforms to

Original: them?
Revised: them?

Original: [Yes]
Revised: [Yes]

Original: If you are including theoretical results...
Revised: If you are including theoretical results...

Original: (a) Did you state the full set of assumptions of all theoretical results?
Revised: (a) Did you state the full set of assumptions of all theoretical results?

Original: [N/A]
Revised: [N/A]

Original: (b) Did you include complete proofs of all theoretical results?
Revised: (b) Did you include complete proofs of all theoretical results?

Original: [N/A]
Revised: [N/A]

Original: If you ran experiments...
Revised: If you ran experiments...

Original: (a) Did you include the code, data, and instructions needed to reproduce the main experimental results (either in the supplemental material or as a URL)?
Revised: (a) Did you include the code, data, and instructions needed to reproduce the main experimental results (either in the supplemental material or as a URL)?

Original: [Yes]
Revised: [Yes]

Original: (b) Did you specify all the training details (e
Revised: (b) Did you specify all the training details (e

Original: g., data splits, hyperparameters, how theywere chosen)?
Revised: g., data splits, hyperparameters, how theywere chosen)?

Original: [Yes] Training details are mentioned here.
Revised: [Yes] Training details are mentioned here.

Original: Readers may refer to
Revised: Readers may refer to

Original: supplementary materials for more details
Revised: supplementary materials for more details

Original: (c) Did you report error bars (e
Revised: (c) Did you report error bars (e

Original: g., with respect to the random seed after running experi-
Revised: g., with respect to the random seed after running experi-

Original: ments multiple times)?
Revised: ments multiple times)?

Original: [Yes] All results are obtained after using three pre-specified
Revised: [Yes] All results are obtained after using three pre-specified

Original: different random seeds.
Revised: different random seeds.

Original: We do not have space here for the exact error bars diagram
Revised: We do not have space here for the exact error bars diagram

Original: (d) Did you include the total amount of compute and the type of resources used (e
Revised: (d) Did you include the total amount of compute and the type of resources used (e

Original: g.,type of GPUs, internal cluster, or cloud provider)?
Revised: g.,type of GPUs, internal cluster, or cloud provider)?

Original: [Yes] Refer to our supplementary
Revised: [Yes] Refer to our supplementary

Original: materials
Revised: materials

Original: If you are using existing assets (e
Revised: If you are using existing assets (e

Original: g., code, data, models) or curating/releasing new assets...
Revised: g., code, data, models) or curating/releasing new assets...

Original: (a) If your work uses existing assets, did you cite the creators?
Revised: (a) If your work uses existing assets, did you cite the creators?

Original: [Yes]
Revised: [Yes]

Original: (d) Did you discuss whether and how consent was obtained from people whose data you’re
Revised: (d) Did you discuss whether and how consent was obtained from people whose data you’re

Original: [Table]
Revised: [Table]

Original: using/curating?
Revised: using/curating?

Original: [Yes]
Revised: [Yes]

Original: [Table]
Revised: [Table]

Original: (e) Did you discuss whether the data you are using/curating contains personally identifiable
Revised: (e) Did you discuss whether the data you are using/curating contains personally identifiable

Original: [Table]
Revised: [Table]

Original: information or offensive content?
Revised: information or offensive content?

Original: [N/A]
Revised: [N/A]

Original: [Table]
Revised: [Table]

Original: If you used crowdsourcing or conducted research with human subjects...
Revised: If you used crowdsourcing or conducted research with human subjects...

Original: [Table]
Revised: [Table]

Original: (a) Did you include the full text of instructions given to participants and screenshots, if
Revised: (a) Did you include the full text of instructions given to participants and screenshots, if

Original: [Table]
Revised: [Table]

Original: applicable?
Revised: applicable?

Original: [N/A]
Revised: [N/A]

Original: [Table]
Revised: [Table]

Original: (b) Did you describe any potential participant risks, with links to Institutional Review
Revised: (b) Did you describe any potential participant risks, with links to Institutional Review

Original: [Table]
Revised: [Table]

Original: Board (IRB) approvals, if applicable?
Revised: Board (IRB) approvals, if applicable?

Original: [N/A]
Revised: [N/A]

Original: [Table]
Revised: [Table]

Original: (c) Did you include the estimated hourly wage paid to participants and the total amount
Revised: (c) Did you include the estimated hourly wage paid to participants and the total amount

Original: [Table]
Revised: [Table]

Original: spent on participant compensation?
Revised: spent on participant compensation?

Original: [N/A] [Table]
Revised: [N/A] [Table]