Simple CNN-based baseline for animal sparse pose estimation

username: Mona_Jalal
cooked: <p>I am interested in a simple CNN-based baseline for detecting the landmarks in an animal given I have groundtruth for the animal.<br>
Here is a screenshot from a recent paper with this regard:<br>
<div class="lightbox-wrapper"><a class="lightbox" href="https://discuss.pytorch.org/uploads/default/original/3X/3/5/359304b47fc15df360742228e207a35f8f5a937b.jpeg" data-download-href="https://discuss.pytorch.org/uploads/default/359304b47fc15df360742228e207a35f8f5a937b" title="Screenshot%20from%202019-12-10%2002-50-47"><img src="https://discuss.pytorch.org/uploads/default/optimized/3X/3/5/359304b47fc15df360742228e207a35f8f5a937b_2_690x320.jpeg" alt="Screenshot%20from%202019-12-10%2002-50-47" data-base62-sha1="7DWi3YTyUpwawOo7y2by0g80sHx" width="690" height="320" srcset="https://discuss.pytorch.org/uploads/default/optimized/3X/3/5/359304b47fc15df360742228e207a35f8f5a937b_2_690x320.jpeg, https://discuss.pytorch.org/uploads/default/optimized/3X/3/5/359304b47fc15df360742228e207a35f8f5a937b_2_1035x480.jpeg 1.5x, https://discuss.pytorch.org/uploads/default/optimized/3X/3/5/359304b47fc15df360742228e207a35f8f5a937b_2_1380x640.jpeg 2x" data-dominant-color="DFE2E4"><div class="meta"><svg class="fa d-icon d-icon-far-image svg-icon" aria-hidden="true"><use href="#far-image"></use></svg><span class="filename">Screenshot%20from%202019-12-10%2002-50-47</span><span class="informations">1641×762 241 KB</span><svg class="fa d-icon d-icon-discourse-expand svg-icon" aria-hidden="true"><use href="#discourse-expand"></use></svg></div></a></div></p>
<p>What would be a good starter code? I am trying not to poke into something complex like openpose/Simple Baseline by Microsoft (ECCV 2018), or DeeperCut. I am looking for something quite simple that can predict the landmarks in a supervised manner. It is totally cool though, if it could do some sort of transfer learning from human pose literature (if that doesn’t make the learning worse).</p>
<p>For starter, I have an annotated dataset of 800 frames and four landmarks.</p>
<p>link 1. <a href="https://www.biorxiv.org/content/biorxiv/early/2018/07/28/377895.full.pdf" rel="noopener nofollow ugc">https://www.biorxiv.org/content/biorxiv/early/2018/07/28/377895.full.pdf</a><br>
link 2. <a href="https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&amp;arnumber=8858533" class="inline-onebox" rel="noopener nofollow ugc">Primate Markerless Pose Estimation and Movement Analysis Using DeepLabCut | IEEE Conference Publication | IEEE Xplore</a></p>
<p>Please let me know if you would be more interested in further information.</p>
<p>P.S.: I recently came across a paper that does domain adaptation for animal pose estimation from human pose estimation. I am not sure how much control I would have over implementing that though or how easy is it to generalize it to any animal. Cross-Domain Adaptation for Animal Pose Estimation</p><aside class="onebox allowlistedgeneric" data-onebox-src="https://arxiv.org/abs/1908.05806">
  <header class="source">
      <img src="https://arxiv.org/static/browse/0.3.4/images/icons/favicon-32x32.png" class="site-icon" width="" height="">

      <a href="https://arxiv.org/abs/1908.05806" target="_blank" rel="noopener nofollow ugc">arXiv.org</a>
  </header>

  <article class="onebox-body">
    <div class="aspect-image" style="--aspect-ratio:690/402;"><img src="https://static.arxiv.org/icons/twitter/arxiv-logo-twitter-square.png" class="thumbnail" width="" height=""></div>

<h3><a href="https://arxiv.org/abs/1908.05806" target="_blank" rel="noopener nofollow ugc">Cross-Domain Adaptation for Animal Pose Estimation</a></h3>

  <p>In this paper, we are interested in pose estimation of animals. Animals usually exhibit a wide range of variations on poses and there is no available animal pose dataset for training and testing. To address this problem, we build an animal pose...</p>


  </article>

  <div class="onebox-metadata">
    
    
  </div>

  <div style="clear: both"></div>
</aside>


username: Mona_Jalal
cooked: <p>Is there any simple baseline for animal pose estimation yet available with PyTorch?</p>