Training and Validation loss and accuracy improvement

username: Santhosh
cooked: <p>Hi,</p>
<p><strong>39 output classes curves:</strong><br>
<img src="https://discuss.pytorch.org/uploads/default/original/3X/b/1/b1f476667465543fdcbbd86f41a05112f3bdfcc3.png" alt="RealDataAccuracy" data-base62-sha1="poggMO9RFNc1a5N6D9NquPX1u27" width="576" height="432"> <img src="https://discuss.pytorch.org/uploads/default/original/3X/8/a/8aa5fc07cbbdd30b89bf45b4bfac4704fccabbdc.png" alt="RealDataLoss" data-base62-sha1="jMxvGvWJz2jBzmTygubvkFdY0TW" width="576" height="432"></p>
<p><strong>5 output classes curves:</strong><br>
<div class="lightbox-wrapper"><a class="lightbox" href="https://discuss.pytorch.org/uploads/default/original/3X/f/5/f50d6815aa430889d2522336fe690358fcd03f79.png" data-download-href="https://discuss.pytorch.org/uploads/default/f50d6815aa430889d2522336fe690358fcd03f79" title="image"><img src="https://discuss.pytorch.org/uploads/default/optimized/3X/f/5/f50d6815aa430889d2522336fe690358fcd03f79_2_690x478.png" alt="image" data-base62-sha1="yXPHD7IpHrFXYVjfsqchQn7VDrb" width="690" height="478" srcset="https://discuss.pytorch.org/uploads/default/optimized/3X/f/5/f50d6815aa430889d2522336fe690358fcd03f79_2_690x478.png, https://discuss.pytorch.org/uploads/default/original/3X/f/5/f50d6815aa430889d2522336fe690358fcd03f79.png 1.5x, https://discuss.pytorch.org/uploads/default/original/3X/f/5/f50d6815aa430889d2522336fe690358fcd03f79.png 2x" data-dominant-color="FBFAFB"><div class="meta"><svg class="fa d-icon d-icon-far-image svg-icon" aria-hidden="true"><use href="#far-image"></use></svg><span class="filename">image</span><span class="informations">805×558 54.8 KB</span><svg class="fa d-icon d-icon-discourse-expand svg-icon" aria-hidden="true"><use href="#discourse-expand"></use></svg></div></a></div><br>
<div class="lightbox-wrapper"><a class="lightbox" href="https://discuss.pytorch.org/uploads/default/original/3X/7/9/79a0ce98cf1747019a7e3eaecdafd7c6bc5b8808.png" data-download-href="https://discuss.pytorch.org/uploads/default/79a0ce98cf1747019a7e3eaecdafd7c6bc5b8808" title="image"><img src="https://discuss.pytorch.org/uploads/default/optimized/3X/7/9/79a0ce98cf1747019a7e3eaecdafd7c6bc5b8808_2_686x499.png" alt="image" data-base62-sha1="hlYiGtRfqkZgtRcir5wZZrcMXuU" width="686" height="499" srcset="https://discuss.pytorch.org/uploads/default/optimized/3X/7/9/79a0ce98cf1747019a7e3eaecdafd7c6bc5b8808_2_686x499.png, https://discuss.pytorch.org/uploads/default/original/3X/7/9/79a0ce98cf1747019a7e3eaecdafd7c6bc5b8808.png 1.5x, https://discuss.pytorch.org/uploads/default/original/3X/7/9/79a0ce98cf1747019a7e3eaecdafd7c6bc5b8808.png 2x" data-dominant-color="FBFAFA"><div class="meta"><svg class="fa d-icon d-icon-far-image svg-icon" aria-hidden="true"><use href="#far-image"></use></svg><span class="filename">image</span><span class="informations">788×574 58.2 KB</span><svg class="fa d-icon d-icon-discourse-expand svg-icon" aria-hidden="true"><use href="#discourse-expand"></use></svg></div></a></div></p>
<p>Looking at the curves above, you can find the training/validation loss and accuracy curves for 5 output classes produced a better result than the 39 output classes. There is a considerable gap between all the training and validation curves. In addition, validation results are higher than the training results. What does it indicate exactly? I want to know whether these curves are a good fit and how to find the convergence point.</p>
<p>Even after increasing the epoch, the result produced is not improving much for the 39 classes model. I’d appreciate it if someone can help me to improve the results further by hyperparameter tuning or using some other popular techniques. I’m aiming to get accuracy over 98% at least for the 39 output classes model.</p>
<p>Parameter details used in training the model are below:</p>
<ol>
<li>The model uses VGG16 pre-trained architecture with 39 output classes (open to change to the architecture that produces good results).</li>
<li>Set Learning rate = 0.001 and optimizer = Adam .</li>
<li>Batch size = 64.</li>
<li>Data transforms Performed - Rotation=30, Resize, Horizontal flip=0.5, Normalize, ToTensor.</li>
<li>Every class has image data ranging between 1000 - 1200. Dataset split into 60:20:20 (Train/Val/Test).</li>
<li>Dropout=0.5.</li>
</ol>
<p>Please let me know of any additional details required to improve the model performance.<br>
TIA.</p>