Enhancing Front-End Pupil Detection Using TensorFlow.js and BlazeFace
Channel: BioniChaos
Date: 24/04/2024

In this video, I dive into the intricacies of building an eye-tracking application using TensorFlow.js and BlazeFace, avoiding Python and MediaPipe to run everything efficiently on the front-end. I tackle challenges like pupil detection which is pivotal for enhancing the app's accuracy. Throughout the video, I dissect our codebase, explaining each component from HTML setups to JavaScript utilities like face and pupil detection algorithms. We also discuss potential improvements and troubleshoot issues, such as non-detections and console log errors, aiming to refine our feature detection and streamline user experience.

Try the prototype tool: https://bionichaos.com/EyeTracker/

The tools I develop are available on https://bionichaos.com 
You can support my work on https://patreon.com/bionichaos

#EyeTracking #TensorFlowJS #BlazeFace #PupilDetection #FrontEndDevelopment #JavaScriptCoding #DebuggingCode #MachineLearning #WebAppDevelopment

00:00 - Introduction to Eye Tracking App and Initial Setup
00:21 - Overview of HTML and TensorFlow.js Usage
00:31 - Current Limitations in Pupil Detection
01:04 - Code Walkthrough and Future Plans
01:34 - Debugging and Enhancing Pupil Detection
02:12 - Troubleshooting Pupil Detection Failures
03:00 - Detailed Code Analysis and Improvement Suggestions
03:56 - Console Log Issues and Debugging Steps
04:23 - Identifying and Solving Image Data Problems
05:30 - Verifying Face and Eye Detection Integration
06:09 - Additional Feature Discussions and Log Verifications
07:08 - Comparison with Python Implementations and Possible Enhancements
08:16 - Enhancing Pupil Detection Accuracy and Visualization
09:12 - Review of Code and Implementation Details
10:03 - Testing with Low Resolution Cameras
11:01 - General Updates and Website Plug
12:05 - Challenges with Current Detection Algorithms
13:04 - Moving Python Tools to JavaScript for Browser Compatibility
14:06 - Issues with Lighting and Face Orientation
15:06 - Troubleshooting API and Tool Errors
16:00 - Exploring Alternatives and Refreshing Sessions
17:06 - Discussing Current Face Detection Mechanisms
18:01 - Historical Context and Comparisons with Other Tools
19:07 - Overview of Files and Future Implementation Plans