Patent Document ID: 20180075198
Application ID: 15263035
Patent Flag: 0

Claim One:
1. A computer implemented method for automatically assessing the mental state of a user from a drawing made by the user comprising: digitizing a drawing and determining drawing characteristics, the drawing characteristics including color, objects, and location; analyzing the color characteristics; analyzing the object characteristics; analyzing the location characteristics; performing a video analysis of the user while making the drawing to determine user characteristics, the user characteristics including time characteristics and mood characteristics; requesting the user to provide a voice description of the drawing; performing an audio analysis of the user's voice description of the drawing; analyzing the time characteristics; analyzing the mood characteristics; receiving a profile of the user including personal user data and user events data; automatically interpreting the color, object and location characteristics of the drawing, the user's voice description of the drawing, and the time and mood characteristics of the user to obtain drawing analysis data; automatically comparing the drawing analysis data with the profile and determining developmental patterns based on the comparison; accessing historical data about a plurality of the user's drawings, the historical data including drawing characteristics of the plurality of the user's drawings, video analysis of the user while making the plurality of drawing and audio analysis of the user's voice description of the plurality of drawings; inputting the historical data into a machine learning algorithm computer program module having a machine learning algorithm; inputting drawing tags into the machine learning algorithm computer program module, the drawing tags being at least one of care giver tags and user tags; training the machine learning algorithm based on the historical data and the drawing tags to learn developmental patterns of the user; combining the developmental patterns of the user learned from the machine learning algorithm and the developmental patterns of the user determined from the comparison of the drawing analysis data with the profile, to determine the mental state of the user over time; and selecting a user action based on the mental state of the user determined over time.