Patent Document ID: 9864803
Application ID: 14805830

Base Claim:
1. A method for multimodal clue based personalized app function recommendation, comprising: receiving an app search query from a user; obtaining a plurality of real-time clues collected from the user; extracting a plurality of features to represent the plurality of real-time clues collected from the user, wherein the plurality of features include structured features and text features; based on the plurality of extracted features, generating a joint representation of a multimodal clue, comprising: using a multimodal Deep Boltzmann Machine (DBM) to construct two separate two-layer DBMs to model distribution over the structured features and the text features respectively; and combining the two separate two-layer DBMs by adding an additional layer of binary hidden units on the top of the two-layer DBMs; based on the joint representation of the multimodal clue, creating a logistic regression model; ranking a list of app functions using the logistic regression model; and displaying a ranked app function list for the user.

---

Claim 2:
2. The method according to claim 1 , wherein obtaining the plurality of real-time clues collected from the user further includes: collecting structured spatiotemporal signals captured by multiple types of sensors, wherein the structured spatiotemporal signals include at least one of time, latitude, longitude, speed, and GPS accuracy; and collecting unstructured text data from one of app content pages and the user.