swin hackathon 2023: team homesick's demo video
Channel: Nguyen Anh
Date: 2023-09-26

Description: application to automatically answer calls related to real estate information (available in the database).

The main purpose of this application is to reduce the unnecessary, reducible load on brokers, and help them classify calls with information that is potentially interesting to them. In addition, it also acts as a chatbot (after slightly editing the interface) to advise customers about real estate projects quickly without having to spend hours searching. The purpose, potential, and approach of this application are many.

Program flow (aka how this program runs):
Input will be the user's question in voice or text form. If it is voice, it will use Silero Vad to filter the sound around the user. In addition, it is also used to know when to stop streaming the speaker's voice. Next, the voice will convert to text using whisper. We choose a whisper port by const me because of overall optimization. The input will then go through two layers of processing using palm2. The first layer is to filter keywords and the corresponding value of the keywords, related to real estate: for example, which direction is the house, north or south, how much is the house, how many bedrooms, etc. Next, the keywords will go to the next processing layer to turn into queries for elastic search. From that query, we get the search results. And we synthesize the results into a complete answer based on gpt. And returns the user results, in the form of either text or voice.

Group members:
+ Nguyen Cuong Nhat (core processing programmer)
+ Nguyen Dang Duc Anh (programmer for input and output processing and program logic)