# Rapid Text Retrieval and Analysis Supporting Latent Dirichlet Allocation Based on Probabilistic Models

Authors: S. Gnanavel; Vinodhini Mani; M. Sreekrishna; R. S. Amshavalli; Yomiyu Reta Gashu; N. Duraimurugan; Namburi Srinivasa Rao
Journal: Mobile Information Systems
 (2022)

---

## Abstract

Text mining, also known as text analysis, is the process of converting unstructured text data into meaningful and functional information. Text mining uses different AI technologies to automate data and generate valuable insights, allowing enterprises to make data-based decisions. Text mining enables the user to extract important content from text data sets. Text analysis encourages machine learning ability for research areas such as medical and pharmaceutical innovation fields. Apart from this, text analysis converts inaccessible data into a structured format, which can be used for further analysis. Text analysis emphasizes facts and relationships from large data sets. This information is extracted and converted into structured data for visualization, analysis, and integration as structured data and refines the information using machine-learning methods. Like most things related to Natural Language Processing, text mining can seem like a difficult concept to understand. But the fact is, it does not have to be. This research article will go through the basics of text mining, clarify its different methods and techniques, and make it easier to understand how it works. We implemented Latent Dirichlet Allocation techniques for mining the data from the data set; it works properly and will be in future development data mining techniques.


---

## Body

## 1. Introduction

Nowadays, there is an increase in public discussions about a product on social media. Analysis of this type of data requires modern technical features of analytics tools and text analytics. Text analysis attempts to understand the meaning of the written word. This is very difficult because it depends on the communication situation of humans. Therefore, the development of social media surrounds a level of communication inability. There is a need to identify the conversations that take place in the community such as on YouTube, Facebook, blog posts, and tweets, where the comments should be in the public mind. Text Analytics is a promising solution and is useful in these times [1, 2].Text analysis applies to categorizing or mining information from the text about the environment [2]. The purpose of text analysis is to create a semantic structure based on differences in the concept, meaning, and attitude of the context. It starts by answering some questions that cannot be answered in the text to be analyzed. Sentiment analysis is a type of text analysis that identifies the polarity of the content. [3].Text analysis is a type of data processing that attempts to detect text formats from large unstructured sources. Also known as text data mining, it is the process of retrieving trivial information and knowledge from unstructured text [4].Patil and Manjrekar explained that text analytics can hide unstructured or semi-structured databases such as full-text documents, HTML files, emails, blogs, academic papers, and newspaper articles. Finally, they said text analysis is about learning data processing, information extraction, and machine learning. The computer is unaware of the relationship between texts and words. The system must be trained by humans for the relationship between words [5].Sentiment analysis is the most important task in text analysis. People often have problems recognizing others, even when in direct contact. An error of text is often caused by a lack of facial expressions or voice traces. This legal writing is hard work and tries to avoid mistakes. People working with systems are the solution to this problem. Systems can identify whether a given word or sentence is positive or negative. Individuals with specific domain expertise can analyze low confidence results and teach the machine the way to standardize these low confidence results. Over time, the computer expert will understand this feature and become more accurate and effective. Our proposed model works perfectly for the given data set and it is able to identify parts of speech like nouns, verbs, etc, and also count the number of words, characters, and character spaces.This article is organized as follows: Section2 explained Related works, Section 3 Methodology, Section 4 Results and Discussion, and Section 5 conclusions.


## 2. Related Works

Park et al. proposed improvements in word-embedding help to implement a concept from minimal seed terms. But the primitive use of those techniques creates false positive errors due to the principle of natural language. To solve this problem, a visual analysis system called Feed Vector is provided, which prompts a user to use feedback to generate feedback and analyze documents. A bipolar concept model has been introduced to refer to irrelevant words [6].Packiametal and Prakash said that the usage of big data increased but it has some real-time issues. In particular, the key part of information retrieval is the best experience with big data. The main purpose is to find or improve the best low-cost and reliable techniques for extracting values from high terabytes and petabytes of available data. Hence big data analysis is important. Conventional analysis concentrates on structured data, but it is not suitable for large amounts of unstructured data. Text analysis is a technique for gaining prominence from unstructured text to identify transformations and patterns [7].Medoc et al. provide a Visual Analytics tool for research work and status awareness for text streams. To achieve the data model, encoding streaming text is designed in several dynamic frequency measurements. Visualization includes two dynamic theme rivers. These two dynamic theme rivers enable real-time travel of most features derived from texts stored in long-term and short-term buffers [8].Bradel et al. suggested that semantic communication delivers difficult statistical models and intrinsic communication techniques between human users. Semantic communication concentrates on manipulating direct spatiality by controlling users who handle sample parameters. However, this semantic communication technique cannot be substantially measured for many text documents. To solve this problem, the multimodel semantic communication concept is put forward in which semantic interactions can trigger multiple models at different levels of the data model so that users can manage large data issues [9–13].Chiranjeevi et al. presented text documents that are a source for storing personal or public information. Currently, text documents are produced at a tremendous speed and the search engine needs to process the data immediately to improve,. providing a computer that improves the process of retrieving information from unstructured data from text documents in the search engine [14].Park investigated Java-based Visual Analytics tool to read a collection of various text data sources and retrieve relationships, keywords, and events from text data using ontology and language processing methods. Then they implemented Java-based Visual Analytics tool to provide users with an integrated and intuitive search interface to support useful and robust inquiry into large and difficult data sets [15].Vandierendonck et al. proposed an optimized solution for text mining. The processing of text data has high performance and is remarkable. A library of high-performance text analytics is provided. This library enables programmers to make maps for heavy numeric representations that can effectively manage text data. The library integrates three performance enhancements that are as follows:(i)
Text data’s effective memory management(ii)
Parallel computation on relative data structures which map text to values(iii)
Optimization of the relative data structure’s type depending on the program context [16]Heimerl et al. proposed that word clouds have developed a direct and visually appealing visual technique for text. They are used in different characteristics to provide an overview by mining the text for words that are expressed with more events. In particular, it is done consistently with pure text abstractions. For tasks with general text analysis, the use of word clouds is described [17].Social networking sites are a common platform for sharing and referral. Posts and comments on someone’s wall like Facebook judge people in many situations based on the advice of others. These ideas affect one’s thinking when determining because there are so many ideas and opinions. As a result, the user likes a particular post and gives negative feedback for it. To solve the problem, a sentiment analysis approach is provided [18–20].P. Biosciences proposed an algorithm for calculation based on text analysis, provided for quality evaluation of the e-book. The algorithmic approach evaluates the quality features of an e-book, especially its readability, security, and comprehension. These qualitative aspects are explored by parsing the e-book test and retrieving various information such as the ideas explained in the e-book. Characteristic features are evaluated based on numerical values [21].Zhang et al. developed a new analysis method, the latent Dirichlet allocation topic model, and used it to carry out technology evaluation and road mapping analysis of the Blockchain field based on patent data. Their results describe the current state of technology development and predict future development trends. The new analysis method is based on technology life cycle theory, the latent Dirichlet allocation topic model, and text similarity calculation, enabling a more effective analysis of the status of R&D in the Blockchain field [22].Alotaibi analyzed the data clustering problem. Symmetry can be considered a precare aspect that can improve shapes and objects, as well as reconstruction and recognition. Symmetric-based clustering methods look for symmetrical clusters with respect to their centers. Furthermore, the K-means algorithm is considered to be one of the most common clustering methods. It is easy to implement and can run quickly in most situations. However, it was initiated by sensitivity and it could easily get caught up in local targets. The Tabu Search algorithm is a standard universal optimization technique, while Adaptive Search Memory is a key component of TS [23].An efficient model Heap Bucketization-Anonymous has been proposed to balance privacy and usability with multiple sensitivity properties. The Heap Packetization-Anonymous model used anatomy to divide the data vertically into (1) semi-identifier table and (2) sensitivity attribute table. Semi-identifier is anonymized by enabling Q-anonymity and Sensitivity attributes are anonymized by the use of slicing and hip bucketing [24].Alotaibi et al.’s study provided the characteristics of the recommendations are analyzed and the suggestion mining extraction process for categorizing the recommended sentences from online customer reviews is provided. Classification using the word-embedding approach via the XG Boost classifier is used. The two datasets used in this experiment are related to online hotel reviews andMicrosoft Windows App Studio discussion reviews. F1, accuracy, recall, and accuracy scores are calculated [25].Rajendran et al. focused on the design of a big data classification model using chaotic pigeon inspired optimization (CPIO)-based feature selection with an optimal deep belief network (DBN) model. This model is executed in the Hadoop MapReduce environment to manage big data. At first, the CPIO algorithm is applied to select a useful subset of features the Harris hawks optimization (HHO)-based DBN model that is derived as a classifier to allocate appropriate class labels. The design of the HHO algorithm to tune the hyper parameters of the DBN model assists in boosting the classification performance [26].Alsufyani et al. presented an intelligent data management framework for a cyber-physical system (IDMF-CPS) with machine-learning methods. The training approach based on two enhanced training procedures, running concurrently to upgrade the processing and communication strategy and the predictive models, is contained in the suggested reasoning modules [27].Li et al. contributed to the clustering of natural language and meet the need for dynamic updating of the knowledge system. Its method of extracting dynamic knowledge based on sentence clustering recognition using a neural network-based structure. The process of transitioning from natural language papers to semantic knowledge systems is examined considering the problems related to sentence vectorization. It examines sentence vectorization properties using various basic definitions, judgment theorems, and post-processing components [28, 29].Table1 shows the comparison of learning the data leakage in the secrecy policy of different social networks like twitter, Facebook, Google+, Orkut, and My space.Table 1
Comparison of learning the data leakage in the secrecy policy of different social networks.
Name of the social networkFriendsStreamingLikePhoto, video and other tagCommentGroup memberTwitterSensitivity data leakage may occurSensitive data cannot be leakedSensitive data cannot be leakedNot implementedNot implementedSensitivity data may leakFacebookSensitivity data leakage may occurSensitivity data may leakSensitivity data may leakNot implementedSensitivity data may leakSensitivity data may leakGoogle+Sensitivity data leakage may occurSensitive data cannot be leakedSensitive data cannot be leakedSensitive data cannot be leakedSensitivity data may leakNot implementedOrkutSensitivity data always leaksSensitive data cannot be leakedSensitivity data may leakSensitivity data may leakSensitivity data may leakSensitivity data may leakMy spaceSensitivity data leakage may occurSensitive data cannot be leakedSensitivity data may leakSensitivity data may leakSensitivity data may leakNot implemented


## 3. Methodology

With the fast development of Internet technology, huge amounts of data can be accessed from online servers. Websites are the major repository of data that often store information in text form. Advances in modern techniques of text analysis have led to the extraction of unstructured data from the online server reaching large data age [30]. To overcome this limit, many researches have been conducted in recent times to do text mining or text analysis from a large database.Text mining is the technique of retrieving information from an unstructured database. It is linked to extract web content using hypertext from the given documents. To create the data from unstructured data, text was first converted to a manageable form of data. Text representation models such as N-gram and LSTMN are used to sort data into structures. Text processing provides valuable insights into customer emails, survey comments, social media, call logs, posts, and other sources of text linked data of the method of text processing are homogeneous data processing, in which the text miner focuses on the text in its place of the structured data. Natural language processing (NLP) is a branch of artificial intelligence that enables computers to understand, interpret, and manipulate human language. NLP attracts from many disciplines, including computer science and computational linguistics, with the aim of filling the gap for human communication and computer understanding.Old-fashioned NLP models were created using rule-based or statistical methods. Studies on the intensity of data analysis in dealing with low-supervised in deep learning models and huge data sets. Neural networks are also used in huge data sets, whose process data are set up functionally. Figure1 shows the block diagram of mined text data from Facebook accounts.Figure 1
Block Diagram of mined text data from Facebook accounts.The text analysis process on Facebook data begins with the extraction of text data. Text analysis is used to control the flow of shared data to users based on the relationship between shared content and the user account received. It extracts text data from the Facebook account to identify the compatibility relationship between the shared post and the user profile and post sharing history. The extracted text data is then analyzed by Latent Dirichlet Allocation (LDA), N-gram algorithms. The group or clusters designed by this allocation mechanism are processed by the Long-Term Memory Network (LSDM) and it sends the shared post to a specific Facebook user to make a decision from the collected database.


### 3.1. Generative Models for Textlatent Dirichlet Allocation (Lda) Model

In Latent Dirichlet Allocation, K Latent topics correspond to the texts. In vocabulary, every topic is described as a multinomial distribution over the/v/words. The texts are created by sampling a mixture of these latent topics and then sampling words from that sampling mixture [31, 32].More exactly, theN words texts w=w1,…,wN are created by the following procedure. Initially, from a Dirichlet distribution, it is sampled. It is sampledmeans it lies in the (k − 1)-dimensional simplex: θt tis greater than zero, ∑I is equal to zero. Then, for each N words, a topic znɛ1,…,k is sampled from Mult (distribution p(zn = i \ At last, in conditioned znth topic, each word wn is sampled from the multinomial distribution p(w/zn). It is represented as a degree for which the topic is mentioned in the texts. The text probability is defined in the following equation:(1)pw=∫∏n=1N∑zn=1kpwn|zn;βpzn|θpθ;αdθ,where p is represented as Dirichlet, (zn/is represented as multinomial parameterized by and p(wn/zn) is denoted as multinomial over the words. The Latent Dirichlet Allocation (LDA) model is parameterized by the k × /v/matrix, k-dimensional Dirichlet parameters, and these parameters control the k multinomial distributions over words.The latent dirichlet allocation models are not as easy as Dirichlet-multinomial clustering model. In LDA model, the innermost plate comprises onlywn as shown in Figure 2. The latent topic node can be sampled only once for every text; and Dirichlet can be sampled only once for the entire collection. In latent dirichlet allocation model, the Dirichlet is sampled for every text, and within the text, the multinomial latent topic node is sampled repeatedly. Compared to prior distribution, the dirichlet is a component in the probability model over the model parameters [33].Figure 2
LDA Graphical model representation.The boxes are plates described as replicates. The outer plate described as texts, when the inner plate describes the repeated choice of words and topics within a text.Equation (1) is a second interpretation of latent dirichlet allocation. From unigram/multinomial model.pw|θ=∑z=1kpw|zpz|θ Where the unigram models p (the latent dirichlet allocation is the mixture model, and p() provides the mixture weights.


### 3.2. Related Models

The mixture of unigrams model performed with each text is created by a single arbitrary chosen topic:(2)pw=∑z=1k∏n=1Npwn|zpz.From several topics, the LDA model permits several texts, but sometimes fails to capture the possibility that the text shows several topics. Latent Dirichlet Allocation captures this possibility, which can increase the parameter count otherwise for multinomialp (z), having k-1 parameters over the k topics [34, 35], where k is the free parameter for Dirichlet. Another model is Hofmann’s Probabilistic Latent Semantic Indexing (PLSI), which is presented for word ‘w’ and text label “d.” These “d”’ and “w” are conditionally independent in the following equation.(3)pd,w=∑z=1kpw|zpz|dpd.


### 3.3. Inference and Learning

The inference for the learning problems for Latent dirichlet allocation is described by examining the likelihood contribution created through a single text. Letzni = 1 iff zn is the ith topic and wnj = 1, if wn is the jth word. Let it present the pw3=1|zi=1,andw=w1,…….,wN,z=z1,……,ZN modifying the (1), are given by(4)pw;α,β+=∏∑iαi∏i∏αi∫θi∏i=1kθiαi−1∏n=1N∑i=1k∏j=1vθiβi,jwn5dθ.The fourth equation is denoted as hypergeometric function that is unfeasible to calculate accurately. For large text collections, the learning algorithms and fast inference are required and have to be used as several techniques to estimate the likelihood in equation (4). Various approximations have to be used for the log-likelihood.(5)logpw;α,β=log∫θα∑zpw|z;βpz|θpθ;αqθ,z;γ,φqθ,z;γ,φdθ≥Eqlogpw|z;β+logpz|θ+logpθ;α−logqθ,z;γ,∅.


### 3.4. LDA Linear Discriminant Analysis of Text in Social Media

Figure3 shows LDA analysis for 4posts entered by four different users on social media. The topics are as follows: “Truth and loyalty,” “Describe a person characteristics,” “why I love myself?” and “The Night life of a Man.” In the first topic the words “tho,” “thy” and “thee” were used repeatedly to emphasize on a subject. The other words which were used to describe the subject were “love,” “fair,” “self,” “make,” and “truth.”Figure 3
LDA model representation of words used repeatedly in post.The second topic describes the person with words such as “sweet,” “nor,” “dost,” which deals with other person and his attributes. The third topic shows the words used to describe oneself. The words such as “love,” “mine,” “doth,” and “eyes” were used repeatedly. Similarly, the words majorly used to describe “The Night life of a Man” includes “thine,” “shall,” “still,” “beauty,” and “time.” The words which describe person on second scale includes “live,” “praise,” “age,” “hours” and “death.” The LDA model provides a comprehensive words used in a large volume of data. In addition, the most used words are highlighted and the corresponding secondary words are shown with smaller fonts. However, the LDA model performs well when the database is small.


## 3.1. Generative Models for Textlatent Dirichlet Allocation (Lda) Model

In Latent Dirichlet Allocation, K Latent topics correspond to the texts. In vocabulary, every topic is described as a multinomial distribution over the/v/words. The texts are created by sampling a mixture of these latent topics and then sampling words from that sampling mixture [31, 32].More exactly, theN words texts w=w1,…,wN are created by the following procedure. Initially, from a Dirichlet distribution, it is sampled. It is sampledmeans it lies in the (k − 1)-dimensional simplex: θt tis greater than zero, ∑I is equal to zero. Then, for each N words, a topic znɛ1,…,k is sampled from Mult (distribution p(zn = i \ At last, in conditioned znth topic, each word wn is sampled from the multinomial distribution p(w/zn). It is represented as a degree for which the topic is mentioned in the texts. The text probability is defined in the following equation:(1)pw=∫∏n=1N∑zn=1kpwn|zn;βpzn|θpθ;αdθ,where p is represented as Dirichlet, (zn/is represented as multinomial parameterized by and p(wn/zn) is denoted as multinomial over the words. The Latent Dirichlet Allocation (LDA) model is parameterized by the k × /v/matrix, k-dimensional Dirichlet parameters, and these parameters control the k multinomial distributions over words.The latent dirichlet allocation models are not as easy as Dirichlet-multinomial clustering model. In LDA model, the innermost plate comprises onlywn as shown in Figure 2. The latent topic node can be sampled only once for every text; and Dirichlet can be sampled only once for the entire collection. In latent dirichlet allocation model, the Dirichlet is sampled for every text, and within the text, the multinomial latent topic node is sampled repeatedly. Compared to prior distribution, the dirichlet is a component in the probability model over the model parameters [33].Figure 2
LDA Graphical model representation.The boxes are plates described as replicates. The outer plate described as texts, when the inner plate describes the repeated choice of words and topics within a text.Equation (1) is a second interpretation of latent dirichlet allocation. From unigram/multinomial model.pw|θ=∑z=1kpw|zpz|θ Where the unigram models p (the latent dirichlet allocation is the mixture model, and p() provides the mixture weights.


## 3.2. Related Models

The mixture of unigrams model performed with each text is created by a single arbitrary chosen topic:(2)pw=∑z=1k∏n=1Npwn|zpz.From several topics, the LDA model permits several texts, but sometimes fails to capture the possibility that the text shows several topics. Latent Dirichlet Allocation captures this possibility, which can increase the parameter count otherwise for multinomialp (z), having k-1 parameters over the k topics [34, 35], where k is the free parameter for Dirichlet. Another model is Hofmann’s Probabilistic Latent Semantic Indexing (PLSI), which is presented for word ‘w’ and text label “d.” These “d”’ and “w” are conditionally independent in the following equation.(3)pd,w=∑z=1kpw|zpz|dpd.


## 3.3. Inference and Learning

The inference for the learning problems for Latent dirichlet allocation is described by examining the likelihood contribution created through a single text. Letzni = 1 iff zn is the ith topic and wnj = 1, if wn is the jth word. Let it present the pw3=1|zi=1,andw=w1,…….,wN,z=z1,……,ZN modifying the (1), are given by(4)pw;α,β+=∏∑iαi∏i∏αi∫θi∏i=1kθiαi−1∏n=1N∑i=1k∏j=1vθiβi,jwn5dθ.The fourth equation is denoted as hypergeometric function that is unfeasible to calculate accurately. For large text collections, the learning algorithms and fast inference are required and have to be used as several techniques to estimate the likelihood in equation (4). Various approximations have to be used for the log-likelihood.(5)logpw;α,β=log∫θα∑zpw|z;βpz|θpθ;αqθ,z;γ,φqθ,z;γ,φdθ≥Eqlogpw|z;β+logpz|θ+logpθ;α−logqθ,z;γ,∅.


## 3.4. LDA Linear Discriminant Analysis of Text in Social Media

Figure3 shows LDA analysis for 4posts entered by four different users on social media. The topics are as follows: “Truth and loyalty,” “Describe a person characteristics,” “why I love myself?” and “The Night life of a Man.” In the first topic the words “tho,” “thy” and “thee” were used repeatedly to emphasize on a subject. The other words which were used to describe the subject were “love,” “fair,” “self,” “make,” and “truth.”Figure 3
LDA model representation of words used repeatedly in post.The second topic describes the person with words such as “sweet,” “nor,” “dost,” which deals with other person and his attributes. The third topic shows the words used to describe oneself. The words such as “love,” “mine,” “doth,” and “eyes” were used repeatedly. Similarly, the words majorly used to describe “The Night life of a Man” includes “thine,” “shall,” “still,” “beauty,” and “time.” The words which describe person on second scale includes “live,” “praise,” “age,” “hours” and “death.” The LDA model provides a comprehensive words used in a large volume of data. In addition, the most used words are highlighted and the corresponding secondary words are shown with smaller fonts. However, the LDA model performs well when the database is small.


## 4. Result and Discussion

In the present period, information is an important asset of an individual, depending on the condition in which the individual lives, and the information that is shared with others in the same way. When a person shares his information on a social website, his followers also benefit from the information, which is an important issue on the social website. Facebook and Twitter are currently sharing more information about two of the most admired social areas in the world. The code that is used to convey differing information on that social website is a picture, video, audio, animation, information, program, and emotion that can be written in a variety of languages. All types of information are shared based on 10 types of ideas such as Economy, National, Sports, Arts, Politics, Opinion, Local News, Technology, Lifestyle, Entertainment, Social Learning, Team, Travel, and Custom. Through the website, various social websites create a variety of groups that narrow. Bay and Sell, Close Friends, Club, Event and Plans, Family, Video Game, Neighbors, Parents, Project, School or College, Study. They exchange information between these groups and different members of the group, and they are a way of providing a wide variety of information.


### 4.1. Data Analytics Based on LDA

Then the information they share is of importance. For example, if there are 2 lakh members in a group, the information shared between them is positive, and as a result, they create an appearance of good, and a negative one in the same group. When information is shared, it creates a social evil. This will provide a good result for analyzing information and whether they should be analyzed or if any of them are harmful or should be shared. Similarly, if a third of people on the website break their account and share a false message with others, they will have a huge impact on the community. This has resulted in the social website being damaged and an economic loss to the community, which we have proposed to avoid. We consider a frame work to be a good solution.Figure4(a) illiterates the mapping for data analytics based on LDA algorithm. The first layer is information retrieval this layer retrieve the data from social media. The second layer is text summarization, and it is summarizes the text based on predefined rule, the next thread layer is topic modeling, and the fourth one is LDA algorithms.Figure 4
(a) Mapping for data analytics based on LDA. (b) Describe an implicit analysis on LDA.
(a)(b)Information obtained from social websites is stored in a dataset as a weather dataset, which is used to easily analyze information and extract it from words. We break down the words into different groups and explain how many times each word has been used in those groups with an analysis and description of maximum usage which shown in Figure4(b).


### 4.2. Data Analyzed In Parts of the Shared Sentence

By using this method, I have proposed to LDA analyze framework shared information through others; the words in the information are grouped based on the English grammar and in order to understand the simple. In this, we have shown in percentage that the number of words in each sentence is used as nouns or verbs, following the English grammar. This nouns and verbs are a source of the wrong way to convey an opinion or to inform others in the right way. When a user is expressing his opinion to others, some of them have evil intent and are analyzed before he can inform others which are shown in Figures5–7. Additionally, the information is represented in Figures 8 and 9.Figure 5
A collection of information that is most shared on the social website.Figure 6
Analyze a collection of shared posted data about the weather on the social website.Figure 7
A Histogram based on the data analyzed in parts of the shared sentence.Figure 8
Nouns obtained from the analyzed data.Figure 9
Verbs obtained from the analyzed data.Figure8 shows that nouns are obtained from the given data set. The most used nouns in the top of the figure and the least used noun in the bottom of the figure.Figure9 shows that verbs are obtained from the given data set.The most used verbs in top of the figure and least used verbs in bottom of the figure.


### 4.3. Number of Words and Character Count

Table2 shows the number of words or characters involved in text feeds on social websites and count symbols involved in text feeds, and Figure 10 is a graphical representation of the number of words or character involved in text feeds.Table 2
Number of words/character involved in text feeds on social websites.
Symbols involved in text feedsNO. Of words/character involved in text feedsWords1290Characters (including spaces)7265Characters (without spaces)5965Figure 10
Number of words statistics involved in text feeds on social websites.Table3demonstrates an analysis of data according to English grammar based on LDA algorithms, Table 4 displays the most used single word in a document, Table 5 shows the most used double words in a document, and Table 6 shows the most used triple words in a document.Table 3
Analysis of data according to English grammar based on LDA.
Word statisticsWord countCumulativePercentage of cumulativeSyllables2045204551.58Sentences12621713.18Unique words37125429.36Average word length (char)4.62546.60.12Average sentence length (word)10.22556.80.26Monosyllabic words (1 syllable)7493305.818.83Polysyllabic words (≥3 syllables)1793484.84.52Syllables per word1.63486.40.04Paragraph793565.41.99Difficult Words3993964.410.07Table 4
Finding the most used word in a document.
Single keyword wordsFrequencyPercentage of single words (%)Down352.7Reported262Trees241.9Tree191.5Across181.4County171.3Blown161.2mph161.2Wind161.2Inches141.1Table 5
Finding the most used double words in a document.
Double keyword wordsFrequencyPercentage of double words (%)(1) Trees were141.1(2) Were reported141.1(3) Blown down131(4) Reported down131(5) Down in110.9(6) Heat indices110.9(7) Indices of110.9(8) Of 110110.9(9) 110 degrees110.9(10) Degrees or110.9Table 6
Finding the most used triple words in a document.
Triple keyword wordsFrequencyPercentage of triple keywords (%)(1) Heat indices of110.9(2) Indices of 110110.9(3) Of 110 degrees110.9(4) 110 degrees or110.9(5) Trees were reported100.8(6) Were reported down100.8(7) Degrees or greater90.7(8) Or greater heat70.5(9) Greater heat indices70.5(10) Wind gusts of70.5


### 4.4. Most Used Single, Double, and Triple Word

From Figure11, we can note that the word “down” is highly used whereas the word “‘inches”is the least used in the given data set.Figure 11
Percentage of the most used word in a document.From Figure12, we can note that the words “trees were” is highly used double words whereas the words “degrees or” are the least used in the given data set.Figure 12
Percentages of most used double words in a document.From Figure13, we can note that the words “heat indices of” is highly used triple words whereas the words “greater heat indices” are the least used in the given data set.Figure 13
Percentages of most used triple words in a document.The model works perfectly for the given data set and is able to identify parts of speech like nouns, verbs, etc, and also count the number of words, characters, and character spaces.


## 4.1. Data Analytics Based on LDA

Then the information they share is of importance. For example, if there are 2 lakh members in a group, the information shared between them is positive, and as a result, they create an appearance of good, and a negative one in the same group. When information is shared, it creates a social evil. This will provide a good result for analyzing information and whether they should be analyzed or if any of them are harmful or should be shared. Similarly, if a third of people on the website break their account and share a false message with others, they will have a huge impact on the community. This has resulted in the social website being damaged and an economic loss to the community, which we have proposed to avoid. We consider a frame work to be a good solution.Figure4(a) illiterates the mapping for data analytics based on LDA algorithm. The first layer is information retrieval this layer retrieve the data from social media. The second layer is text summarization, and it is summarizes the text based on predefined rule, the next thread layer is topic modeling, and the fourth one is LDA algorithms.Figure 4
(a) Mapping for data analytics based on LDA. (b) Describe an implicit analysis on LDA.
(a)(b)Information obtained from social websites is stored in a dataset as a weather dataset, which is used to easily analyze information and extract it from words. We break down the words into different groups and explain how many times each word has been used in those groups with an analysis and description of maximum usage which shown in Figure4(b).


## 4.2. Data Analyzed In Parts of the Shared Sentence

By using this method, I have proposed to LDA analyze framework shared information through others; the words in the information are grouped based on the English grammar and in order to understand the simple. In this, we have shown in percentage that the number of words in each sentence is used as nouns or verbs, following the English grammar. This nouns and verbs are a source of the wrong way to convey an opinion or to inform others in the right way. When a user is expressing his opinion to others, some of them have evil intent and are analyzed before he can inform others which are shown in Figures5–7. Additionally, the information is represented in Figures 8 and 9.Figure 5
A collection of information that is most shared on the social website.Figure 6
Analyze a collection of shared posted data about the weather on the social website.Figure 7
A Histogram based on the data analyzed in parts of the shared sentence.Figure 8
Nouns obtained from the analyzed data.Figure 9
Verbs obtained from the analyzed data.Figure8 shows that nouns are obtained from the given data set. The most used nouns in the top of the figure and the least used noun in the bottom of the figure.Figure9 shows that verbs are obtained from the given data set.The most used verbs in top of the figure and least used verbs in bottom of the figure.


## 4.3. Number of Words and Character Count

Table2 shows the number of words or characters involved in text feeds on social websites and count symbols involved in text feeds, and Figure 10 is a graphical representation of the number of words or character involved in text feeds.Table 2
Number of words/character involved in text feeds on social websites.
Symbols involved in text feedsNO. Of words/character involved in text feedsWords1290Characters (including spaces)7265Characters (without spaces)5965Figure 10
Number of words statistics involved in text feeds on social websites.Table3demonstrates an analysis of data according to English grammar based on LDA algorithms, Table 4 displays the most used single word in a document, Table 5 shows the most used double words in a document, and Table 6 shows the most used triple words in a document.Table 3
Analysis of data according to English grammar based on LDA.
Word statisticsWord countCumulativePercentage of cumulativeSyllables2045204551.58Sentences12621713.18Unique words37125429.36Average word length (char)4.62546.60.12Average sentence length (word)10.22556.80.26Monosyllabic words (1 syllable)7493305.818.83Polysyllabic words (≥3 syllables)1793484.84.52Syllables per word1.63486.40.04Paragraph793565.41.99Difficult Words3993964.410.07Table 4
Finding the most used word in a document.
Single keyword wordsFrequencyPercentage of single words (%)Down352.7Reported262Trees241.9Tree191.5Across181.4County171.3Blown161.2mph161.2Wind161.2Inches141.1Table 5
Finding the most used double words in a document.
Double keyword wordsFrequencyPercentage of double words (%)(1) Trees were141.1(2) Were reported141.1(3) Blown down131(4) Reported down131(5) Down in110.9(6) Heat indices110.9(7) Indices of110.9(8) Of 110110.9(9) 110 degrees110.9(10) Degrees or110.9Table 6
Finding the most used triple words in a document.
Triple keyword wordsFrequencyPercentage of triple keywords (%)(1) Heat indices of110.9(2) Indices of 110110.9(3) Of 110 degrees110.9(4) 110 degrees or110.9(5) Trees were reported100.8(6) Were reported down100.8(7) Degrees or greater90.7(8) Or greater heat70.5(9) Greater heat indices70.5(10) Wind gusts of70.5


## 4.4. Most Used Single, Double, and Triple Word

From Figure11, we can note that the word “down” is highly used whereas the word “‘inches”is the least used in the given data set.Figure 11
Percentage of the most used word in a document.From Figure12, we can note that the words “trees were” is highly used double words whereas the words “degrees or” are the least used in the given data set.Figure 12
Percentages of most used double words in a document.From Figure13, we can note that the words “heat indices of” is highly used triple words whereas the words “greater heat indices” are the least used in the given data set.Figure 13
Percentages of most used triple words in a document.The model works perfectly for the given data set and is able to identify parts of speech like nouns, verbs, etc, and also count the number of words, characters, and character spaces.


## 5. Conclusion

Text mining is achieved by two methods that are linguistic rules and machine learning systems. Linguistic rules operate based on a rule-based pattern-matching model based on simple Boolean keywords. It is also performed by creating a complex model developed by field experts. Linguistic rules are used for quick analysis. The machine learning approach uses forms of text database. Statistical methods are used to compare documents with each other and generate the most important text information from a large text corpus or database. ML approaches range from simple to complex processes that collect valuable information and unique forms from a provided database. The dataset collected from social media such as Facebook was used to analyze the text to avoid anonymous users unnecessarily sharing the public post. The N-Gram LSDM and LDA algorithms are used for mining the information and generating patterns that compare the connection between the post and the user account. Finally, the LDA algorithm works properly, and we conclude that it is suitable for text mining. It is limited to the English language and it has not been tried with others languages. In the future, we plan to implement this algorithm in other languages and use the Latent Semantic Analysis (LSA) algorithm and make comparisons between LDA and LSA.



---

*Source: 6028739-2022-08-08.xml*