Patent ID: 11907333

Abstract:
Techniques for grouping system logs using machine learning. The techniques include deriving an input matrix from the logs, in which rows represent the logs and columns represent unique words in the logs. The techniques include applying a TF-IDF algorithm to the input matrix and deriving a TF-IDF matrix from the TF-IDF algorithm output. The TF-IDF matrix reflects how important the unique words are to the respective logs. The techniques include applying a PCA algorithm to the TF-IDF matrix and deriving a PCA matrix having a reduced dimensionality from the PCA algorithm output. The techniques include applying a Cosine Similarity algorithm to the PCA matrix and deriving CS matrices from the CS algorithm output. Each CS matrix reflects the cosine similarity of a respective log relative to all the other logs. The techniques include applying a clustering algorithm to the CS matrices and deriving log groupings from the clustering algorithm output.