GitHub repository: ssomani7/Apache-Spark-Kafka-POC-s
Primary language: Java
Created: 2019-09-17T07:24:25Z
Description: Implemented Spark machine learning Pipeline on AWS EMR for Collaborative Filtering to recommend users which online educational course they should take based on their viewing history. Target audience found using K-Means clustering over 2 billion data rows. • Using Kafka & Spark Structured Streaming simulated the above models as real time events with a window size of 2 minutes. • House price prediction for California residents based on Kaggle’s 2014/15 dataset using Linear Regression. Narrowed down the customers who were likely to purchase using Logistic Regression & Decision Tree Classifier along with Random Forests to choose the best performing model.