Pig

CA675 Cloud assignment to perform spam detection with TF IDF using mapreduce Author : Nirav Patel (23265654)

This project is for checking for ham and spam of the top 10 accounts based on scores/posts and finding the TF-IDF values of the words of the top 10 ids of the ham and spam dataset.

This project is to create a spam detection system in Hadoop. In this project, I have also calculated the Tf-Idf of the top 10 keywords in the top 10 Spam and Ham Accounts.

Spam and Ham detection system using Hadoop and Hive on Google Cloud Instance