Cloud-Based Email Spam Detection

Project information

Led development of an AWS-hosted spam detection system. Utilized Hive, Pig, PySpark on EMR for ETL. Processed email data stored in S3. Implemented TF-IDF for accurate classification. SQL in Hive for data manipulation and tracking top spam/ham accounts. Integrated bag of words for spam keyword identification. Utilized PySpark to compute TF-IDF scores. Stored results in S3 for analysis. Demonstrated proficiency in cloud services, data mining techniques, and programming languages for effective spam detection.

61 Commits
1 Branch
0 Tags

README

Created on

November 12, 2023

Copy SSH clone URLgit@gitlab.computing.dcu.ie:sudames2/shree_sudame_ca675_assignment.git
Copy HTTPS clone URLhttps://gitlab.computing.dcu.ie/sudames2/shree_sudame_ca675_assignment.git