Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validation, Column extensions, SQL functions, and DataFrame transformations

Computing pagerank with Hadoop MapReduce

Easy parallel map-reduce command line tool

An python implementation of Minimal Mapreduce Algorithms for Apache Spark

MapReduce, Spark, Hadoop, PostgreSQL, Cluster Management

MapReduce example written in python to analyze the feelings of EE UU

Map/Reduce project with Hadoop

🐘 ➕ 🐍 Learning Hadoop with Python

A case study on mining association rules between different factors related to deaths of people in the United States

Lambda to start EMR and run a map reduce job

Big Data Computing

Parallel implementation of Breadth-First Search algorith in Java MapReduce and PySpark. This implementation finds degrees of separation between Twitter Users

A REST-based service that translates the SQL query into MapReduce and Spark jobs. It runs these jobs and provides the JSON object. SQL to MapReduce and Spark translator.

Learn Big Data tools/ framework by doing examples, POC, per projects.

Setup hadoop cluster manually and automatically

Create a Non-Positional InvertedIndex with MapReduce

This repository contains practice assignments of Intro to Hadoop and MapReduce course by Udacity.

Market Basket Analysis using Hadoop MapReduce in Python

Compute TF-IDF with Python & Hadoop Streaming