MapReduce Job Development, RDDs Programming, Medical Data Management, Sales Analysis, And Efficient Data Integration For Big Data Analysis. Spark: Big Data Processing, SQOOP Integration, And Spark Structured Streaming For Real-Time Data.

Real-Time & Batch Data Processing Pipeline

ETL Pipeline for Spar Nord Bank for the analysis of refilling frequency of the ATM's all over the europe

This repository consists of the source code and the screenshots of the output. This project uses Hive, SQL, and Sqoop to perform analysis.

heart data analysis

Import data into the Hive using Sqoop.

[Innopolis University] Big Data Course 2023. Final Project

A python package that lets you sqoop into HDFS/Hive/HBase data from RDBMS using sqoop

Build a data pipeline (using hadoop-hdfs, sqoop, hiveql) for data analysis out of an ambiguous and incomplete instruction.

Built a data pipeline by creating tables in MySQL DB, ingested tables to Hadoop for data warehousing and built HiveQL views. Hive views in Linux VM were connected to Power BI application in Windows to create visualizations.

BigData Engineering Capstone Project with Tech-stack : Linux, MySQL, sqoop, HDFS, Hive, Impala, SparkSQL, SparkML, git

Created a utility to import data from traditional databases to hdfs using sqoop and implemented using bash

A query system for a hypothetical bank scenario

Apache Sqoop tutorial

This is the first project where we worked on apache spark, In this project what we have done is that we downloaded the datasets from KAGGLE where everyone is aware of, we have downloaded loan, customers credit card and transactions datasets . After downloading the datsaets we have cleaned the data . Then after by using new tools and technologies…

Cloudera_Material: Study Material to help people preparing for Cloudera CCA Spark and Hadoop Developer Exam (CCA175). Feel free to collaborate.

A prototype project of big data platform, the source codes of the book Big Data Platform Architecture and Prototype