Course Curriculum
Module 1 : Introduction to Big Data
• Introduction to Big Data
• Why Big Data?
• Characteristics of Big Data – 4 Vs
• Applications of Big Data
Module 2 : Hadoop Storage – HDFS
• Introduction to Hadoop
• HDFS – Hadoop Distributed file system
• Components of HDFS
• HDFS terminology
• HDFS Federation
• HDFS high availability
• Role of zoo keeper
• Replica pipeline and network distance algorithm
• HDFS Read and Write
• Installing Hadoop in Windows/Mac using Cloudera Quickstart VM
Module 3 : Introduction to Map Reduce – Hadoop’s processing framework
• Introduction to Map Reduce Framework
• Mapper and Reducer APIs
• First Map Reduce program – Word Count
• Map Reduce examples – Inverted Index and Titanic Data Analysis
• Modes of execution
• Job execution in MRV1 VS YARN
• Serialization and Deserialization
• Writable Classes
• Distributed Cache
Module 4 : Hive – Data warehousing infrastructure built on top of Hadoop
• Introduction to Hive
• RDBMS VS Hive
• Hive DDL : Managed Table VS External Table
• Issues with delimiters
• Hive Architecture
• Partitioning – Static and Dynamic
• Bucketing
• Dealing JSON data – using JSON SerDe
• Hive UDF
• Creating Views
• File Formats – Avro, Parquet, ORC
• Optimizing Techniques
Module 5 : No SQL Database – Hbase – Hadoop’s database
• What is a No SQL Database ?
• Why Hbase ?
• Introduction to Hbase
• Hbase high level architecture
• Hbase commands
• Indepth architectural view of Hbase
• Java APIs for Hbase operations
• Bulk Load using Table Mapper and Table Reducer API
• Bulk Load using import TSV tool from a file
Module 6 : Sqoop, Kafka – Data Ingestion tools and Oozie – Hadoop workflow scheduler
• Introduction to Sqoop
• Sqoop Architecture
• Sqoop import and Export with Examples
• Introduction to Oozie
• Oozie workflow
• Oozie Action Tags
• Oozie Parametrization
• Flume – Spooling Directory
• Kafka
Module 7 : Python
• Core programming concepts of Python
Module 8 : Spark Core
• Introduction to Spark
• Why Spark ?
• Applications of Spark
• Spark Terminology
• RDD
• Architecture of Spark
• Transformations and Actions
• RDD Hierarchy
• Lazy Execution
• Shared Variables
• RDD persistence
Module 9 : Spark SQL
• Spark SQL – Data Frames , Data Sets and SQL
• Spark JDBC
Contact : 9160040789/9182622217 mail: [email protected]
• Creating Dataframes from different sources
• Saving a dataframe to a file/table & table with partitioning
• Introduction to Delta Lake
• CRUD operation using delta format
Module 10 : Kafka
• Introduction to Kafka
• Kafka Architecture
• Kafka Use cases
• Creating Producer and Consumer
Module 11 : Spark Streaming
• Spark Streaming with Kafka
Course Duration : 45 Hours
Tools Used :
• Virtual Box
• Cloudera Quick start VM
• Google Cloud Platform/Microsoft Azure for Demo
• Databricks Community Edition
Programming Languages Used :
• J2SE for Map Reduce
• Python for Spark
• SQL for Hive and Spark SQL
Projects :
• Batch Processing of e-commerce data using Hadoop stack
• Real Time Data Ingestion and processing of Social Media data using Hadoop stack
• Telematics Data Analysis
Workshops and Hackathons :
• Realtime ETL process simulation using Hadoop/Spark
• Hackathons on real-time data engineering problem statements
I all the time used to study post in news papers but now as I am a user of net so from
now I am using net for articles, thanks to web.
my web page :: relax
Before writing to disk, data is encoded in the “8 in 14” standard and stored in the form of land and pits. In the embossed plates, the recesses are 1/4 wavelength deep in the material of the reading laser plate (about 125 nm), as a result of the interference of light reflected from the environment and the recesses, the wave is extinguished. The pits are 500 nm wide and the track spacing is 1.6 mm. The differences in light reflection are used by the lens servo to guide the beam along the path and focus it.
https://readygopay.com/2016/03/27/hello-world/
[url=http://advaird.com/]how much is advair[/url]
[url=https://diflucanr.com/]diflucan over counter[/url]
[url=http://toradol.directory/]toradol for headaches[/url]
[url=http://prednisonecsr.online/]otc prednisone cream[/url]
[url=http://accutanemix.online/]generic accutane price[/url]
[url=https://modafinile.online/]modafinil 200 mg price india[/url]
[url=http://modafinile.com/]modafinil 50mg[/url]
[url=http://accutaneiso.online/]accutane for sale australia[/url]
best online pharmacies in mexico: cmq pharma – mexico pharmacies prescription drugs
reputable mexican pharmacies online
http://cmqpharma.com/# mexican rx online
mexican online pharmacies prescription drugs
[url=https://dezithromax.online/]azithromycin 1g for sale[/url]
[url=http://dexamethasonen.com/]dexamethasone 20 mg[/url]
best online pharmacies in mexico: mexico pharmacy – mexico drug stores pharmacies
mexican rx online
https://cmqpharma.online/# buying prescription drugs in mexico online
medicine in mexico pharmacies
[url=http://xlyrica.com/]lyrica medicine price[/url]
[url=https://strattera.company/]atomoxetine strattera[/url]
mexican pharmacy: best online pharmacies in mexico – reputable mexican pharmacies online
purple pharmacy mexico price list [url=http://foruspharma.com/#]mexican pharmaceuticals online[/url] pharmacies in mexico that ship to usa
http://indiapharmast.com/# indian pharmacy paypal
mexican drugstore online: mexico pharmacy – medicine in mexico pharmacies
mexican drugstore online: buying prescription drugs in mexico online – mexican online pharmacies prescription drugs
п»їbest mexican online pharmacies [url=http://foruspharma.com/#]best online pharmacies in mexico[/url] mexican border pharmacies shipping to usa
mexico pharmacy: mexico drug stores pharmacies – buying prescription drugs in mexico
[url=http://flomaxms.online/]noroxin tablets 400mg[/url]
canadian pharmacy victoza: is canadian pharmacy legit – vipps canadian pharmacy
http://indiapharmast.com/# Online medicine home delivery
top 10 pharmacies in india: top online pharmacy india – indian pharmacies safe
best canadian online pharmacy [url=https://canadapharmast.com/#]pharmacy in canada[/url] canadian pharmacy
indian pharmacies safe: best online pharmacy india – online pharmacy india
buying prescription drugs in mexico: pharmacies in mexico that ship to usa – pharmacies in mexico that ship to usa
safe canadian pharmacies: safe canadian pharmacy – northern pharmacy canada
mexican drugstore online [url=https://foruspharma.com/#]mexican drugstore online[/url] mexico pharmacies prescription drugs
https://canadapharmast.online/# escrow pharmacy canada
canadian compounding pharmacy: canada pharmacy online – canada pharmacy online legit
canadian online pharmacy: canadian pharmacy no scripts – best canadian pharmacy to order from
best online pharmacies in mexico: best online pharmacies in mexico – mexican pharmaceuticals online
https://amoxildelivery.pro/# buy cheap amoxicillin online
https://clomiddelivery.pro/# where to buy generic clomid
buy ciprofloxacin [url=https://ciprodelivery.pro/#]ciprofloxacin order online[/url] buy cipro online
amoxicillin for sale online: amoxicillin tablet 500mg – where can you buy amoxicillin over the counter
https://amoxildelivery.pro/# amoxicillin 1000 mg capsule
[url=http://acyclovirmc.com/]acyclovir 500 mg tab[/url]
http://amoxildelivery.pro/# amoxicillin pills 500 mg
paxlovid for sale [url=http://paxloviddelivery.pro/#]Paxlovid buy online[/url] paxlovid cost without insurance
http://amoxildelivery.pro/# amoxicillin 50 mg tablets
buy paxlovid online: paxlovid for sale – paxlovid pharmacy
http://ciprodelivery.pro/# ciprofloxacin generic
can you buy amoxicillin over the counter canada [url=http://amoxildelivery.pro/#]amoxicillin without prescription[/url] prescription for amoxicillin
http://paxloviddelivery.pro/# paxlovid cost without insurance
http://amoxildelivery.pro/# where can i buy amoxicillin without prec
where to get clomid without insurance [url=http://clomiddelivery.pro/#]where can i get clomid without rx[/url] how to buy cheap clomid prices
cipro: п»їcipro generic – ciprofloxacin
https://clomiddelivery.pro/# where buy cheap clomid
http://doxycyclinedelivery.pro/# doxycycline discount
buy amoxicillin 500mg [url=http://amoxildelivery.pro/#]amoxicillin tablet 500mg[/url] amoxicillin 500 mg without prescription
http://doxycyclinedelivery.pro/# doxycycline hydrochloride
purchase amoxicillin 500 mg: order amoxicillin no prescription – amoxicillin 250 mg
[url=https://itretinoin.online/]0.05 retin a cream[/url]
https://paxloviddelivery.pro/# paxlovid generic
http://amoxildelivery.pro/# amoxicillin 500 mg without a prescription
doxycycline 150 mg [url=http://doxycyclinedelivery.pro/#]doxycycline cheap[/url] buy doxycycline tablets
https://paxloviddelivery.pro/# paxlovid pill
where to get generic clomid without rx: can i buy cheap clomid without dr prescription – where to buy generic clomid no prescription
https://clomiddelivery.pro/# clomid buy
purchase doxycycline [url=https://doxycyclinedelivery.pro/#]doxycycline 20 mg[/url] doxycycline 100mg pills
https://amoxildelivery.pro/# amoxicillin cephalexin
https://paxloviddelivery.pro/# Paxlovid over the counter
where to buy amoxicillin over the counter [url=https://amoxildelivery.pro/#]amoxicillin price canada[/url] amoxicillin 500mg capsules price
doxycycline order online canada: doxycycline 250 mg – doxycycline over the counter nz
paxlovid price: paxlovid india – Paxlovid buy online
[url=https://lasixtbs.com/]how much is furosemide 40 mg[/url]