Data Analysis Using Spark SQL and Hive

Data Analysis Using Spark SQL and Hive

Overview/Description
Target Audience
Prerequisites
Expected Duration
Lesson Objectives
Course Number
Expertise Level

Overview/Description
In this course you will learn about performing data analysis using Spark SQL and Hive. It is one in a series of courses that prepares learners for exam 70-775: Perform Data Engineering on Microsoft Azure HDInsight.

Target Audience
IT professionals who implement and work with big data analytics and engineering workflows and use open-source technologies; IT professionals preparing for Microsoft exam 70-775

Prerequisites
None

Expected Duration (hours)
0.8

Lesson Objectives

Data Analysis Using Spark SQL and Hive

start the course

describe Jupyter and Apache Zeppelin

merge DataFrames using Spark SQL

describe Apache Parquet

manage interactive Livy sessions

describe what interactive querying is and how its used with Hive

use Ambari Views

use HiveOL

describe how to parse files such as CSV files with Hive

use ORC for caching

use Hive tables

use Zeppelin to visualize data

use data analysis for Spark SQL

Course Number:
df_mahd_a07_it_enus

Expertise Level
Intermediate