Big Data on AWS

Duration: 
3 days
Codes: 
AMA-AWS-BD,AWS

Overview

Big Data on AWS introduces you to cloud-based big data solutions such as Amazon Elastic MapReduce (EMR), Amazon Redshift, Amazon Kinesis and the rest of the AWS big data platform.

In this course, we show you how to use Amazon EMR to process data using the broad ecosystem of Hadoop tools like Hive and Hue. We also teach you how to create big data environments, work with Amazon DynamoDB, Amazon Redshift, and Amazon Kinesis, and leverage best practices to design big data environments for security and cost-effectiveness.

This course is delivered through a mix of instructor-led training (ILT) and hands-on labs.

Please note: students are required to bring their own laptop/tablet and power cable for this course.

Audience

This course is intended for:

  • Solutions Architects responsible for designing and implementing big data solutions
  • Data Scientists and Data Analysts interested in learning about big data solutions on AWS

Skills Gained

In this course, participants will learn how to:

  • Fit AWS solutions inside of a big data ecosystem
  • Leverage Apache Hadoop in the context of Amazon EMR
  • Identify the components of an Amazon EMR cluster
  • Launch and configure an Amazon EMR cluster
  • Leverage common programming frameworks available for Amazon EMR including Hive, Pig, and Streaming
  • Leverage Hue to improve the ease-of-use of Amazon EMR
  • Use in-memory analytics with Spark and Spark SQL on Amazon EMR
  • Choose appropriate AWS data storage options
  • Identify the benefits of using Amazon Kinesis for near real-time big data processing
  • Define data warehousing and columnar database concepts
  • Leverage Amazon Redshift to efficiently store and analyse data
  • Comprehend and manage costs and security for Amazon EMR and Amazon Redshift deployments
  • Identify options for ingesting, transferring, and compressing data
  • Use visualisation software to depict data and queries
  • Orchestrate big data workflows using AWS Data Pipeline

Prerequisites

We recommend that attendees of this course have the following prerequisites:

  • AWS Technical Essentials course or equivalent experience
  • Basic familiarity with big data technologies, including Apache Hadoop, MapReduce, HDFS, and SQL/NoSQL querying
  • Complete the Big Data Technology Fundamentals web-based training or have equivalent experience
  • Working knowledge of core AWS services and public cloud implementation
  • Basic understanding of data warehousing, relational database systems, and database design

The supply of this course by DDLS is governed by the booking terms and conditions. Please read the terms and conditions carefully before enrolling in this course, as enrolment in the course is conditional on acceptance of these terms and conditions.

Course Outline

  • Overview of Big Data
  • Ingestion, Transfer, and Compression
  • Storage Solutions
  • Storing and Querying Data on DynamoDB
  • Big Data Processing and Amazon Kinesis
  • Apache Hadoop and Amazon EMR
  • Using Amazon Elastic MapReduce
  • Hadoop Programming Frameworks
  • Processing Server Logs with Hive on Amazon EMR
  • Using Hadoop Streaming on Amazon EMR
  • Streamlining Your Amazon EMR Experience with Hue
  • Running Pig Scripts in Hue on Amazon EMR
  • Spark on Amazon EMR
  • Tables with Spark and Spark SQL on Amazon EMR
  • Managing Amazon EMR Costs
  • Securing your Amazon EMR Deployments
  • Data Warehouses and Columnar Datastores
  • Amazon Redshift and Big Data
  • Optimising Your Amazon Redshift Environment
  • Big Data Design Patterns
  • Visualising and Orchestrating Big Data
  • Using Tibco Spotfire to Visualise Big Data

Day 1

  • Introduction to Apache Hadoop and Amazon EMR

Day 2

  • Processing Chemistry Data Using Hadoop Streaming on Amazon EMR
  • Interactively Creating and Querying Tables with Spark and Spark SQL on Amazon EMR

Day 3

Please note: This is an emerging technology course. Course outline is subject to change as needed.

Related Courses

Thinking about Onsite?

If you need training for 3 or more people, you should ask us about onsite training. Putting aside the obvious location benefit, content can be customised to better meet your business objectives and more can be covered than in a public classroom. It's a cost effective option.

Submit an enquiry from any page on this site, and let us know you are interested in the requirements box, or simply mention it when we contact you.

Upcoming Dates

  • GREEN This class is Guaranteed To Run.
  • SPVC - Self-Paced Virtual Class.
  • Click a Date to Enroll.
Course Location Days Cost Date
London London3 1795 £1795 2019-09-27
Bristol Bristol3 1795 £1795 2019-10-02
Devon Exeter3 1795 £1795 2019-10-02
Midlands Birmingham3 1795 £1795 2019-10-02
Edinburgh Edinburgh3 1795 £1795 2019-10-02
London London3 1795 £1795 2019-10-21
London London3 1795 £1795 2019-10-21
London London3 1795 £1795 2019-11-11
London London3 1795 £1795 2019-11-27
London London3 1795 £1795 2019-11-27
Bristol Bristol3 1795 £1795 2019-12-04
Devon Exeter3 1795 £1795 2019-12-04
Midlands Birmingham3 1795 £1795 2019-12-04
Edinburgh Edinburgh3 1795 £1795 2019-12-04
London London3 1795 £1795 2019-12-11
London London3 1795 £1795 2020-01-09
London London3 1795 £1795 2020-01-09
London London3 1795 £1795 2020-01-15
London London3 1795 £1795 2020-01-15
London London3 1795 £1795 2020-02-24
London London3 1795 £1795 2020-02-24