AWS Glue - The Complete Masterclass

Descripción

Learn the latest in AWS Glue - And learn to use it with other AWS resources. In this growing world of data and growing cloud computing, it is necessary to have the core competency in cloud ETL tool also. AWS Glue come with the in built Spark support, Data Quality and data curation using Data brew. The top technology, finance and insurance companies like JPMC, Vanguard, BCBS, Amazon, Capital One, Capgemini, FINRA and more are all using AWS Glue to run their ETL on PetaBytes scale of data everyday. AWS Glue provides server less and scalable ETL solution where scripts can be written in Python, Spark and currently using Ray. It also provides the visual drag and drop options to create the ETL pipelines. As now more and more companies are migrating to cloud it has caused an explosion in demand for this skill! With the mastery of AWS Glue, you now have the ability to quickly become one of the most knowledgeable people in the job market! This course will teach the basics in AWS Glue Data Catalog, AWS Glue Studio, AWS resources such as IAM, SNS, KMS, CloudFormation, CloudWatch and continuing on to learning how to use AWS Glue to build ETL solution for the organization! Once we've done that we'll go through how to use the Glue Data Quality, Glue Streaming and Glue Data Brew ETL pipelines. All along the way you'll have multiple labs to create all the resources and ETL pipelines using AWS console and CloudFormation templates that you put you right into a real world situation where you need to use your new skills to solve a real problem! This course now includes the role playing also to solidify your understanding on the concepts learned. If you're ready to jump into the data engineering world of AWS Glue, this is the course for you!

Lo que aprenderás

• Understanding of AWS Glue Data Catalog and creating AWS Glue Database, Glue Tables and Crawlers
• Using AWS Glue Studio, creating the ETL pipeline along with scheduled triggers, conditional triggers and glue workflow
• KMS, IAM Role, SNS, S3 and other associated AWS resources associated with Glue. Understanding and creation of all the resources
• Understanding of AWS Glue Data Quality and creating the associated Glue ETL pipeline
• Understanding AWS Glue Data Brew , creating the recipe, project and job to curate the dataset
• Understanding the AWS Glue streaming, creating the stream using the Python shell job and load the stream using the Spark streaming
• Different ways AWS Glue job can fail and debugging the failure and fix
• Creating the AWS resources for AWS Glue Pipeline using the AWS console and cloudformation

Requisitos

• Understanding of ETL concepts
• AWS account to perform all the labs
• No cloud experience is required