ETL using Python: from MySQL to BigQuery

ETL using Python: from MySQL to BigQuery

A course for supercharged analysts

What you’ll learn

  • Connect to MySQL using Python
  • Connect to BigQuery using Python
  • ETL data from MySQL to BigQuery using Python
  • Setting up their environment to use Python with MySQL and BigQuery

Requirements

  • Python installed (e.g. virtual environment, anaconda, etc…)
  • Familiarity with SQL
  • Familiarity with Python
  • GCP Account for BigQuery Access
  • An IDE like VS Code or PyCharm

Description

This is a direct and to the point course that will get you quickly ETL’ing data from MySQL to BigQuery.
The lessons in this course are broken out into short How-Tos. Therefore you can take this course over the weekend and be ready to show off your skills on Monday morning!

Things that we will cover:
  • Setup
    • Setting up a GCP Account
    • Credential and Authentication for security
    • Python Environment Setup
  • Extract
    • Use Python to connect to MySQL
    • Use Python’s pandas to export data
    • Python library usage for saving files to file paths
  • Transform
    • Use Python functions to transform data
    • Learn how to use Python pandas to transform data
    • Use inline SQL during Extract for data transformation
  • Load
    • Use the BigQuery Python library
    • Connect to BigQuery
    • Load data to BigQuery
    • Incremental Loads vs Truncate and Load
    • Other data handling options during Load
After taking this course, you’ll be comfortable with the following pretty cool things:
  • Connect to MySQL using Python
  • Learn how to obscure your database credentials so you’re not exposing them in your code
  • Usage of the os module for the purpose of saving files and hard coding fewer things.
  • Use both Python and the pandas library to transform data on the fly during the Transformation phase of your ETL
  • Learn how to use GBQ’s modules/libraries to make the loading of the data a very easy, straightforward task
Have fun, enjoy and keep growing!

Who this course is for:

  • Business Intelligence Analysts
  • Data Analysts
  • Beginner Data Engineers
  • Beginner Software Developers
  • Data Power Users

Last updated: 9/2021 | Size: 1 GB
Click to get:
Source: https://www.udemy.com/course/etl-using-python-mysql-to-bigquery/


MySQL Database Management System using MySQL. MySQL for ALL!
MySQL Database Management System using MySQL. MySQL for ALL!
05.05.2020
Python Pyqt5 Database Programming with MySql in Qt Designer
Python Pyqt5 Database Programming with MySql in Qt Designer
07.11.2021
Practical MySQL for Data Analysis
Practical MySQL for Data Analysis
06.20.2021
The Complete Nodejs MySQL Login System
The Complete Nodejs MySQL Login System
04.14.2021

No comments.

Add Commenent
reload, if the code cannot be seen