Python & Big Data Analysis Course in Dhaka at CDIP, UIU

Introduction to Python and Big Data Analysis

CDIP offers the certificate course on Introduction to Python and Big Data Analysis. Nowadays, Data Science is the most demanding profession in the software industry. To be a Data Scientist one should have a vast knowledge of Big Data and Machine Learning. For both cases, python provides best packages and libraries. In this course, a student will not only learn the basic of python but also the data analysis on Big Data.

Name: Sifatur Rahim

Designation: Senior Data Analyst

Company: Pathao

Experience: 12+ Years

Linkedin: https://bd.linkedin.com/in/sifatur-rahim-59930a33

  • Basic Python Part 1
  • Basic Python Part 2
  • Basic Python Part 3
  • Basic Python Part-4
  • Advanced Python
  • Database (SQL, PostgreSQL) 
  • Pandas
  • Introduction to Google Cloud Console (GCP)
  • Big data (in GCP)
  • Big Data Part 2 (PySpark)

Basic Python Part 1

  • Overview – of Linux (Ubuntu), Linux filesystem
  • Ubuntu command line (terminal) tricks 
  • Environment Setup, Python intro, package manager (pip)
  • Basic Syntax
  • Variable Types
  • Basic Operators
  • Decision Making
  • Loops
  • Numbers, Strings, Lists, Tuples, Dictionary
  • Date & Time variables.
  • Functions
  • Modules
  • Files I/O
  • Exceptions

Advanced Python

  • Classes/Objects
  • Database Access
  • Jupyter notebook

Database

  • Why database
  • PostgreSQL DB
  • Understanding Database design of standard project
  • Standard DB operations

Pandas

Pandas (intro)

  • Understanding pandas dataframe
  • Load dataframe from csv/excel
  • Database connection and execute query
  • Dataframe filtering and storing result to CSV, Excel
  • Kaggle dataset analysis

 Big Data part 1- Concept

  •    General discussion

Big Data Part 2 (PySpark)

Implementation

  •      AWS EMR (and related basics of AWS like ec2, S3)
  •      Run example with Hive, Hue
  •      Example with PySpark (from Kaggle dataset)

Project


Linux as a learning environment is preferred.

  • Students can gain a proper idea about Scripting using Python.
  • Students can Identify Proper objective types and can build Python Modules for reusability.
  • Exception & Error handling in Python.
  • Data Analysis using Python.
  • Students will learn different types of open-source relational database management systems.
  • Big Data Analysis Using Pyspark & Pandas.
  • Students will expect to find the result using Data analysis.
  • Essential skill
  • Terminal/Linux
  • Python
  • A strong background for students in data analysis foundation
  • Essential for abroad study 

Blogs

November 2019

why-learn-python-2019-2020

Why Learn Python- Top Reasons 2020

Python is everywhere. If you haven’t been living under a rock for the past 5-7 years you must have heard of python in one way or another. It is the largest growing high-level and interpreted programming language to-date. Learning Python makes you eligible for even more jobs in the market compared to C++ or Java. The average Python developer in the US (2019) earns an average yearly salary of slightly more than $120k. In addition to the lucrative job [...]