Azure Data Factory Training--Continuous Integration/Delivery
Master Azure Data Factory: Build Real Projects with CI/CD, DevOps & Pipelines – Kickstart Your Data Engineering Career
Lo que serás capaz de hacer
Azure Data Factory Masterclass: Learn ADF with Real Projects, CI/CD & DevOps Learn Azure Data Factory step-by-step with real-world projects and master complex data workflows using ADF — beginner-friendly and regularly updated. Welcome to the Azure Data Factory Masterclass by Step2C Educations , your trusted source for practical and career-focused data engineering content. Whether you're a beginner or an IT professional looking to switch to data engineering, this course will help you learn Azure Data Factory (ADF) from the ground up and build confidence to create complex, production-grade data workflows . This course was first launched in 2020 , and thanks to feedback from thousands of learners, we’ve kept it updated regularly to reflect the latest features, changes, and best practices in the Azure ecosystem . The latest updates include coverage of CI/CD (Continuous Integration and Delivery) , DevOps automation , and real-world data pipeline use cases . This course is taught by Sarafudheen PM , an experienced Data Engineering Trainer and Cloud Consultant with deep expertise in Azure Data Factory , Azure DevOps , Databricks , and data pipeline orchestration . With a passion for making technical topics easy to understand, Sarafudheen has helped thousands of students transition into data engineering roles through real-world project-based teaching . He is also the founder of Step2C Educations , a platform dedicated to helping learners build practical skills in cloud, data, and DevOps technologies. Azure Data Factory is the cloud-based ETL and data integration service that allows you to create data-driven workflows for orchestrating data movement and transforming data at scale . Using Azure Data Factory, you can create and schedule data-driven workflows (called pipelines) that can ingest data from disparate data stores. You can build complex ETL processes that transform data visually with data flows or by using compute services such as Azure HDInsight Hadoop, Azure Databricks, and Azure SQL Database. Additionally, you can publish your transformed data to data stores such as Azure SQL Data Warehouse for business intelligence (BI) applications to consume. Ultimately, through Azure Data Factory, raw data can be organized into meaningful data stores and data lakes for better business decisions. Mastering Power BI: New addition, We have add ne new module to explain power BI dashboard development. In this course, you are going to learn How to Create Free Azure Subscriptions. Why we need the Azure Data Factory. What are the Key Components Of Azure Data Factory? How to create Azure Data Factory Instances, How to create Azure SQL databases How to create tables In Azure SQL databases and insert data into your tables using SQL Server management studio. How to create a Blob Storage Account using the Azure portal. How to create Azure Data Factory Instances. How to create linked services in Azure Data factory. How to create data set in Azure Data factory. Master different types of activities inside Azure Data Factory. Azure Data Factory Custom Email Notifications. Learn to transform your data with mapping Data Flow Learn to prepare your data with Wrangling Data Flow. Github integrations. Devops integrations. Parameterization in Azure Data Factory Data Set and Pipelines. Continuous Integration and Delivery (CI/CD) in Azure Data Factory. Custom email notification in Azure Data factory Slowly changing dimension. Incremental Load in Azure Data factory Azure Cosmos DB Azure Synapse Analytics Dynamic Data masking Mastering Power BI Additional Learning Materials -For DP 203 Exam Preparation.) Azure Mapping Data Flow New Module Why This Course? Beginner-friendly — no prior Azure experience required Project-based — work on real data scenarios Regularly updated — reflects latest Azure ADF changes Taught by an industry expert who explains complex concepts in simple terms Includes CI/CD, DevOps, and automation , not just basics
- Understand what Azure Data Factory (ADF) is and how it fits into cloud data engineering
- Set up your first data pipeline to move and transform data
- Work with different data sources like Azure Blob Storage, Azure SQL, and Data Lake Gen2
- Use best practices to handle complex, real-world ETL workflows
- How To Create Pipelines In Azure Data Factory.
- How To Create Data set & Linked services in Azure Data Factory.
Temario
UNIDAD 1 - Introduction · 4 leccionesUNIDAD 1 - Introduction
UNIDAD 1 - Introduction
- What We Will Learn From This Course ?
- Download Full Resources And Code Used In This Course
- Download data From Github
- How to set up an Azure subscription
UNIDAD 2 - Demo Lab 1: Introductions To Azure Data Factory · 13 leccionesUNIDAD 2 - Demo Lab 1: Introductions To Azure Data Factory
UNIDAD 2 - Demo Lab 1: Introductions To Azure Data Factory
- Introduction To Lab 1
- Create Azure SQL Database
- Access Azure SQL Databases Using Azure Query Editor & SSMS
- Azure SQL Data Base - Create New Tables & Insert Sample Data
- Create A Storage Account
- Connect To Storage Account Using Azure Storage Explore
- Create Azure Data Factory Instance
- Azure Data Factory For The First Time
- Create Linked Service (Connection To Source & Destinations)
- Create Data Set For Source Tables And Destinations Files
- Create Pipeline And Configure Copy Activity (Azure SQL DB To Storage Account)
- Execute Our Pipeline And Monitor Our Pipeline Executions (new)
- Clean Your Azure Resources
UNIDAD 3 - Azure Data Factory Assignment 1 · 11 leccionesUNIDAD 3 - Azure Data Factory Assignment 1
UNIDAD 3 - Azure Data Factory Assignment 1
- Task 1: Check Your Understanding
- Create New Resource Group Called ADF
- How to Create a New Storage Account in Azure.
- What is Azure Data Lake V2
- How to Create a New Data Lake Storage in Azure.
- How to Create an Azure SQL Database.
- How to Create Tables and Insert Data into Azure SQL Database
- How to Create Azure Data Factory Instances and Configure Linked Services
- How to Create Multiple Datasets in Azure Data Factory?
- How to Create a Pipeline with Multiple Copy Activities in Azure Data Factory
- How to Clean Up Resources by Deleting an Azure Resource Group
UNIDAD 4 - How To Use Parameters And Variables In Azure Data Factory · 5 leccionesUNIDAD 4 - How To Use Parameters And Variables In Azure Data Factory
UNIDAD 4 - How To Use Parameters And Variables In Azure Data Factory
- Use Parameter In your Data Set To Create A Dynamic Pipelines-Part 1
- Use Parameter In your Data Set To Create A Dynamic Pipelines-Part 2
- Use Of Variables In Azure Data Factory
- Use Of System Variables In Azure Data Factory
- Use Expressions & Functions In Set Variables Activity
UNIDAD 5 - Azure Data Factory Administrations · 1 leccionesUNIDAD 5 - Azure Data Factory Administrations
UNIDAD 5 - Azure Data Factory Administrations
- Use Of Annotations And User Properties
UNIDAD 6 - Learn Different Control Flow Activities In ADF Part 1 · 9 leccionesUNIDAD 6 - Learn Different Control Flow Activities In ADF Part 1
UNIDAD 6 - Learn Different Control Flow Activities In ADF Part 1
- Understanding Our Requirements
- Use Of Get Metadata Activity
- Use Get Metadata Activity With Azure SQL Server
- How To Use Wait Activity To Delay Our Process
- Use Of ForEach Activity
- Use Of If Condition Activity
- Use Of Delete Activity
- Assignment
- Solutions For Assignment
UNIDAD 7 - Exploring Various Control Flow Activities in Azure Data Factory, Part 1 · 3 leccionesUNIDAD 7 - Exploring Various Control Flow Activities in Azure Data Factory, Part 1
UNIDAD 7 - Exploring Various Control Flow Activities in Azure Data Factory, Part 1
- Introduction To Lab 5
- How To Use ADF Lookup Activity?
- How To Configure Switch Activity
UNIDAD 8 - Real World Project & Use Cases · 11 leccionesUNIDAD 8 - Real World Project & Use Cases
UNIDAD 8 - Real World Project & Use Cases
- Incrementally copy new and changed files based on Last Modified Date
- Difference Between Incremental Load and Full Load (Animation)
- How We Could Implement Incremental Load In ADF (Single Table - Insert Only)
- Create Infrastructure For Incremental Load Demo
- Create Source Tables and Destination Tables
- Create Dataset And Linked services
- Create A Full Load Azure Data Factory
- Implement A Incremental Load In Azure Data Factory
- What is SCD / Slowly changing dimension?
- How To Implement SCD Type 1 In Azure Data Factory?
- Demo: SCD Type 1
UNIDAD 9 - Azure Data Factory Custom Email Notifications · 8 leccionesUNIDAD 9 - Azure Data Factory Custom Email Notifications
UNIDAD 9 - Azure Data Factory Custom Email Notifications
- Introduction To Azure Logic Apps
- Lets Create A Logic Apps To Send A Email
- Create Resources & Data Set
- Invoke Azure Logic Apps Using Azure Data Factory Web Activity
- Pass Custom Message From ADF To Azure Logic App
- Pass System Parameter Values From ADF To Azure Logic Apps
- Configure Azure Data Factory To Send A Failed email notification -Last Activity
- Configure Azure Data Factory To Send A Failed email notification -Any Activity
UNIDAD 10 - Self Hosted Integration Runtime & Data Set Parameters (Lab 3 New Version ) · 6 leccionesUNIDAD 10 - Self Hosted Integration Runtime & Data Set Parameters (Lab 3 New Version )
UNIDAD 10 - Self Hosted Integration Runtime & Data Set Parameters (Lab 3 New Version )
- Introduction To Lab 3
- Create Azure Resources For This Demo
- Create Self Hosted Integration Run Time To Access On-Premise Devices
- Perform Copy Activity Without Parameter
- Create Pipelines With Lookup Activity
- Create Pipelines With Lookup & For Each Activity
UNIDAD 11 - Mapping Data Flow Demo Part 1 · 24 leccionesUNIDAD 11 - Mapping Data Flow Demo Part 1
UNIDAD 11 - Mapping Data Flow Demo Part 1
- Introductions to Mapping Data Flow
- How To Use Data Flow UI Part 1
- How To Use Data Flow UI Part 2
- How To Use Data Flow UI Part 3
- Introduction's To Required Transformations
- Source Transformations: Customer
- Schema drift in Source Transformations
- Source Transformations In Mapping Data Flow: Payments
- Source Transformations: Orders
- Filter Transformations: Restrict Payments Data
- Assignment: Filter Transformations To Restrict Customer Data
- Solutions: Filter Transformations To Restrict Customer Data
- Select Transformations: Select Relevant Columns From Customer Table
- Assignment: Select Relevant Columns From Payments Table
- Solution : Select Relevant Columns From Payments Table
- Select Relevant Columns From Orders Table
- Join Transformations: Join Customers & Orders
- Assignment: Use Join Transformations To Join Customers-Orders With Payments
- Solutions : Use Join Transformations To Join Customers-Orders With Payments
- Remove unwanted columns using Select Transformations
- Use Pivot in Mapping Data Flow
- Sink Transformations In Mapping Data Flow
- Execute Our Data Flow Using Data Flow Activity
- Use Parameters To Make Your Data Flow A Dynamic
UNIDAD 12 - Mapping Data Flow Demo Part 2 · 16 leccionesUNIDAD 12 - Mapping Data Flow Demo Part 2
UNIDAD 12 - Mapping Data Flow Demo Part 2
- New Requirements
- Use Inline Data Set To Read Data Using Source Transformations
- Assignment Union Transformations To Combine Data From Sales NA & Sales SA
- Solutions Union Transformations To Combine Data From Sales Files
- UnPivot Transformations In Azure Data Factory Mapping Data Flow
- Derive New Column Transformations
- Derive New Column Transformations
- Remove Unwanted Columns Using Select Transformations
- Introductions To Lookup Transformations
- Join Employee Details And Sales Details Using Join Transformations
- Summarize Your Data Using Aggregate Transformations
- New Branch Transformations
- Conditional Split Transformation
- Demo Conditional Split Transformations In Mapping Data Flow For Multiple Output
- Use Sink Transformations With Inline Data Set
- Executer Employee Sales Details Mapping Data Flow
UNIDAD 13 - CDC Options in Azure Data Factory Mapping Data Flow · 6 leccionesUNIDAD 13 - CDC Options in Azure Data Factory Mapping Data Flow
UNIDAD 13 - CDC Options in Azure Data Factory Mapping Data Flow
- Introductions To CDC in Mapping Data Flow
- Create Source And Sink For CDC Demo
- Enable CDC at Source - Azure SQL Data Base
- Configure Azure Data Factory Mapping Data Flow To Use Change Data Capture
- Test Change Data Capture Using ADF Mapping Data Flow
- Important: Disable CDC and Change Azure SQL Server Configurations
UNIDAD 14 - Real Time Scenario Based Tasks in Azure Data Factory · 6 leccionesUNIDAD 14 - Real Time Scenario Based Tasks in Azure Data Factory
UNIDAD 14 - Real Time Scenario Based Tasks in Azure Data Factory
- Read Data From Github : Copy Data From An HTTP Endpoint
- Problem And Solutions
- Use Pipeline Variables
- Use Of Pipeline Parameter
- Use Lookup Activity And For Each Activity
- Final Solutions : Lookup ForEach & Copy Activity
UNIDAD 15 - Introduction To GitHub · 6 leccionesUNIDAD 15 - Introduction To GitHub
UNIDAD 15 - Introduction To GitHub
- What We Will Learn From This Module
- How To Create GitHub Account
- How To Create Repository And Files In Your GitHub
- How To Create New Branch
- How To Merge Code Changes From GitHub Feature Branch To Master Branch
- How To Delete A Repository From Your GitHub Account
UNIDAD 16 - Integrate Azure Data Factory With GitHub · 4 leccionesUNIDAD 16 - Integrate Azure Data Factory With GitHub
UNIDAD 16 - Integrate Azure Data Factory With GitHub
- Create A GitHub Repository (Folder) For Azure Data Factory
- Integrate GitHub Repository With Azure Data Factory
- Publish Your changes From Git To Azure Data Factory
- Create Different Feature Branches For New Development & Code Changes
UNIDAD 17 - Integrate Azure Data Factory With Azure DevOps · 4 leccionesUNIDAD 17 - Integrate Azure Data Factory With Azure DevOps
UNIDAD 17 - Integrate Azure Data Factory With Azure DevOps
- Create DevOps Account
- Create Project And Repository In DevOps And Integrate ADF With Azure Devops
- How To Use Master Branch (Collaboration Branch For Publishing Changes To ADF)
- How To Use Devops Feature Branches and Pull Request To Marge your Code Changes
UNIDAD 18 - Access Azure Storage Account Data In A Secure Way (With Azure Key Vault) · 2 leccionesUNIDAD 18 - Access Azure Storage Account Data In A Secure Way (With Azure Key Vault)
UNIDAD 18 - Access Azure Storage Account Data In A Secure Way (With Azure Key Vault)
- How To Use Azure Key Vault To Access Data By Using Connections String
- How To Rotate Keys To Control Your Data Access.
UNIDAD 19 - Continuous Integration & Delivery (CI/CD) in Azure Data Factory · 15 leccionesUNIDAD 19 - Continuous Integration & Delivery (CI/CD) in Azure Data Factory
UNIDAD 19 - Continuous Integration & Delivery (CI/CD) in Azure Data Factory
- Introduction To Continuous Integration & Delivery In Azure Data Factory (CI/CD)
- Create Different Resource Groups For Different Environments
- Create Three Different Storage Account (Development / Production & Test)
- Configure Input & Output Containers For Different Environment
- Create Key Vault To Access Your Date in Secure Way
- Deploy Different Azure Data Factory Instances In Different Environment
- Grant Azure Data Factory To Access Key Vault Secrete (For Three Environment)
- Store Your Storage Account Connection Details Inside Azure Key Vault Secrete
- Create A Demo Pipeline & Test Our Application Execution
- Integrate Azure Data Factory With GitHub Use Feature Branch/Pull Request & Merge
- Create A DevOps Project & Configure Artifacts As GitHub Inside Your New Release
- Create Our First Release To Test Environment
- Use Variable & Variable Group in A Pipeline Release ( For Dynamic Deployment)
- Create Second Release To Test and Production By Using Our Environment Variable
- Automate Our Release Based On ADF Publishing
UNIDAD 20 - Triggers In Azure Data Factory · 7 leccionesUNIDAD 20 - Triggers In Azure Data Factory
UNIDAD 20 - Triggers In Azure Data Factory
- Notes
- Azure Data Factory Triggers :: Introductions
- Scheduled Triggers In Azure Data Factory
- Tumbling Window Trigger in Azure Data Factory
- Trigger Azure Data Factory Based On Blob Event
- How To Use Event Trigger With Parameter
- How To Create Dependent Trigger With Tumbling Window Trigger
UNIDAD 21 - Introductions To Microsoft Fabric · 2 leccionesUNIDAD 21 - Introductions To Microsoft Fabric
UNIDAD 21 - Introductions To Microsoft Fabric
- What Is Microsoft Fabric And Why We should Learn It
- Create Fabric Account Without Using Work Email
UNIDAD 22 - Mastering Power BI · 12 leccionesUNIDAD 22 - Mastering Power BI
UNIDAD 22 - Mastering Power BI
- Introduction To Power BI Project
- Install Power BI
- Data Source
- Import Data Into Power BI
- Fix The Column Issue Using Power Query / Transform Data
- Data Preparation: Deriving New Column/Data Using Add Columns
- Data Preparation: Basic Data Cleaning Using Power BI
- Power BI Visualization: Add Slicers
- Power BI Visualization: Add Cards
- Power BI Visualization: Create a Power BI Pie Chart
- Power BI Visualization: Create A Power BI Bar and column charts
- Power BI Visualization : Map-Based Visualization in Power BI
UNIDAD 23 - Introduction To NoSql & Cosmos DB- How To Access Cosmos From ADF · 4 leccionesUNIDAD 23 - Introduction To NoSql & Cosmos DB- How To Access Cosmos From ADF
UNIDAD 23 - Introduction To NoSql & Cosmos DB- How To Access Cosmos From ADF
- An Introduction To Azure Cosmos DB
- Create an Azure Cosmos DB Database And Save Data
- Execute Query (Query data in your Azure Cosmos DB database)
- Copy Data From Azure SQL To Cosmos DB database Using Azure Data Factory
UNIDAD 24 - Introduction To SSIS & Azure · 4 leccionesUNIDAD 24 - Introduction To SSIS & Azure
UNIDAD 24 - Introduction To SSIS & Azure
- How to Download and Install Visual Studio 2019
- Install SSIS & Azure Feature Pack For SSIS
- Task 1: Upload Data Into Azure Storage Account Using SSIS task
- Task 2: Read Data from Azure Storage Account Using SSIS
UNIDAD 25 - Azure Synapse Analytics · 14 leccionesUNIDAD 25 - Azure Synapse Analytics
UNIDAD 25 - Azure Synapse Analytics
- Introduction To Azure Synapse Analytics
- Demo (Synapse Analytics Studio)
- Create Azure Synapse Analytics
- Create Azure SQL For Demo 1
- Connect To Azure Synapse SQL Pool From SSMS
- Open Synapse Studio
- Create Dedicated SQL Pool
- Create Tables In Your SQL Pool & Execute SQL Statements
- Create Spark Pool Using Synapse Analytics
- Create Notebook and Database Using Spark Pool
- Create OnDemand SQL pool
- Access External Data source and Create External Tables
- Introduction To Demo (Pipelines In Synapse Analytics)
- Create Pipelines In Azure Synapse Analytics
UNIDAD 26 - Additional Data Engineering Learning Materials · 8 leccionesUNIDAD 26 - Additional Data Engineering Learning Materials
UNIDAD 26 - Additional Data Engineering Learning Materials
- Dynamic Data Masking
- Demo: Dynamic Data Masking In Azure
- What Is Azure Storage Account?
- Demo: Azure Storage Account Creations And Uses
- How To Use Storage Explore From Portal
- Storage Explore Desktop Version
- Redundancy In Primary And Secondary Region
- Read Access To Data in The Secondary Region
UNIDAD 27 - Azure Data Engineering Interview Questions · 18 leccionesUNIDAD 27 - Azure Data Engineering Interview Questions
UNIDAD 27 - Azure Data Engineering Interview Questions
- Question 1
- Question 2
- Question 3
- Question 4
- Question 5
- Question 6
- Question 7
- Question 8
- Question 9
- Question 10
- Question 11
- Question 12
- Question 13
- Question 14
- ETL Vs ELT
- Key components Of ADF & SSIS
- Career Check-In: Exploring Your Path in Azure Data Engineering
- Accessing On-Premises Environment in ADF
UNIDAD 28 - Master Different Wrangling Data Flow Transformations in ADF · 4 leccionesUNIDAD 28 - Master Different Wrangling Data Flow Transformations in ADF
UNIDAD 28 - Master Different Wrangling Data Flow Transformations in ADF
- How To Use Wrangling Data Flows in Azure Data Factory (Group By Transformations)
- Common Transformations and Actions In Wrangling Data Flow
- Conditional Columns & Other Common Transformations In Wrangling Data Flow
- Merge Transformations:: Wrangling data flows
UNIDAD 29 - Mapping Data Flow Demo Part 1 (Old Module) · 12 leccionesUNIDAD 29 - Mapping Data Flow Demo Part 1 (Old Module)
UNIDAD 29 - Mapping Data Flow Demo Part 1 (Old Module)
- What Is Mapping data flows In Azure Data Factor 26-12-2022
- Source And Sin in Azure Mapping Data Flow
- Aggregate Transformation In Mapping Data Flow
- Filter Transformations In Mapping Data Flow
- Conditional Split Transformation Demo
- Derived Column Data Transformations
- New Branch Transformations
- Sort Transformations
- Select Transformation
- Use Of Join Transformation & Types Of Join Transformations In ADF
- How To Use Join Transformations In ADF
- Exist And Does not Exist Transformation To Filter Your Data
UNIDAD 30 - Bonus · 1 leccionesUNIDAD 30 - Bonus
UNIDAD 30 - Bonus
- Bonus
Tu certificado lo emite la SEP, no solo una plataforma
Al demostrar la competencia recibes un certificado emitido por la Secretaría de Educación Pública a través del Gobierno del Estado de México: un documento oficial que puedes presentar con confianza ante cualquier empleador o institución.
Tu certificado con INEC
- Lo emite la Secretaría de Educación Pública (SEP), a través del Gobierno del Estado de México
- Documento oficial con folio verificable en línea
- Lo otorga la Universidad Tecnológica Fidel Velázquez
Otras plataformas en línea
- Constancia privada emitida por la misma plataforma
- Solo acredita horas cursadas o asistencia
- Sin respaldo de una autoridad educativa
Tu itinerario, de la inscripción al certificado
- 1
Inscripción con pago único
Pagas $2,800 MXN una sola vez y entras de inmediato al curso.
- 2
Estudias a tu ritmo
30 unidades con videos, lecturas y actividades, disponibles 24/7 durante 12 meses.
- 3
Cuestionarios por unidad
Cuestionarios para comprobar lo aprendido.
- 4
Certificado
Emitido por la SEP a través del Gobierno del Estado de México, con folio verificable.
Un certificado oficial de la SEP
Muestra · verificable por folio y QR
- Emitido por la Secretaría de Educación Pública (SEP), a través del Gobierno del Estado de México. No es una constancia privada: es un documento oficial, y ese respaldo marca la diferencia frente a otras plataformas en línea.
- Contenido impartido por Step2C Education.
- Folio y QR verificables para compartirlo con quien te contrate.
Empieza hoy, a tu ritmo
Un solo pago y acceso inmediato al curso completo durante 12 meses.
- 30 unidades · 240 lecciones · 60 h
- 12 meses de acceso
- Certificado emitido por la SEP (Gob. del Estado de México) con folio verificable
Sobre tu inscripción
¿Cómo es el pago?
Un solo pago de $2,800 MXN. No hay mensualidades ni cargos recurrentes.
¿Cuánto tiempo tengo acceso?
12 meses desde tu inscripción, 24/7, para avanzar a tu ritmo.
¿Quién imparte el contenido?
El curso es impartido por Step2C Education; INEC gestiona tu inscripción, evaluación y certificado.
¿Qué pasa cuando vence mi acceso?
Puedes renovar tu cuenta tú mismo desde la plataforma, sin trámites ni esperas.
