Microsoft
Perform data science with Azure Databricks
Microsoft

Perform data science with Azure Databricks

This course is part of Microsoft Azure Data Scientist Associate (DP-100) Professional Certificate

Taught in English

Some content may not be translated

 Microsoft

Instructor: Microsoft

6,387 already enrolled

Included with Coursera Plus

Course

Gain insight into a topic and learn the fundamentals

3.3

(46 reviews)

Intermediate level

Recommended experience

25 hours (approximately)
Flexible schedule
Learn at your own pace

What you'll learn

  • Harness the power of Apache Spark and powerful clusters running on the Azure Databricks platform to run data science workloads.

  • Perform machine learning with Azure Databricks. Work with User-Defined Function (UDF) in Azure Databricks

  • Work with DataFrames in Azure Databricks. Use Azure Databricks and the Apache Spark notebook to process large amounts of data

  • Build and query a Delta Lake

Details to know

Shareable certificate

Add to your LinkedIn profile

Assessments

31 quizzes

Course

Gain insight into a topic and learn the fundamentals

3.3

(46 reviews)

Intermediate level

Recommended experience

25 hours (approximately)
Flexible schedule
Learn at your own pace

See how employees at top companies are mastering in-demand skills

Placeholder

Build your Software Development expertise

This course is part of the Microsoft Azure Data Scientist Associate (DP-100) Professional Certificate
When you enroll in this course, you'll also be enrolled in this Professional Certificate.
  • Learn new concepts from industry experts
  • Gain a foundational understanding of a subject or tool
  • Develop job-relevant skills with hands-on projects
  • Earn a shareable career certificate from Microsoft
Placeholder
Placeholder

Earn a career certificate

Add this credential to your LinkedIn profile, resume, or CV

Share it on social media and in your performance review

Placeholder

There are 6 modules in this course

In this module, you will discover the capabilities of Azure Databricks and the Apache Spark notebook for processing huge files. You will come to understand the Azure Databricks platform and identify the types of tasks well-suited for Apache Spark. You will also be introduced to the architecture of an Azure Databricks Spark Cluster and Spark Jobs.

What's included

7 videos5 readings4 quizzes1 discussion prompt

Azure Databricks supports day-to-day data-handling functions, such as reads, writes, and queries. In this module, you will work with large amounts of data from multiple sources in different raw formats. You will also learn to use the DataFrame Column Class Azure Databricks to apply column-level transformations, such as sorts, filters and aggregations. You will also use advanced DataFrame functions operations to manipulate data, apply aggregates, and perform date and time operations in Azure Databricks.

What's included

4 videos10 readings4 quizzes

Azure Databricks supports a range of built in SQL functions, however, sometimes you have to write custom function, known as User-Defined Function (UDF). In this module, you will learn how to register and invoke UDFs. You will also learn how to use Delta Lake to create, append, and upsert data to Apache Spark tables, taking advantage of built-in reliability and optimizations.

What's included

4 videos7 readings6 quizzes

In this module, you will learn how to use PySpark’s machine learning package to build key components of the machine learning workflows that include exploratory data analysis, model training, and model evaluation. You will also learn how to build pipelines for common data featurization tasks.

What's included

4 videos11 readings8 quizzes

In this module, you will learn how to use MLflow to track machine learning experiments and how to use modules from the Spark’s machine learning library for hyperparameter tuning and model selection.

What's included

4 videos5 readings5 quizzes

In this module, you will learn how to use the Uber’s Horovod framework along with the Petastorm library to run distributed, deep learning training jobs on Spark using training datasets in the Apache Parquet format. You will also learn how to use MLflow and Azure Machine Learning service register, package, and deploy a trained model to both Azure Container Instance, and Azure Kubernetes Service as a scoring web service.

What's included

5 videos6 readings4 quizzes1 discussion prompt

Instructor

Instructor ratings
2.4 (8 ratings)
 Microsoft
Microsoft
67 Courses614,334 learners

Offered by

Microsoft

Recommended if you're interested in Software Development

Why people choose Coursera for their career

Felipe M.
Learner since 2018
"To be able to take courses at my own pace and rhythm has been an amazing experience. I can learn whenever it fits my schedule and mood."
Jennifer J.
Learner since 2020
"I directly applied the concepts and skills I learned from my courses to an exciting new project at work."
Larry W.
Learner since 2021
"When I need courses on topics that my university doesn't offer, Coursera is one of the best places to go."
Chaitanya A.
"Learning isn't just about being better at your job: it's so much more than that. Coursera allows me to learn without limits."

New to Software Development? Start here.

Placeholder

Open new doors with Coursera Plus

Unlimited access to 7,000+ world-class courses, hands-on projects, and job-ready certificate programs - all included in your subscription

Advance your career with an online degree

Earn a degree from world-class universities - 100% online

Join over 3,400 global companies that choose Coursera for Business

Upskill your employees to excel in the digital economy

Frequently asked questions