Visually Transform Data in Azure Data Factory or Azure Synapse Analytics

Cathrine Wilhelmsen

Do you need to clean, convert, aggregate, prepare, or transform large amounts of data, but don’t want to spend your time learning a new programming language or writing lots of code? If so, Data Flows in Azure Data Factory or Azure Synapse Analytics could be the tool for you!

By using Data Flows, you can build both simple and complex data transformations in a visual editor. These Data Flows are executed on an underlying spark cluster for optimal scale-out performance for big data analytics, without you having to worry about any nitty-gritty details.

We will look at the capabilities and use cases for Data Flows, where they best fit into your architecture, and how they compare to Power Queries (called Dataflows Gen2 in Microsoft Fabric). Then, we will work through a few different Data Flows demos to dig deeper into the various transformations available, as well as the expression language and how to use the visual expression builder. Finally, we will cover how to orchestrate and monitor our Data Flows, discuss lessons learned, and explain the pricing model.

By the end of this session, you will have a solid understanding of Data Flows in Azure Data Factory and Azure Synapse Analytics. Is this the tool that will take the throne in the epic Battle of the Transformation Tools? Join the final session in this learning path to find out!