Faster Analytics – Optimizing the Data Engineering Process

Jarid McKenzie

You’ve been running your data engineering ETL processes for years. Now the nightly job isn’t finishing till just before the executives request all their reports. There is no room for error.

You have tried addressing some of the longest running processes, but nothing seems to make the job finish sooner.

Have no fear. There are strategies to making the entire process finish sooner.

This session will review the process of trying to build an analytical environment, discuss ways of organizing the overall process, and provide a few strategies for what to tackle. We’ll discuss the theory of constraints and which specific processes need to be addressed first.

Let’s make it run faster!