← #60 Data Warehousing at Scale, 9. december 2019
Data Engineering with Azure Databricks
Simon Whiteley (Advancing Analytics)
Azure DataBricks brings a Platform-as-a-Service offering of Apache Spark, which allows for blazing fast data processing, interactive querying and the hosting of machine learning models all in one place! But most of the buzz is around what it means for Data Science & AI - what about the humble data engineer who wants to harness the in-memory processing power within their ETL pipelines? How does it fit into the Modern Data Warehouse? What does data preparation look like in this new world?
This session will run through the best practices of implementing Azure DataBricks as your data ingestion, transformation and curation tool of choice.