Microsoft has recently incorporated the well-renowned Databricks platform into Azure as a 1st class tool. 1st class being natively supported in other tools such as Azure Data Factory. Azure Databricks is a big step forward in the world of big data and data science. It is a unified Apache Spark platform that allows collaboration between Data Scientist and Data Engineers through notebooks that are integrated directly into the application. It allows you to code in  SQL, Scala, R