Firstly, you need to create a Linked Service for ADF to connect to your Databricks Cluster. You can connect to as many clusters as you want.
Then create a pipeline in the ADF, in the Activities list click in the Databricks Option and then drag the attribute of Notebook/Python/Jar as per your need.
Under General Give the Name of the Stem and then under Azure Databricks Option, you need to specify the cluster name(where your notebook resides) which are connected via Linked Service in first step.
Lastly, under the Settings option, you need to navigate to the Databricks Notebook which you want to run and then select it.
With over 2.5 million reviews, we can provide the specific details that help you make an informed software buying decision for your business. Finding the right product is important, let us help.