Lab preparation
Create ADF and two Virtual Machines from your Azure Portal.
Quickstart: Create a data factory by using the Azure Data Factory UI
Quickstart: Create a Windows virtual machine in the Azure portal
In my example, I have created two VMs, one named as Self-Host and another named as Self-Host2, install Chrome to both VMs.
Please also build two hosts from your VM as well.
Setting up a self-hosted integration runtime on one VM
To create and set up a self-hosted integration runtime, use the following procedures on Self-Host VM.
Create a self-hosted IR via Azure PowerShell
-
You can use Azure PowerShell for this task. Here is an example:
Set-AzDataFactoryV2IntegrationRuntime -ResourceGroupName $resourceGroupName -DataFactoryName $dataFactoryName -Name $selfHostedIntegrationRuntimeName -Type SelfHosted -Description “selfhosted IR description” -
Download and install the self-hosted integration runtime on a local machine.
-
Retrieve the authentication key and register the self-hosted integration runtime with the key. Here is a PowerShell example:
Get-AzDataFactoryV2IntegrationRuntimeKey -ResourceGroupName $resourceGroupName -DataFactoryName $dataFactoryName -Name $selfHostedIntegrationRuntimeName
Create a self-hosted IR via Azure Data Factory UI
Use the following steps to create a self-hosted IR using Azure Data Factory UI.
-
On the Let’s get started page of Azure Data Factory UI, select the Author tab on the leftmost pane.
-
Select Connections at the bottom of the leftmost pane, and select Integration runtimes in the Connections window. Select +New.
-
On the Integration runtime setup window, select Perform data movement and dispatch activities to external computes, and select Continue.
-
Enter a name for your IR, and select Create.
-
Select the link under Option 1 to open the express setup on your computer. Or follow the steps under Option 2 to set up manually. The following instructions are based on manual setup:
a. Copy and paste the authentication key. Select Download and install integration runtime.
b. Download the self-hosted integration runtime on a local Windows machine. Run the installer.
c. On the Register Integration Runtime (Self-hosted) page, paste the key you saved earlier, and select Register.
d. On the New Integration Runtime (Self-hosted) Node page, select Finish.
6. After the self-hosted integration runtime is registered successfully, you see the following window:
Setting up a self-hosted integration runtime on another VM as HA
- Go to the Integration runtimes, in my example, I have created the IR self-hosttest below.
- Try to Edit self-hosttest below.
-
After that, directly follow the Option 1 to trigger Express setup, it will help you finishing the installation and registering.
-
After installing the IR on the another host Self-Host2, you can see below two host VMs below.
Note: Sometimes, you can see one of the node is pending on Inactive status, you need to make sure the two nodes with the same version such as below.