Build High Availability Two Nodes for Self-Host Integration Runtime

Lab preparation

Create ADF and two Virtual Machines from your Azure Portal.

Quickstart: Create a data factory by using the Azure Data Factory UI
Quickstart: Create a Windows virtual machine in the Azure portal

In my example, I have created two VMs, one named as Self-Host and another named as Self-Host2, install Chrome to both VMs.

Please also build two hosts from your VM as well.

Setting up a self-hosted integration runtime on one VM

To create and set up a self-hosted integration runtime, use the following procedures on Self-Host VM.

Create a self-hosted IR via Azure PowerShell

1. You can use Azure PowerShell for this task. Here is an example:
   Set-AzDataFactoryV2IntegrationRuntime -ResourceGroupName $resourceGroupName -DataFactoryName $dataFactoryName -Name $selfHostedIntegrationRuntimeName -Type SelfHosted -Description “selfhosted IR description”

2. Download and install the self-hosted integration runtime on a local machine.

3. Retrieve the authentication key and register the self-hosted integration runtime with the key. Here is a PowerShell example:

Get-AzDataFactoryV2IntegrationRuntimeKey -ResourceGroupName $resourceGroupName -DataFactoryName $dataFactoryName -Name $selfHostedIntegrationRuntimeName

Create a self-hosted IR via Azure Data Factory UI

Use the following steps to create a self-hosted IR using Azure Data Factory UI.

1. On the Let’s get started page of Azure Data Factory UI, select the Author tab on the leftmost pane.

2. Select Connections at the bottom of the leftmost pane, and select Integration runtimes in the Connections window. Select +New.

3. On the Integration runtime setup window, select Perform data movement and dispatch activities to external computes, and select Continue.

4. Enter a name for your IR, and select Create.

5. Select the link under Option 1 to open the express setup on your computer. Or follow the steps under Option 2 to set up manually. The following instructions are based on manual setup:

a. Copy and paste the authentication key. Select Download and install integration runtime.
b. Download the self-hosted integration runtime on a local Windows machine. Run the installer.
c. On the Register Integration Runtime (Self-hosted) page, paste the key you saved earlier, and select Register.
d. On the New Integration Runtime (Self-hosted) Node page, select Finish.
6. After the self-hosted integration runtime is registered successfully, you see the following window:

Setting up a self-hosted integration runtime on another VM as HA

1. Go to the Integration runtimes, in my example, I have created the IR self-hosttest below.

2. Try to Edit self-hosttest below.

3. After that, directly follow the Option 1 to trigger Express setup, it will help you finishing the installation and registering.
   

4. After installing the IR on the another host Self-Host2, you can see below two host VMs below.

Note: Sometimes, you can see one of the node is pending on Inactive status, you need to make sure the two nodes with the same version such as below.