Are you looking at installing Self-Hosted Integration Runtime? Trying to import data from on-premises to Azure? Trying to publish data to on-premises systems using Azure Data Factory?
This tutorial will help you install Self-Hosted IR in Azure Synapse Analytics. It’s also valid for Azure Data Factory.
Self-Hosted Integration Runtime is designed so your on-premises systems are accessible to Azure services. This means they are accessible either when exporting data from on-premises systems to Azure or when exporting data from Azure to on-premises systems.
Installing Azure Self-Hosted Integration Runtime
To start, there are 2 main steps to install IR. In addition, it’s possible to use PowerShell to do it.
- Creating Self-Hosted Integration Runtime in Azure
- Installing IR in an on-premises server / VM and syncing with your Azure Data Factory / Synapse Analytics
Creating Self-Hosted Integration Runtime in Azure
Next, in your Synapse Analytics, go to Manage-> Integration runtimes-> New
Then, select the Self-Hosted option and click “continue.”
After that, define a name and click and click “create.”
In the next screen, don’t forget to copy to the keys into your Key Vault. This allows you to re-install them in case of migration or problems.
At this stage, you have already created a Self-Hosted Integration Runtime, but you need to finish the configuration by installing it in an on-premises server or virtual machine. Let’s go and finish the installation in the server.
You can see that the IR is not available until we finish the next step.
Installing IR in an on-premises server / VM
This server/VM needs to be able to connect to access your source system so you can extract information from the on-premises systems.
You have 2 options:
- Express Setup – For this option, it downloads the installation file with the keys built into the file.
- Manual Setup – For this option, it downloads the installation file without the keys in the file. You need to follow a 2-step process:
- Install Service
- Include Keys to sync to Azure
Let’s follow the manual setup option.
Next, once you download and open the file, you can install the service.
Include Keys to sync to Azure
Now, it’s time to sync with Azure by including keys.
Click “finish” and wait until it syncs with the Azure environment.
In the Azure portal, you can see the status as “available now.”
Configuring Azure Self-Hosted Integration Runtime
Within Azure Self-Hosted IR, you have some configuration options, for example:
- Enable clusters and define the maximum number of concurrent jobs
- Enable auto-update
- Monitor memory, version, and workloads
Enable clusters and define maximum number of concurrent jobs
First, you can enable a cluster. This is highly recommended for production workloads and increasing the limit of concurrent jobs.
Secondly, you can also enable auto update of the Integration Runtime.
Monitor memory, version and workloads
Lastly, if you click the IR monitor icon or go to the Monitor Hub, you can see a summary of the status.
Today, you’ve installed and configured an Azure Data Factory Self-Hosted Integration Runtime. This enables workloads between on-premises systems and Azure without writing a single line of code.
In upcoming blog posts, we’ll continue to explore Azure Data Factory Integration Runtimes and its features.
Please follow Tech Talk Corner on Twitter for blog updates, virtual presentations, and more!
Do you have any questions about Self-Hosted Integration Runtimes? Leave a comment below.