Cloud and Hybrid TUTORIAL

Configuring On-Premises Connector for Hybrid Data Pipeline on Azure

Updated: 26 Feb 2021

Introduction to On-Premises Connector

Our cloud connectivity solutions provide an innovative on-premises connectivity service to access on-premises data stored behind the firewall from any cloud service. In order to do that you will have to install an On-Premises connector behind your firewall that allows secure and real-time access to in-network data sources from anywhere. To learn more about the On-Premises connector, you can watch this video.

You will need an on-premises connector when you deploy Hybrid Data Pipeline
in your DMZ or a cloud of your choice and you want access data behind the firewall. In this tutorial we will help you configure the On-premises connector when Hybrid Data Pipeline is installed on Azure.

Prerequisites

  1. We assume that you have deployed Hybrid Data Pipeline on Azure by following this tutorial on deploying hybrid data pipeline in Azure.
  2. If you don’t have the installer for Hybrid Data Pipeline’s On-premises connector, you can download it by visiting this page and filling out your details.
  3. Before running the installer, you would have to copy the files in the path
    /path/to/Progress/DataDirect/Hybrid_Data_Pipeline/Hybrid_Server/redist/
    from Hybrid Data Pipeline installation directory to the directory of the On-premises connector installer.

Installing on-premises connector

  1. Double click the installer to start the installation. Click next on the Introduction window.

    On-premises Connector Introduction

    Fig: Hybrid Data Pipeline – On Premises Connector Introduction

  2. On the next screen you would be asked to choose installation directory. You can either keep it as a default or choose your own location.

    On-premises Connector Install Location

    Fig: Hybrid Data Pipeline – On Premises Connector Install Location

  3. On the next screen, choose standard installation if you don’t need any customization. If you need to enable support for Microsoft Dynamics CRM or you would need a proxy to access public internet, choose advanced installation and click Next.

    On-premises Connector Installation Type

    Fig: Hybrid Data Pipeline – On Premises Connector Installation Type


  4. On the next screen, you would have to provide the credentials that you use to authenticate with Hybrid Data Pipeline and a unique connector label and click on Next.

    On-premises Connector Services Information

    Fig: Hybrid Data Pipeline – On Premises Connector Services Information

  5. Your credentials will be verified at this point and if it’s success authenticated, you will be shown Pre-installation summary. Click on Install to start the installation.

    On-premises Connector Pre-Installation

     Fig: Hybrid Data Pipeline – On Premises Connector Pre Install Summary

  6. Click on Done, after the installation is complete to close the installer.

Configuring the On-Premises Installer

  1. Open the Hybrid Data Pipeline On-Premises configuration tool from Start Menu and go to status tab and click on Test connection. You will see that On Premises connector fails to connect to couple of services as shown below.

    Hybrid Data Pipeline Before Status

    Fig: Hybrid Data Pipeline – Before Status

  2. This is because we didn’t configure the firewall and Azure inbound security rules to accept connections on the ports that these services are listening on.
  3. The default ports for On-Premises Access service is 40501 and Notification service is 11280 and 11443 where one doesn’t use SSL and other uses SSL. If you have configured these ports while installing, you should be able to find the values in the configuration file names Onpremise.properties that you copied from redist folder to install On-premises connector.
  4. To open the ports on the VM where Hybrid Data pipeline is installed, open the terminal and run the following commands.
    sudo iptables -I INPUT -p tcp -m tcp --dport 40501 -j ACCEPT
    sudo iptables -I INPUT -p tcp -m tcp --dport 11280 -j ACCEPT
    sudo iptables -I INPUT -p tcp -m tcp --dport 11443 -j ACCEPT
    sudo service iptables save

     

  5. Now open Azure portal and open your VM’s network security group setting. It generally follows the naming format of <VMName>-nsg. Under the network security group settings, go to Inbound security rules and add security rules to accept incoming TCP connections on the above ports. Please find below the screenshot of the settings for your reference.

    HDP - Azure Inbound Security rules

    Fig: Hybrid Data Pipeline – Azure Inbound Security rules

  6. Now open the Hybrid Data Pipeline On-premises configuration tool and test it again. This time connection to all services should be successful as shown below.
Hybrid Data Pipeline – After Configuration

 

Fig: Hybrid Data Pipeline – After Configuration

Next Steps

Now that you have configured the On-Premises connector to work properly with your Hybrid Data Pipeline installation on Azure, feel free to connect your On-Premises data sources to access them in a fast, secure and easiest way than ever that you have ever accessed your data. If you have any questions or have any trouble with the configuration, feel free to contact us.

Connect any application to any data source anywhere

Explore all DataDirect Connectors

Need additional help with your product?

Get Customer Support