Configuring On-Premise Connector for Hybrid Data Pipeline on DigitalOcean

Progress DataDirect Hybrid Data Pipeline is an innovative data access service for enterprises and cloud ISVs that is designed to simplify and streamline data integration between cloud, mobile, and on-premises sources through a secure, firewall-friendly integration. One of the main features that we talk about and many of our customers appreciate is how we can connect your on-premise data sources even though they are behind a firewall.

In order to do that you will have to install an On-Premises connector behind your firewall that allows secure and real-time access to in-network data sources from anywhere. To learn more about the On-Premises connector, you can watch this video.

1. We assume that you have deployed Hybrid Data Pipeline on DigitalOcean by following this tutorial and now you are trying to install and configure On-premises connector in your environment.
2. If you don’t have the installer for Hybrid Data Pipeline’s On-premises connector, you can download it by visiting this page and filling out your details.
3. Before running the installer, you would have to copy the files in the path
   /path/to/Progress/DataDirect/Hybrid_Data_Pipeline/Hybrid_Server/redist/
   from Hybrid Data Pipeline installation directory to the directory of the On-premises connector installer.

1. Double click the installer to start the installation. Click next on the Introduction window.

    

   

   Fig: Hybrid Data Pipeline – On Premises Connector Introduction

    

2. On the next screen you would be asked to choose installation directory. You can either keep it as a default or choose your own location.

    

   

    

   Fig: Hybrid Data Pipeline – On Premises Connector Install Location

    

3. On the next screen, choose standard installation if you don’t need any customization. If you need to enable support for Microsoft Dynamics CRM or you would need a proxy to access public internet, choose advanced installation and click Next.

    

   

   Fig: Hybrid Data Pipeline – On Premises Connector Installation Type

    

4. On the next screen, you would have to provide the credentials that you use to authenticate with Hybrid Data Pipeline and a unique connector label and click on Next.

    

   

   Fig: Hybrid Data Pipeline – On Premises Connector Services Information

    

5. Your credentials will be verified at this point and if it’s success authenticated, you will be shown pre-installation summary. Click on Install to start the installation.

 Fig: Hybrid Data Pipeline – On Premise Connector Pre-Install Summary

1. Open the Hybrid Data Pipeline On-Premises configuration tool from Start Menu and go to status tab and click on Test connection. You will see that On Premises connector fails to connect to couple of services as shown below.

    

   

   Fig: Hybrid Data Pipeline – Before Status

2. This is because we didn’t configure the firewall to accept connections on the ports that these services are listening on.
3. The default ports for On-Premises Access service is 40501 and Notification service is 11280 and 11443 where one doesn’t use SSL and other uses SSL. If you have configured these ports while installing, you should be able to find the values in the configuration file names Onpremise.properties that you copied from redist folder to install On-premises connector.
4. To open the ports on the VM where Hybrid Data pipeline is installed, open the terminal and run the following commands.

    

   sudo iptables -I INPUT -p tcp -m tcp --dport 40501 -j ACCEPT
   sudo iptables -I INPUT -p tcp -m tcp --dport 11280 -j ACCEPT
   sudo iptables -I INPUT -p tcp -m tcp --dport 11443 -j ACCEPT
   sudo service iptables save

    

5. Now open the Hybrid Data Pipeline On-premises configuration tool and test it again. This time connection to all services should be successful as shown below.

Fig: Hybrid Data Pipeline – After Configuration

Now that you have configured the On-Premises connector to work properly with your Hybrid Data Pipeline installation on DigitalOcean, feel free to connect your On-Premises data sources to access them in a faster, more secure and easier way than ever before. If you have any questions or have any trouble with the configuration, feel free to leave comments below or contact support.