Configuring On-Premises Connector for Hybrid Data Pipeline on Amazon Lightsail

Progress DataDirect Hybrid Data Pipeline is an innovative data access service for enterprises and cloud ISVs that is designed to simplify and streamline data integration between cloud, mobile, and on-premises sources through a secure, firewall-friendly integration. One of the main features that we talk about and many of our customers appreciate is how we can connect your on-premises data sources even though they are behind a firewall. To do that you must install an On-Premises Connector behind your firewall that allows secure and real-time access to in-network data sources from anywhere.

As you can deploy Hybrid Data Pipeline anywhere in the world, this tutorial will help you configure the On-Premise Connector to work properly your Amazon Lightsail installation.

1. We assume that you have deployed Hybrid Data Pipeline on Amazon Lightsail by following this tutorial and now you are trying to install and configure the On-Premises Connector in your environment.
2. If you don’t have the installer for Hybrid Data Pipeline’s On-Premises Connector, you can download it by visiting this page and filling out your details.
3. Before running the installer, you would have to copy the files in the path
   /path/to/Progress/DataDirect/Hybrid_Data_Pipeline/Hybrid_Server/redist/
   from Hybrid Data Pipeline installation directory to the directory of the On-Premises Connector installer.

1. Double click the installer to start the installation. Click next on the Introduction window.


2. On the next screen, you would be asked to choose installation directory. You can either keep it as a default or choose your own location.



3. On the next screen, choose standard installation if you don’t need any customization. If you need to enable support for Microsoft Dynamics CRM or you would need a proxy to access public internet, choose advanced installation and click Next.



4. On the next screen, you would have to provide the credentials that you use to authenticate with Hybrid Data Pipeline and a unique connector label and click on Next.



5. Your credentials will be verified at this point and if it’s success authenticated, you will be shown Pre-installation summary. Click on Install to start the installation.



6. Click on Done, after the installation is complete to close the installer.

1. Open the Hybrid Data Pipeline On-Premise configuration tool from Start Menu and go to status tab and click on Test connection. You will see that On Premise connector fails to connect to couple of services as shown below.


2. This is because we didn’t configure the Lightsail inbound firewall rules to accept connections on the ports that these services are listening on.
3. The default ports for On-Premise Access service is 40501 and Notification service is 11280 and 11443 where one doesn’t use SSL and another uses SSL. If you have configured these ports while installing, you should be able to find the values in the configuration file names Onpremise.properties that you copied from redist folder to install On-premise connector.
4. To open the ports, go to the Amazon Lightsail portal, then on your instance go to the Networking tab and allow incoming connections on the ports mentioned in the last step as shown.


5. Now open the Hybrid Data Pipeline On-premise configuration tool and test it again. This time connection to all services should be successful as shown below.

Now that you have configured the On-Premise connector to work properly with your Hybrid Data Pipeline installation on Amazon Lightsail, feel free to connect your On-Premises data sources to access them in a faster, more secure and easier way. To learn more about Progress DataDirect Hybrid Data Pipeline, you can visit this page or watch this short video overview.