Accessing on-premises data from the cloud often brings with it many security and availability headaches, but with DataDirect Hybrid Data Pipeline it is now possible to securely access data behind any firewall while still leveraging the benefits of advanced cloud load balancing.
In this tutorial, you’ll learn how to quickly configure Azure’s Application Gateway to achieve both the scalability and reliability of a clustered Hybrid Data Pipeline installation by leveraging our support of the WebSockets protocol.
This document assumes you are already familiar with installing a Hybrid Data Pipeline cluster on 2 or more Azure instances which meet the minimum requirements – including use of an external configuration database and shared storage. It also assumes familiarity with configuring VPCs, Networking and basic administration within the Azure environment.
General Information about installing a single node in Azure Cloud can be found here, while details on a cluster installation can be found in our Installation Guide.
Note that there are a few changes with the DataDirect Hybrid Data Pipeline installation specific to supporting cloud load balancers:
- There is a new option for Load Balancers. Be sure to choose option 3 if using a WebSockets based load balancer such as the Application Load Balancer.

- Make sure to load your PEM file (SSL cert) on the HDP server as well as on the Google Load Balancer. This ensure correct the redistributable files are created to support installation of the On-Premises Connector and hybrid ODBC/JDBC drivers.
- Ensure your “Load Balancing Host Name” matches the hostname in your SSL cert.
- Configure Rules
- Create Path-Based Rule
- Name: HDPRules
- Listener: HTTPS
- Default backend pool: HDPServerPool
- Default HTTP Settings: appGatewayBackendHttpSettings
- Add Configuration:
- HDPNode1 (Create one of these rules for EVERY node)
- Name: HDPNode1
- Path: /connect/opa_<hostname provided during HDP install>_40501
- BE SURE TO REPLACE dots with underscores in hostname
- Backend pool: HDPNode1
- HTTP Settings: OPA_Node1
- Notification
- Name: Notification
- Path: /connect/X_DataDirect_Notification_Server
- HTTP Settings: Notification_Pool

- Delete default listener
- appGatewayHttpListener on port 80 can be removed.
- Delete default backend pool
- appGatewayBackendPool
- Add the front-end IP address of the Application Gateway to DNS as an A-Record. This will vary depending on where your DNS records are managed.
We hope this tutorial assisted in creating a cloud-based solution to OData enable both your on-premises and cloud data sources using Progress Hybrid Data Pipeline and Azure’s Application Gateway. Now you can have security, scalability and reliability all together in a single data access solution which lets you bring sources such as Oracle, Postgres, MySQL, DB2 and SQL Server out from behind the firewall. If you have any question, please feel free to contact us.