4.4.0 archive

Note: This version of Hybrid Data Pipeline has reached end of life. These release notes are for reference purposes.

Enhancements

The Hybrid Data Pipeline 4.4 release implements features that simplify the deployment of cluster environments by implementing an enhanced messaging that removes the external dependency upon a Kafka message queue and provides integration with application load balancers in public cloud environments.

Integration with cloud load balancers

Hybrid Data Pipeline has added support for multi-node clusters that integrate with cloud load balancers. Hybrid Data Pipeline supports cloud load balancers that support the Websockets protocol (such as AWS application load balancer and Azure application gateway).

Enhanced Messaging

Hybrid Data Pipeline now has enhanced messaging such that the deployments no longer rely upon a Kafka cluster to support highly available inter-node communication.

Support for OAuth 2.0

Hybrid Data Pipeline now supports OAuth 2.0 authorization for OData API access, in addition to the basic authentication. Customers using client applications or third-party applications like Salesforce Connect and Power BI will be able to invoke Hybrid Data Pipeline OData access endpoints by passing in the required tokens as opposed to storing user credentials in the application.

Support for Installation using Docker image

You can now install a single node Hybrid Data Pipeline server for evaluation purposes using a Docker image. Docker is a tool that makes it easier to deploy and run applications. The use of a Docker image means that no prior machine setup is required. You may choose to use this method if you want to get started without spending time on installation and configuration.

Response File changes

The following properties have been removed from the response file for both console and GUI modes:

• USING_LOAD_BALANCING_YES
• USING_LOAD_BALANCING_NO
• D2C_USING_KAFKA_CONFIG
• D2C_USING_KAFKA_CONFIG_CONSOLE
• D2C_MESSAGE_QUEUE_SERVERS
• D2C_MESSAGE_QUEUE_SERVERS_CONSOLE
• D2C_HDP_CLUSTER_NAME

The following properties have been added to the response file for both console and GUI modes:

• D2C_NO_LOAD_BALANCER (GUI and console): specifies if no load balancer is used.
• D2C_NETWORK_LOAD_BALANCER (or D2C_NETWORK_LOAD_BALANCER_CONSOLE): specifies whether a network load balancer is used.
• DC_CLOUD_LOAD_BALANCER (or D2C_CLOUD_LOAD_BALANCER_CONSOLE): specifies whether a cloud load balancer is used. 

Web UI Enhancements

Limit GetSchema Hybrid Data Pipeline

Users can now configure the additional property Metadata Exposed Schemas in the data source configuration to restrict the schemas they see in the SQL Editor and the OData Editor.

GUID for SQL Server

Added support for exposing GUID data type as a GUID in OData for SQL Server data source.

On-Premises Connector

Simplified the On-premises Connector installation such that the Cloud Access service is no longer installed. Only the single Cloud Connector service will be installed.