Apache Spark SQL

Progress DataDirect for ODBC for Apache Spark SQL Wire Protocol Driver

An asterisk (*) indicates support that was added in a hotfix or software patch subsequent to a release.

Version 8.0.2

Operating System Certifications
  • Certified with SUSE Enterprise Server 15*
    Driver version 08.01.0427 (B0547, U0390)
  • Certified with Ubuntu Linux 18.04*
    Driver version 08.01.0427 (B0547, U0390)
  • Certified with Red Hat Enterprise 8.0*
    Driver version 08.01.0427 (B0547, U0390)
  • Certified with Spark SQL 2.2*
    Driver version 08.01.0207 (B0293, U0193)
  • Certified with Red Hat Enterprise 7.3*
    Driver version 08.01.0169 (B0259, U0174)
  • Certified with Windows Server 2016*
    Driver version 08.01.0144 (B0239, U0156)
  • Certified with Debian Linux 7.11*, 8.5*
    Driver version 08.01.0088 (B0138, U0095)
  • Certified with Ubuntu Linux 14.04*, 16.04*
    Driver version 08.01.0088 (B0138, U0095)
  • Certified with Spark SQL 2.0*
    Driver version 08.01.0144 (B0239, U0156)
Enhancements
  • The default version of the OpenSSL library has been upgraded to version 1.1.1g, which fixes the following security vulnerabilities:*
    • Segmentation fault in SSL_check_chain (CVE-2020-1967)
    • rsaz_512_sqr overflow bug on x86_64 (CVE-2019-1551)

    Version 1.1.1g also addresses vulnerabilities resolved by earlier versions of the library. For more information on the installed library files, refer to the readme.
    For more information on the OpenSSL vulnerabilities resolved by this upgrade, refer to the corresponding OpenSSL announcements at https://www.openssl.org/news/vulnerabilities-1.1.1.html.

  • The drivers using base version B0649 and later have been enhanced to include timestamp in the internal packet logs by default. If you want to disable the timestamp logging in packet logs, set PacketLoggingOptions=1. The internal packet logging is not enabled by default. To enable it, set EnablePacketLogging=1.*
  • OpenSSL library 1.0.2r has been replaced with version 1.0.2u. In addition to fixing multiple new vulnerabilities, version 1.0.2u also addresses the vulnerabilities resolved by version 1.0.2r.*
    Version 1.0.2u of the OpenSSL library fixes the following security vulnerabilities:
    • x64_64 Montgomery squaring procedure used in exponentiation with 512-bit moduli (CVE-2019-1563)
    • Padding Oracle in PKCS7_dataDecode and CMS_decrypt_set1_pkey (CVE-2019-1563)
    • Compute ECC cofactors if not provided during EC_GROUP construction (CVE-2019-1547)
    • Installation paths in diverse Windows builds (CVE-2019-1552)

    Note: By default, the driver will attempt to load version 1.1.1 of the library; however, if the library cannot be loaded, the driver will fall back to version 1.0.2.

  • The Driver Manager for UNIX/Linux has been enhanced to support setting the Unicode encoding type for applications on a per connection basis. By passing a value for the SQL_ATTR_APP_UNICODE_TYPE attribute using SQLSetConnectAttr, your application can specify the encoding at connection. This allows your application to pass both UTF-8 and UTF-16 encoded strings with a single environment handle.*
    The valid values for the SQL_ATTR_APP_UNICODE_TYPE attribute are SQL_DD_CP_UTF8 and SQL_DD_CP_UTF16. The default value is SQL_DD_CP_UTF8.
    This enhancement is available in build 08.02.0449 of the driver manager.
  • The default OpenSSL library version has been updated to 1.1.1d.*
  • The new AllowedOpenSSLVersions option determines which version of the OpenSSL library file the driver uses for data encryption when multiple versions are installed with the product. For example, when specifying a value of 1.1.1 (AllowedOpenSSLVersions=1.1.1) the driver uses the 1.1.1 version of the library that is installed with the driver.*
  • The default OpenSSL library version has been updated to 1.0.2r.*         
  • The default OpenSSL library version has been updated to 1.0.2n.*
  • The default OpenSSL library version has been updated to 1.0.2k.*
  • The default OpenSSL library version has been updated to 1.0.2j.*
  • The default OpenSSL library version has been updated to 1.0.2h.*
  • The default OpenSSL library version has been updated to 1.0.2g.*
  • The default OpenSSL library version has been updated to 1.0.2f.
Changed Behavior
  • The following Windows platforms have reached the end of their product lifecycle and are no longer supported by the driver*:
    • Windows 8.0 (versions 8.1 and higher are still supported)
    • Windows Vista (all versions)
    • Windows XP (all versions)
    • Windows Server 2003 (all versions)

Version 8.0.1

Certifications
  • Certified with Spark SQL 1.4.x and 1.5.x
Enhancements
  • The driver has been enhanced to support the Decimal and Varchar data types.
  • The new Min Long Varchar Size connection option allows you to fetch SQL_LONGVARCHAR columns whose size is smaller than the minimum imposed by some third-party applications, such as SQL Server Linked Server.
  • The new Varchar Threshold connection option allows you to fetch columns that would otherwise exceed the upper limit of the SQL_VARCHAR type for some third-party applications, such as SQL Server Linked Server.

Version 8.0.0

Features
  • Support for Apache Spark SQL 1.2.x and 1.3.x.
  • DataDirect Wire Protocol technology for improved response time and throughput.
  • Support for all ODBC Core and Level 1 functions.
  • Support for core SQL-92 grammar.
  • Advanced security features, including:
    • Kerberos authentication
    • Data encryption


patch-whats-new

Read Next

What's new