Codeless configuration for DataDirect ODBC bulk functionality and Ab Initio

Codeless configuration for DataDirect ODBC bulk functionality and Ab Initio

March 10, 2011 0 Comments

When we introduced bulk load in the DataDirect Connect for ODBC product line, we were really excited about the new functionality and the implications for new application development. If I had to choose one favorite component that you can use today, it would have to be the introduction of the property, EnableBulkLoad=1, to increase performance of existing applications out of the box such as Ab Initio's suite of ETL products. In this post, I'll dive a bit deeper into why we're so jazzed about EnableBulkLoad and how you can leverage the functionality in your application development.

The Connect for ODBC User's Guide documents EnableBulkLoad as follows, "If set to 1 (Enabled), the driver uses the database bulk load protocol when an application executes an INSERT with multiple rows of parameter data."

The description is not nearly as exciting as what this connection property does for your application. The driver will transparently convert operations with ODBC parameter array binding to the database's native bulk protocol. The charts available online show that the ODBC driver bulk load functionality is the fastest solution on the market for moving large amounts of data.

With Ab Initio, this can be configured by setting "array load" in the database configuration file and then set EnableBulkLoad=1 in the ODBC data source for the SQL Server Wire Protocol driver, for example. This combination results in unparalleled performance in the ETL solution from Ab Initio. Similar to Progress DataDirect, Ab Initio develops high quality software; and this is a great example of the power of codeless configuration you hear about from Progress DataDirect.

A knowledge article on the configuration can be found here for reference:

Sumit Sakar

Sumit Sarkar

Sumit Sarkar is a Chief Data Evangelist at Progress, with over 10 years experience working in the data connectivity field. The world's leading consultant on open data standards connectivity with cloud data, Sumit's interests include performance tuning of the data access layer for which he has developed a patent pending technology for its analysis; business intelligence and data warehousing for SaaS platforms; and data connectivity for aPaaS environments, with a focus on standards such as ODBC, JDBC, ADO.NET and ODATA. He is an IBM Certified Consultant for IBM Cognos Business Intelligence and TDWI member. He has presented sessions on data connectivity at various conferences including Dreamforce, Oracle OpenWorld, Strata Hadoop, MongoDB World and SAP Analytics and Business Objects Conference, among many others. 

Comments are disabled in preview mode.