3 Demos to Put a “Spark” in your Data Integration

3 Demos to Put a “Spark” in your Data Integration

October 28, 2016 0 Comments
3 Demos to Put a “Spark” in your Data Integration

Idaliz Baez presents three demos for Spark data integration including JDBC Apache SQOOP, ODBC SparkSQL and Salesforce Spark DataFrames.

What is Apache Sqoop?

Apache Sqoop is a tool designed for efficiently transferring bulk data between Apache Hadoop and structured datastores such as relational databases. This project successfully graduated from the Incubator in March of 2012 and is now a top-level Apache project.

In this first demo, I will show you how to ingest external data into Hadoop using Apache Sqoop and the DataDirect JDBC drivers.

Why Use DataDirect Drivers When Sqoop Has Out-of-the-Box External Database Support?

Although Apache Sqoop has a certain level of out-of-the-box support, this support is very limited. Here are some of the key features you are missing out on if you stick with out-of-the-box capabilities:3 Demos to Put a “Spark” in your Data Integration

Unlocking Hadoop Data and Spark DataFrameworks Support

Unlock Hadoop Data Through Spark SQL to Any BI/Reporting App

In the second demo, I’m going to walk you through accessing Hadoop data through Spark SQL with any of your beloved BI/Reporting applications.

How can Progress DataDirect Help You With Spark DataFrameworks?

To conclude the demos, I will show you how to access data for Spark across relational, cloud, SaaS and NoSQL data sources utilizing JDBC connectivity.

Watch the Video

Optimize Your Data Connectivity Framework Today

In these demos we discussed JDBC connection to Apache Sqoop, ODBC connection to SparkSQL and Salesforce Spark DataFrames. If you would like to test any of these solutions for yourself, we offer free trials for each of them! Get started with high-performance data connectivity today!

Try Now for Free

Idaliz Baez

Idaliz is a Sales Engineer with Progress. After receiving her undergraduate degree from Duke University in Civil and Environmental Engineering, Idaliz Baez spent a year at NASA Goddard Space Flight Center gaining on-the-job experience before returning to Duke in pursuit of her Masters of Engineering Management degree. 

Comments are disabled in preview mode.
Latest Stories
in Your Inbox

Subscribe to get all the news, info and tutorials you need to build better business apps and sites

More From Progress
2020 Progress Data Connectivity Report
2020 Progress Data Connectivity Report
Read More
Getting Ahead of the Hybrid Data Curve
Read More
Creating Quick, Codeless Connectivity with Autonomous REST Connector
Read More