Tutorial: Access Data via JDBC with Apache Nifi

Tutorial: Access Data via JDBC with Apache Nifi

Posted on August 01, 2017 0 Comments
Tutorial Access Data via JDBC with Apache Nifi_870x220

In this tutorial, learn how to ingest data with Apache Nifi using JDBC drivers and SQL queries.

Apache Nifi is an open source project that was built to automate data flow and data management between different systems. Data flow complexity has grown as the number of disparate systems has increased. In addition, the demands on those individual systems continue to grow in scope and complexity.

Nifi meets those demands with key features such as ease of use with a drag and drop UI, and easy scalability to run a single server or in a clustered mode across many servers.

In May 2017, the updated Apache Nifi 1.2.0-RC1 version was released. DZone has a nice overview of some of the features. 


For data access, Apache Nifi supports connectivity through the JDBC API and use of the SQL query syntax. With JDBC and SQL, it isn't necessary to write separate applications or use different query syntax to access different database systems (Oracle and Salesforce, for example). Using JDBC allows you to use standard connectivity and standard SQL syntax for different database systems. 

You may be familiar with SQL as the standard language for accessing relational databases. With the rise of NoSQL, SaaS and Big Data sources, many thought that the popularity of SQL was on the decline. However, market demand for a common standard syntax has actually led to a rise in popularity of SQL support by countless databases, including the so-called NoSQL sources.

Using DataDirect JDBC connectivity you can set up database connections and pass standard SQL, which is commonly used by off-the-shelf applications as well as custom applications that connect to multiple databases. The JDBC API defines a set of Java interfaces that encapsulate major database functionality, such as running queries, processing results, and determining configuration information. 

For example, within the Apache Nifi flow you can use the QueryDatabaseTable component to generate and executes a SQL select query. Our tutorial walks you through the configuration of drivers and the QueryDatabaseTable setup.

In order to get you started using Nifi, we've put together this tutorial demonstrating how to pull Salesforce data into Hive using Apache Nifi. Setting up connectivity through Nifi is a bit more involved than in end-user desktop applications you may be familiar with, so our tutorial is a very detailed step-by-step look at the process.


Get Started with Apache Nifi Today

Our tutorial assumes that you have a DataDirect JDBC driver. If you don't already own our connectivity, get started today with a free 15 day trial. You'll be able to immediately use the evaluation driver with Nifi by following the tutorial.

Start the Tutorial

Saikrishna Teja Bobba

Saikrishna is a DataDirect Developer Evangelist at Progress. Prior to working at Progress, he worked as Software Engineer for 3 years after getting his undergraduate degree, and recently graduated from NC State University with Masters in Computer Science. His interests are in the areas of Data Connectivity, SaaS and Mobile App Development.


Comments are disabled in preview mode.

Sitefinity Training and Certification Now Available.

Let our experts teach you how to use Sitefinity's best-in-class features to deliver compelling digital experiences.

Learn More
Latest Stories
in Your Inbox

Subscribe to get all the news, info and tutorials you need to build better business apps and sites

Loading animation