Tutorial Spotlight: Import Streaming Data from Any REST API Into Apache Kafka Using JDBC

Tutorial Spotlight: Import Streaming Data from Any REST API Into Apache Kafka Using JDBC

November 04, 2019 0 Comments
Tutorial Spotlight Import Streaming Data from Any REST API Into Apache Kafka Using JDBC_1200x600

Connect to and query any REST API directly from Apache Kafka without writing a single line of code using Progress DataDirect Autonomous REST Connector.

Strike while the iron is hot is how the adage goes. Literally, a blacksmith can only manipulate metal when it is just out of the forge. After that, if the metal becomes too cool it can’t be used until the temperature is once again correct.

Your data is no different. Whether it is real-time stock market data for a financial services company or real-time sensor data for an IoT operation, your business thrives or dies on its ability to keep up with the dynamic swings of its source data.

Apache’s Kafka application has quickly emerged as the preeminent open source platform for fast, scalable processing of streaming data. Businesses of all kinds rely on this speed and dependability to create, monitor and report on their streaming data clusters. As with any data application, connectivity and access become a vital part of its success.

In this tutorial, we will show you how to import stock market data from any REST API to Kafka with a little help from Progress DataDirect Autonomous REST Connector. Autonomous REST Connector allows you to seamlessly and codelessly connect REST API data sources to your BI application. While Kafka has its own JDBC connector, it cannot connect to REST APIs. Progress DataDirect Autonomous REST Connector can connect to and query any REST API using SQL.

Our tutorial’s stock market example uses PRGS (that’s us!), but feel free to substitute with your own favorite ticker symbol. Once you’re up and running, Kafka will run your JDBC source connectors and continue polling the REST API via the DataDirect Autonomous REST Connector every five seconds to fetch new data. How’s that for real-time information?

Everything we build at Progress DataDirect is to help you improve your business. This tutorial is meant to show you one of many possibilities. If you want to learn about ODBC or other connectors, let us know! Start with the tutorial or contact us.

Read the Tutorial

Joelle Andrews

Joelle Andrews

Joelle Andrews is a Senior Product Marketing Specialist at Progress with a focus on the DataDirect suite of solutions. She has 8+ years of experience in sales, product marketing, and marketing automation.  Outside of work, Joelle loves getting lost in a book, rescuing cats, and traveling the world.

Comments
Comments are disabled in preview mode.
Topics
Latest Stories
in Your Inbox

Subscribe to get all the news, info and tutorials you need to build better business apps and sites

More From Progress
232x131_resourceimage
Getting Ahead of the Hybrid Data Curve
Read More
 
autonomousrest
Creating Quick, Codeless Connectivity with Autonomous REST Connector
Read More
 
whats-new-thumb_210x120
What’s New in OpenEdge 12.1
Read More