Connect to and query any REST API directly from Apache Kafka without writing a single line of code using Progress DataDirect Autonomous REST Connector.
Strike while the iron is hot is how the adage goes. Literally, a blacksmith can only manipulate metal when it is just out of the forge. After that, if the metal becomes too cool it can’t be used until the temperature is once again correct.
Your data is no different. Whether it is real-time stock market data for a financial services company or real-time sensor data for an IoT operation, your business thrives or dies on its ability to keep up with the dynamic swings of its source data.
Apache’s Kafka application has quickly emerged as the preeminent open source platform for fast, scalable processing of streaming data. Businesses of all kinds rely on this speed and dependability to create, monitor and report on their streaming data clusters. As with any data application, connectivity and access become a vital part of its success.
In this tutorial, we will show you how to import stock market data from any REST API to Kafka with a little help from Progress DataDirect Autonomous REST Connector. Autonomous REST Connector allows you to seamlessly and codelessly connect REST API data sources to your BI application. While Kafka has its own JDBC connector, it cannot connect to REST APIs. Progress DataDirect Autonomous REST Connector can connect to and query any REST API using SQL.
Our tutorial’s stock market example uses PRGS (that’s us!), but feel free to substitute with your own favorite ticker symbol. Once you’re up and running, Kafka will run your JDBC source connectors and continue polling the REST API via the DataDirect Autonomous REST Connector every five seconds to fetch new data. How’s that for real-time information?
Everything we build at Progress DataDirect is to help you improve your business. This tutorial is meant to show you one of many possibilities. If you want to learn about ODBC or other connectors, let us know! Start with the tutorial or contact us.
Joelle Andrews is a Product Marketing Manager focused on Progress Customer Care. Joelle’s past experience includes two years with the DataDirect team and a decade of experience in other product marketing, marketing automation, and sales roles. Outside of work, Joelle loves hiking, getting lost in a book, rescuing cats, and traveling the world.
Subscribe to get all the news, info and tutorials you need to build better business apps and sites
You have the right to request deletion of your Personal Information at any time.
You can also ask us not to pass your Personal Information to third parties here: Do Not Sell My Info
We see that you have already chosen to receive marketing materials from us. If you wish to change this at any time you may do so by clicking here.
Thank you for your continued interest in Progress. Based on either your previous activity on our websites or our ongoing relationship, we will keep you updated on our products, solutions, services, company news and events. If you decide that you want to be removed from our mailing lists at any time, you can change your contact preferences by clicking here.
Let our experts teach you how to use Sitefinity's best-in-class features to deliver compelling digital experiences.Learn More