A major center of cost and effort in the financial services industry is the handling of post-trade processing. Post-trade processing is a complex process. Some of the processes involved include:
Within a single firm, it is common for multiple business units and independent systems to be involved with the processing of a single trade. It is often necessary to interact with multiple external firms beyond those of the counterparty. Errors are common given the complexity and speed of the modern trading environment. The post-trade processing environment understands this and is flexible and forgiving toward errors.
Straight-through processing (STP) is meant to allow trades to be processed as quickly as possible after trade execution. STP has only been possible to achieve in limited areas because of the complexity of post-trade processing.
Today, STP is back in the news because of a new technology called “blockchain.”
Blockchain replaces the individual ledgers maintained by each firm and replaces them with a common, distributed, legally binding ledger. With blockchain, reconciliation of ledgers and its associated tasks — like exception handling — disappear because a single logical ledger means there is nothing to reconcile.
A common distributed ledger is a major enhancement that makes STP more achievable.
Advocates of this technology argue that blockchain simplifies and speeds up regulatory reporting because the data needed for the reports is centrally stored. Financial crime can therefore be reduced because ledger transactions cannot be modified, clearing and settlement will become instantaneous, and data accuracy will be increased, all while cost and risk will be reduced.
While all these benefits may be possible, there is the question of how do you go from here to there?
While the potential benefits of blockchain are real, the reasons for the existence of current trade-processing infrastructures are also real. It is certainly true that blockchain has the potential to reduce the work involved with settlement, clearing, avoidance/correction of errors and compliance. However, not all the work will go away. The post-trade work that remains will have to move to real-time.
Today’s trade-processing systems require:
However, a trade-processing system built for blockchain:
Comparing these lists, it is clear that many of today’s trade-processing systems are not ready for blockchain. Most importantly, the fundamental (serial batch) approach of many existing systems is not suitable for the new world.
Blockchain will not be adopted universally, all at once. Instruments and locations will adopt it at different rates and at different levels of completeness. Firms will need to support both blockchain and non-blockchain based trade-process for the indefinite future.
At a technical level, to accomplish the requirements listed above requires a new approach. Basically, there are a number of fundamental building blocks that, along with a sufficiently flexible infrastructure, can make it possible to build the new trade-processing infrastructure. These building blocks are:
These core capabilities offer a variety of enhancements to trade-processing:
Real-Time – Having multiple processes each handling a part of the trade-processing in a serial fashion with their own copy of the data makes it difficult to implement STP. Having each data element exist only once with all processes accessing that central copy is a much better approach. With a batch processing framework, data integrity is easy to maintain as only one process accesses a given data element at any one time. With a real-time system data integrity means transactions and ACID.
Handling Complexity – Trade-processing is done for instruments that are easy to model, like equities. Trade-processing is also done for instruments with complex underlying object models, like certain swaps. Complex instruments can be difficult to describe, especially in a relational schema. See “Object-Oriented Programming & NoSQL Databases” for a discussion of this.
Trade-processing needs to verify trades are consistent with the appropriate master agreements – information that exists in the form of legal documents and not relational tables. To fully implement real-time trading, it is necessary to have an infrastructure that is able to automate the handling of this kind of data.
Automation – In today’s trade-processing systems, critical functionality exists in products like Microsoft Excel. While blockchain might eventually sweep all this aside, the reason for Excel’s continued use is that it is sometimes easier to build and maintain complex and changing functionality in a spreadsheet than formally coding it into an application. When moving to blockchain, the probability of success is much greater if the new infrastructure can leverage as much of the existing infrastructure as possible and not require a complete rewrite of the entire process.
ETL – A key to moving to a blockchain-based trading system is moving away from extensive batch-oriented processing to real-time ETL. This is difficult to do in relational-based systems because a large amount of the ETL is translating data from its original format into the tables, rows, and columns that relational requires. This requires substantial development time to model and can be time-consuming at run time.
Another reason for the multiple, independent, ETL processes of today is that a given ETL process may require data to exist in a certain format. The process may need to transform the data it receives to its desired form – resulting in the need for multiple copies of the same underlying data. To move to real-time ETL, it is necessary that the database underlying trade-processing can provide different views of the same data to different users.
Error Avoidance/Correction – When a blockchain-based transaction is executed it is legally binding – the default approach for blockchain is you cannot change a transaction once it is completed. This is a tough new constraint. Any trade-processing infrastructure built for a blockchain based environment must have rigorous error detection and correction capabilities.
– Many trade-processing systems have traditionally been built on a relational infrastructure. In a blockchain era this is problematic for two main reasons:
The reality is that trade-processing is complex and hard and relational is not a good fit to handle it. When real-time trade-processing is required the disadvantages become overwhelming.
If not SQL, then what?
Consider MarkLogic – MarkLogic provides:
The world of trade-processing is changing. In the future, it will move faster and demand higher levels of accuracy than ever before.
The trade-processing systems of today are not ready for the demands of tomorrow. Moving to this new world will require fundamental enhancements in the underlying trade-processing frameworks starting with the ability to handle diverse, constantly evolving, data sets.
David Kaaret has worked with major investment banks, mutual funds, and online brokerages for over 15 years in technical and sales roles.
He has helped clients design and build high performance and cutting edge database systems and provided guidance on issues including performance, optimal schema design, security, failover, messaging, and master data management.
Let our experts teach you how to use Sitefinity's best-in-class features to deliver compelling digital experiences.Learn More
Subscribe to get all the news, info and tutorials you need to build better business apps and sites
You can also ask us not to share your Personal Information to third parties here: Do Not Sell or Share My Info
We see that you have already chosen to receive marketing materials from us. If you wish to change this at any time you may do so by clicking here.
Thank you for your continued interest in Progress. Based on either your previous activity on our websites or our ongoing relationship, we will keep you updated on our products, solutions, services, company news and events. If you decide that you want to be removed from our mailing lists at any time, you can change your contact preferences by clicking here.