rENIAC for Ultralow Latency - Historical and Real-time Data Joins in Electronic Trading Applications

In an active day to day trading environment, market participants spend a significant amount of time and effort to gain insight on how past behavior relates to its future. The trading signals become a crucial part of it for devising strategies to handle both historical and real-time (streaming) market data for actionable recommendations.To have competitive edge firms engaged in electronic trading need to find the fastest and most efficient means of joining historical and real time data to provide signals and enable execution as close to instant as possible.

Example architecture:

electronic trading before reniac cache deployment

Reduce CPU usage through a combination of FPGAs and Data Acceleration

The standard CPU infrastructure offers solutions to continuously add CPUs to accommodate for data growth or need for speed, or to add an ever-growing cache layer in front of persistent data stores. But the main limitation of CPUs are both speed and scale as processing is constrained by the number of cores. 

Thus solutions to handle latency sensitive data or perform wide joins faster and more efficiently are achieved by looking into database acceleration and FPGAs. 

rENIAC combines the power of hardware with the flexibility of software to reduce latency and Increase throughput

FPGAs have long been used in high frequency trading applications for their ability to meet both large storage requirements and for their smartly networked processing capabilities. By leveraging FPGAs and software, rENIAC provides

  • the power of persistence 
  • scalable, tunable, metered performance to suit varied application needs
  • consistent latency for electronic trading

rENIAC recognized the inefficiencies of CPU based processing and built rENIAC Data Engine. rENIAC Data Engine (rDE) is a FPGA-accelerated data accelerator. It provides high performance by speeding up the access to storage (memory as well as Flash), network operations, and by accelerating clustering and compute algorithms (e.g. compression, hash, compaction, bloom filter). 

This results in a high throughput and predictable low latency solution for scaling database systems. By enabling specific acceleration engines in the FPGA and adapter APIs in the CPU host software to ensure compatibility with database API, data-intensive workloads can be accelerated by rENIAC without application software changes or refactoring.

Data acceleration via a live cache or storage engine

 electronic trading after reniac cache deployment model

As a cache, rENIAC is able to service read requests up to 10x more quickly than a standard database. In this deployment, rENIAC stores much of the real time data and also performs the wide join, thus processing the overall action much more quickly. 

This relieves CPU usage for operational and networking functions on the backend and separates revenue-generating logic from necessary but IO intensive functions

Benefits of rENIAC for Electronic Trading

 rENIAC’s live cache deployment model benefits electronic trading with speed of data access:

  • As a cache, rENIAC drops in and immediately accelerates data access with minimal deployment time and no required maintenance or tuning
  • This deployment model provides read request access at much higher speed and with greatly reduced and consistent, predictable latency
  • rENIAC enables caching capabilities so the amount of accessible hot data can reach multiple terabytes via a single node
  • Thus more processing power against more data, providing faster learning models and execution of strategies based on historical and streaming data

Full use case available for download (no form fill required!) below.

Read the use case