T-engine architecture

T-engine is a multi-core runtime engine that sits as a middleware in your platform between the user program and the multi-core hardware.

T-engine architecture is completely distributed, asynchronous and event-driven based.

On the hardware level, T-engine abstracts and handles all low-level and platform-specific details such as parallelization and CPU cores allocation, cores synchronization and communication, memory management, and other optimizations.

On the software level, T-engine runs only a single thread per core. Thus, Actors deployed on the same core share the same thread. T-engine manages safely the memory sharing between the Actors on the same core.

The communication between cores is latency constant independently of the number of cores. In fact, Events between Actors running on different CPUs are managed using a lock free mechanism, allowing for a deterministic event transport latency. This key feature allows for an innovative approach of real-time parallel programming.

Red zone v/s Blue zone

T-engine provides additional guarantees for real-time execution using 2 delimited zones: It is the notion of Red Zone and Blue Zone.

The Blue Zone is the core subset running non real-time functions such as monitoring, audit, logging, administration, and third party system integration (database, file management, etc.)

On the other hand, the Red Zone is the core subset running all the realtime critical functions such as SOR (Smart Order Routing), Risk Management and Feed Handlers. The zone choice is made according to the workflow business requirements.

By this organization, “fast” functionality running in the Red Zone will be guaranteed to achieve maximum throughput and still asynchronously benefit from any “slow” functionality running in the Blue Zone. Both zones can freely communicate without disturbing the Red Zone latency.

You choose the T-engine technology that fits best with your hardware WITHOUT changing your software. T-engine is natively compatible with mainstream multicore and manycore CPUs as well as accelerator-based manycore such as Xeon PHI.