The Memory System
Discover a deep learning accelerator that accelerates inferencing computation with excellent efficiency and unmatched compute density.
ActiveQoS Within ORBIT Memory System
The ORBIT Memory System provides ActiveQoS advanced traffic control. As part of ActiveQoS, both OIC and OMC prioritize traffic based on its urgency and master's property to deliver latency-sensitive traffic on time. ActiveQoS uses the buffer status from the OMC and slave monitor IPs to manage traffic from the masters. By interacting with the memory controller, ActiveQoS reduces latency and bandwidth in OIC. As a result, ActiveQoS allows OIC to maintain steady traffic while avoiding blocking and congestion caused by overcrowding.
Automated adaptation of QoS knobs based on real latency observed in silicon
Enabled by a combination of NoC and memory controller
Perfect solution to Head-of-Line (HOL) blocking issue with maintaining utilization