CXL based tiered memory management system

Abstract

CXL(Compute Express Link) is a next generation memory interconnect technology that supports lower latency, higher bandwidth. Recently, there has been increasing attention and active development in the fields of artificial intelligence and big data processing. The demand for programs that utilize large memory capacity has also been on the rise. Type 3 devices of CXL can be used as memory expander and provide larger memory capacity. In this study, we emulated a structure where the memory expander is directly connected to the processor without switch by using a non-uniform memory access machine. We consider a hierarchical memory structure that includes local memory within the same node and remote memory from different nodes. In this hierarchical memory structure, we investigate efficient memory management techniques that can be applied to Type 3 CXL memory expander.