Pond: CXL-Based Memory Pooling Systems for Cloud Platforms · HackerPapers discussions

Pond: CXL-Based Memory Pooling Systems for Cloud Platforms — mentioned by dvas

Sun, 05 Nov 2023 13:27:26 GMT

CXL and its coherency mechanisms will be interesting to watch as the requirements for LLMs and related applications requiring large memory pools continue to grow. This includes some HPC related workloads also. One of the use cases I have seen recently was driving down the total cost of DRAM in a larger-scale deployment of systems at AWS, Azure, Meta etc. Pond [1] which is a memory pooling system, claims to achieve the desired performance and at the same time lowering costs as one example. I think a look at the overall, bigger picture is important. For example considering how a system will be…

Paper and discussion history. A mention is not an endorsement.

Pond: CXL-Based Memory Pooling Systems for Cloud Platforms — HN submission

Thu, 03 Nov 2022 01:17:03 GMT

Pond: CXL-Based Memory Pooling Systems for Cloud Platforms

1 point; 0 discussion replies on HN. Paper and source history. A submission is not an endorsement.

Pond: CXL-Based Memory Pooling Systems for Cloud Platforms — mentioned by pbalcer

Wed, 29 Jun 2022 09:06:34 GMT

There's a significant momentum behind CXL [1]. Samsung already announced a CXL DRAM module [2]. From where I sit, it's all but inevitable that this technology will get broader adoption, at least with large CSPs. Its benefits are just too good to pass up. The extra latency is estimated to be no worse than a NUMA hop [3]. Many companies are already figuring out how to best deal with the more complex memory topologies that CXL will enable [4, 5]. But I'm biased (I work for Intel), so take what I say with a grain of salt. [1] - https://www.computeexpresslink.org/members [2]…

Paper and discussion history. A mention is not an endorsement.

Pond: CXL-Based Memory Pooling Systems for Cloud Platforms — HN submission

Tue, 15 Mar 2022 14:07:13 GMT

First-Generation Memory Disaggregation for Cloud Platforms

2 points; 0 discussion replies on HN. Paper and source history. A submission is not an endorsement.

Pond: CXL-Based Memory Pooling Systems for Cloud Platforms — HN submission

Mon, 14 Mar 2022 16:05:25 GMT

First-Generation Memory Disaggregation for Cloud Platforms

1 point; 0 discussion replies on HN. Paper and source history. A submission is not an endorsement.