Relational Memory: Native In-Memory Accesses on Rows and Columns · HackerPapers discussions

Relational Memory: Native In-Memory Accesses on Rows and Columns — mentioned by rwmj

Thu, 21 Dec 2023 18:56:40 GMT

Red Hat supported a lot of research into this and there's some really interesting stuff, but nothing that is very compelling for commercial use. What uses do you have in mind? To my mind the more interesting stuff are the PCIe FPGA boards like https://www.xilinx.com/products/boards-and-kits/alveo/u200.h... One particularly interesting research project was using the FPGA fabric to remap addresses, allowing database tables to be "virtually" rearranged (eg. making a row-major data source into a column-major source for easier searching). https://disc.bu.edu/papers/edbt23-relational-memory…

Paper and discussion history. A mention is not an endorsement.

Relational Memory: Native In-Memory Accesses on Rows and Columns — mentioned by rwmj

Thu, 05 Oct 2023 07:54:30 GMT

But the bet was customers would buy Xeons with an FPGA block that would "do magic". What magic it would do and how you'd program it in a sane way was never specified in great detail. In any case for those that really want this it turns out you can put the FPGA on the end of a regular PCIe link and get all the same benefits. Edit: By the way there is some niche research of the FPGA in core (which don't work if the FPGA is over PCIe). This paper describes a way to rearrange memory using a programmable FPGA-based memory controller to optimize database table accesses…

Paper and discussion history. A mention is not an endorsement.

Relational Memory: Native In-Memory Accesses on Rows and Columns — mentioned by rwmj

Tue, 20 Dec 2022 08:40:42 GMT

Something similar in this paper, putting an FPGA between the processor and DRAM so you can arbitrarily remap bits of it: https://arxiv.org/abs/2109.14349

Paper and discussion history. A mention is not an endorsement.

Relational Memory: Native In-Memory Accesses on Rows and Columns — mentioned by rwmj

Mon, 07 Nov 2022 13:14:58 GMT

This paper is a slightly different approach to a similar problem: https://arxiv.org/abs/2109.14349 They are inserting an FPGA fabric between standard CPUs and standard DDR RAM, allowing the memory to be reorganized on the fly. For example you can flip columns and rows in arrays, or turn ordinary row-oriented databases into column-first databases. I think all these approaches have a problem that you end up having to throw away all existing software to take advantage of them.

Paper and discussion history. A mention is not an endorsement.

Relational Memory: Native In-Memory Accesses on Rows and Columns — HN submission

Tue, 18 Oct 2022 15:33:53 GMT

Using an FPGA to transform rows to columns on in-memory databases

7 points; 0 discussion replies on HN. Paper and source history. A submission is not an endorsement.

Relational Memory: Native In-Memory Accesses on Rows and Columns — mentioned by belter

Sun, 03 Oct 2021 23:02:16 GMT

"Analytical database systems are typically designed to use a column-first data layout that maps better to analytical queries of access patterns. This choice is premised on the assumption that storing data in a row-first format leads to accessing unwanted fields; moreover, transforming rows to columns at runtime is expensive. On the other hand, new data items are constantly ingested in row-first form and transformed in the background to columns to facilitate future analytical queries. How will this design change if we can always access only the desired set of columns? In this paper, to address…

Paper and discussion history. A mention is not an endorsement.

Relational Memory: Native In-Memory Accesses on Rows and Columns — HN submission

Sun, 03 Oct 2021 23:02:16 GMT

Relational Memory: Native In-Memory Accesses on Rows and Columns

3 points; 1 discussion reply on HN. Paper and source history. A submission is not an endorsement.