HiFrames: High Performance Data Frames in a Scripting Language — mentioned by tedmiston

Fri, 13 Oct 2017 17:24:46 GMT

The abstract from the paper about it HiFrames: High Performance Data Frames in a Scripting Language [1] describes HPAT better than the description in the repo: > Data frames in scripting languages are essential abstractions for processing structured data. However, existing data frame solutions are either not distributed (e.g., Pandas in Python) and therefore have limited scalability, or they are not tightly integrated with array computations (e.g., Spark SQL). This paper proposes a novel compiler-based approach where we integrate data frames into the High Performance Analytics Toolkit (HPAT)…

Paper and discussion history. A mention is not an endorsement.

HiFrames: High Performance Data Frames in a Scripting Language — mentioned by chrispeel

Sun, 01 Oct 2017 20:19:35 GMT

...and HiFrames [1] and HPAT [2] will kill Spark ;-) HiFrames and HPAT are built on Julia [3] and use the Julia packages ParallelAccelerator.jl [4]. [1] https://arxiv.org/abs/1704.02341 [2] https://github.com/IntelLabs/HPAT.jl [3] https://julialang.org/ [4] https://github.com/IntelLabs/ParallelAccelerator.jl

Paper and discussion history. A mention is not an endorsement.

HiFrames: High Performance Data Frames in a Scripting Language · HackerPapers discussions

HiFrames: High Performance Data Frames in a Scripting Language — mentioned by tedmiston

HiFrames: High Performance Data Frames in a Scripting Language — mentioned by chrispeel