DataFlow: An LLM-Driven Framework for Unified Data Preparation and Workflow Automation in the Era of Data-Centric AI — HN submission

Tue, 23 Dec 2025 04:03:32 GMT

DataFlow: Using LLMs to Build Reproducible, End-to-End Data Pipelines

2 points; 1 discussion reply on HN. Paper and source history. A submission is not an endorsement.

DataFlow: An LLM-Driven Framework for Unified Data Preparation and Workflow Automation in the Era of Data-Centric AI — HN submission

Sun, 21 Dec 2025 09:44:21 GMT

Show HN: DataFlow – Open Tool for LLM data prep 10k synthetic > 1M generic data

Hi HN, We are the OpenDCAI team from Peking University. We just released DataFlow, an open-source framework designed to make LLM data preparation as programmable and modular as model training. The Problem: While model architectures are standardized (PyTorch/JAX), data preparation is still dominated by ad-hoc scripts and loosely defined workflows. Most existing tools focus on "cleaning" or "filtering" existing large datasets, but modern LLM training increasingly relies on complex synthetic data generation and iterative refinement. Our Solution: DataFlow DataFlow treats data processing like…

1 point; 0 discussion replies on HN. Paper and source history. A submission is not an endorsement.

DataFlow: An LLM-Driven Framework for Unified Data Preparation and Workflow Automation in the Era of Data-Centric AI · HackerPapers discussions

DataFlow: An LLM-Driven Framework for Unified Data Preparation and Workflow Automation in the Era of Data-Centric AI — HN submission

DataFlow: An LLM-Driven Framework for Unified Data Preparation and Workflow Automation in the Era of Data-Centric AI — HN submission