Vortex
AssessTools
An open-source columnar file format designed for high-throughput ML data loading.
Why it's here
Placed in Assess: 1 article(s) of evidence from 1 source(s), led by open-source activity, with 1 in the last 30 days. Confidence 24%. Low accumulated evidence, so it defaults conservatively pending more signal.
Evidence (1)
- 7InfoQ·9/4/2026open_sourceVortex Streams S3 Data to GPUs with One-Copy Loading
Onur Satici describes Vortex, an open-source columnar file format under the Linux Foundation, as a way to remove CPU and NVMe bottlenecks in ML training data loading. Using lightweight encodings, segment pruning, and zero-copy pipelines, it can stream S3 data directly to GPUs at up to 60 Gbps without upfront reprocessing.