Rafael Aguiar
Rafael Aguiar has battle scars from building streaming engines, distributed systems, and real-time analytics in production.
When not at work, he’s probably hiking somewhere.
Sessions
Operations
Stories
Stream
Streamling: Lightweight, Extensible Streaming on DataFusion
Talk
Apache DataFusion is moving beyond batch into streaming. We built Streamling, a Rust streaming engine that uses DataFusion planning and Arrow RecordBatch streams for real-time SQL/WASM transforms. This talk covers how we built it, highlights key features (FFI plugins, WASM transforms, and dynamic tables), and shares production lessons.