Xiao Meng

Goldsky

Xiao Meng is a software engineer specializing in data infrastructure, stream processing, and SRE. He is the Streaming Team Lead at Goldsky, where he leads development of a declarative, serverless real-time data platform for blockchain data. Previously, he was an Expert Data Engineer at Activision/Demonware, building a real-time game telemetry platform for titles including Call of Duty.

Sessions

Operations

Stories

Stream

Streamling: Lightweight, Extensible Streaming on DataFusion

Talk

Apache DataFusion is moving beyond batch into streaming. We built Streamling, a Rust streaming engine that uses DataFusion planning and Arrow RecordBatch streams for real-time SQL/WASM transforms. This talk covers how we built it, highlights key features (FFI plugins, WASM transforms, and dynamic tables), and shares production lessons.