Hacker News logo

Show HN: DuckDB for Kafka Stream Processing

74 points
by dm03514
2 days ago
13 comments
Hello Everyone! We built SQLFlow as a lightweight stream processing engine.

We leverage DuckDB as the stream processing engine, which gives SQLFlow the ability to process 10's of thousands of messages a second using ~250MiB of memory!

DuckDB also supports a rich ecosystem of sinks and connectors!

https://sql-flow.com/docs/category/tutorials/

https://github.com/turbolytics/sql-flow

We were tired of running JVM's for simple stream processing, and also of bespoke one off stream processors

I would love your feedback, criticisms and/or experiences!

Thank you


13 comments

Loading...

Almost there! We're setting everything up for you.

Built by Troy Ciesco
Hacker News API