Bytewax is a data processing solution that combines an open source library with modules and connectors to create data processing pipelines in Python.

Bytewax

Bytewax | 2,755 followers on LinkedIn. A Real-Time Data Streaming Processor.
Cloud native, highly scalable, open source, engineered for #Python developers. | Open source framework and distributed stream processing engine. 

Use real-time data with your AI, ML, or IoT use cases and build streaming data pipelines with everything you need directly in Python: recovery, scalability, windowing, aggregations, and connectors!

Bytewax&#39;s mission is to transform stream processing, making it faster, more accessible, and flexible for all users.

Chief of Staff @ Bytewax 🐝 | Python-native stream processing for Machine Learning, GenAI, and IoT

Jonas Best

Sales and GTM Leader for Enterprise Data and AI Solutions | Culture & Team Builder | Results-Driven Executive in AI/ML, SaaS, IaaS, PaaS, Cloud, and…

Doug Cohen

Synthetic Data @ Datacebo

Srini Kadamati

Streamlit Community Growth & Open Source @ Snowflake

Anna Filippova

🚀 Level Up Your Data Processing with Bytewax v0.20! Bytewax v0.20 brings critical updates to improve your workflow. The newly added Dataflow Visualizer provides a graphical representation of your data pipelines, making them easier to navigate and optimize. 🐝 We've also restructured our core operators to boost data handling efficiency, ensuring smoother operations within your applications. Ready to upgrade your data streams? ➡️ https://lnkd.in/e-WQPyxk

𝐌𝐨𝐝𝐮𝐥𝐞𝐬 𝐀𝐋𝐄𝐑𝐓! 🚨 Let’s be honest—data engineering is full of bottlenecks. Building custom connectors, writing boilerplate code, debugging integrations… it’s the work no one wants, but everyone needs. That’s exactly why we launched the Module Hub. It’s not just a toolset; it’s a smarter way of thinking about real-time pipelines. "𝘚𝘵𝘰𝘱 𝘥𝘰𝘪𝘯𝘨 𝘵𝘩𝘦 𝘴𝘢𝘮𝘦 𝘵𝘩𝘪𝘯𝘨𝘴 𝘰𝘷𝘦𝘳 𝘢𝘯𝘥 𝘰𝘷𝘦𝘳. 𝘚𝘵𝘢𝘳𝘵 𝘧𝘰𝘤𝘶𝘴𝘪𝘯𝘨 𝘰𝘯 𝘸𝘩𝘢𝘵 𝘳𝘦𝘢𝘭𝘭𝘺 𝘮𝘢𝘵𝘵𝘦𝘳𝘴." That’s what our CEO, Zander Matheson , envisions for every team using Bytewax. 🔥 These are the incredible companies whose technologies power the new Bytewax modules — find all the details in our blog. 🔗 https://lnkd.in/eCi-hNjG Apache Kafka , Google BigQuery, Hopsworks FS, AWS Kinesis Streams, ClickHouse , MongoDB , MQTT, Delta Lake , RabbitMQ , AWS IoT Gateway, Azure IoT Data Hub, Redpanda Data , Amazon MSK, Confluent , Redis , Websockets, Snowflake , Qdrant , Milvus , Pinecone , Oracle MySQL , Google Vertex AI, Amazon SageMaker, Feast, Weaviate , InfluxData , Microsoft Azure AI Search, and more.

Thrilled to be listed among Estuary ’s partners! 🛠️ At Bytewax, we’re passionate about simplifying real-time dataflows, and our collaboration with Estuary is a huge step toward making that happen. Check out their new partner page and see what we’re building together! 🚀

"𝘈𝘐 𝘸𝘪𝘭𝘭 𝘯𝘦𝘷𝘦𝘳 𝘳𝘦𝘱𝘭𝘢𝘤𝘦 𝘵𝘩𝘦 𝘬𝘯𝘰𝘸𝘭𝘦𝘥𝘨𝘦 𝘰𝘧 𝘣𝘶𝘪𝘭𝘥𝘪𝘯𝘨 𝘳𝘰𝘣𝘶𝘴𝘵, 𝘴𝘤𝘢𝘭𝘢𝘣𝘭𝘦, 𝘢𝘯𝘥 𝘳𝘦𝘭𝘪𝘢𝘣𝘭𝘦 𝘴𝘺𝘴𝘵𝘦𝘮𝘴." Our very own Laura Funderburk recently joined Chris Lusk🕵️♂️ from AI Makerspace to share her journey, insights on Gen AI, and the challenges of real-time RAG systems. 🚀 She spoke about her passion for integrating generative AI into real-time applications and how it’s reshaping what’s possible with streaming analytics. 🤫 Laura also offered an exciting glimpse of her upcoming book, where she demystifies building robust RAG systems with Bytewax and Haystack ( deepset ). The book focuses on practical, real-world use cases backed by her extensive experience with LLMs and streaming technologies. Catch the full interview and stay updated on her groundbreaking work! https://lnkd.in/eZx5iUms 💛 Bytewax is proud to have Laura on the team, pushing the boundaries of what’s possible in real-time AI.

🔥 Last week, PyData NYC inspired and energized us! Huge thanks to NumFOCUS for organizing such a fantastic event. The Bytewax team has returned home, taken a deep breath, and is now back in action. From the booth to the talks, it was all about connecting with the community. We loved hearing your thoughts, answering your questions, and sharing our approach to real-time data processing. 🐝 🧐 Zander Matheson ’s session focused on how Bytewax combines Python’s flexibility with Rust’s speed for real-time streaming. He shared practical tips on using PyO3 to optimize performance, integrating Rust with Python, and packaging with Maturin, offering a clear roadmap for high-efficiency workflows. If you’re interested, you can check out the slides [the link is in the comments]. We’ll also be sharing the recording soon for those who missed it. 💛 Stay tuned!

🗽 PyData NYC 𝐢𝐬 𝐚 𝐰𝐫𝐚𝐩, 𝐚𝐧𝐝 𝐢𝐭 𝐰𝐚𝐬 𝐚𝐧𝐨𝐭𝐡𝐞𝐫 𝐛𝐢𝐠 𝐡𝐢𝐭! ⭐️ This was my second PyData Global conference with Bytewax , and while I had a sense of what to expect, I still came away with fresh insights. Reflecting after a weekend in NYC and a red-eye flight home, here are my key takeaways: 🤗 𝐓𝐡𝐞 𝐏𝐲𝐭𝐡𝐨𝐧 𝐜𝐨𝐦𝐦𝐮𝐧𝐢𝐭𝐲 𝐢𝐬 𝐢𝐧𝐜𝐫𝐞𝐝𝐢𝐛𝐥𝐞! As in London, everyone was friendly, curious, and supportive. It was awesome to see familiar faces and connect with so many who stopped by our booth. ✨ 𝐓𝐡𝐞 𝐰𝐨𝐫𝐝 “𝐀𝐈” 𝐝𝐨𝐞𝐬 𝐧𝐨𝐭 𝐡𝐚𝐯𝐞 𝐦𝐮𝐜𝐡 𝐦𝐞𝐚𝐧𝐢𝐧𝐠 𝐡𝐞𝐫𝐞. In media and business, “AI” is often tossed around as a catch-all for mysterious tech “magic”—“we use AI to cut costs and improve processes.” But at PyData, conversations were refreshingly concrete: real-time vector embeddings for RAG, technologies powering LLMs, and Machine Learning applications. Just as magicians don’t use the word “magic” to describe their tricks to other magicians, here, it’s all about real, tangible tech! 🌊 𝐒𝐭𝐫𝐞𝐚𝐦 𝐏𝐫𝐨𝐜𝐞𝐬𝐬𝐢𝐧𝐠 𝐢𝐬 𝐠𝐚𝐢𝐧𝐢𝐧𝐠 𝐦𝐨𝐦𝐞𝐧𝐭𝐮𝐦. Unlike in previous settings, many attendees were familiar with Stream Processing and seemed to understand quickly why Python + Stream Processing is a powerful combination for real-time data transformations. (Or maybe I’ve just gotten better at explaining Bytewax? 🤔) In almost every conversation, people could think of at least one real-time use case. 🏢 𝐁𝐲𝐭𝐞𝐰𝐚𝐱 𝐂𝐚𝐧 𝐋𝐨𝐨𝐤 𝐁𝐢𝐠𝐠𝐞𝐫 𝐓𝐡𝐚𝐧 𝐈𝐭 𝐈𝐬 With a booth next to giants like NVIDIA , Microsoft , Bloomberg , and IBM it is easy to look bigger than we are. It’s flattering when people think we have global offices, but we’re still a lean startup! 🐝 𝐁𝐲𝐭𝐞𝐰𝐚𝐱 𝐬𝐰𝐚𝐠 = 𝐍𝐞𝐰 𝐘𝐨𝐫𝐤𝐞𝐫 𝐚𝐩𝐩𝐫𝐨𝐯𝐞𝐝! Our Chonky Bee keychains were a hit again, and this time, we came prepared with enough stock! Thanks to everyone who stopped by, rocked our swag, and supported us with GitHub stars 🌟. 🙏 𝐀 𝐡𝐮𝐠𝐞 𝐭𝐡𝐚𝐧𝐤 𝐲𝐨𝐮 𝐭𝐨 𝐏𝐲𝐃𝐚𝐭𝐚 𝐍𝐘𝐂 & NumFOCUS The organization was flawless, and the volunteers made everything run smoothly. We’re grateful for the opportunity to be part of this amazing conference!

And that’s a wrap! 🎉 The final day of PyData NYC is here, and what a ride it’s been! We’re leaving with hearts full of inspiration and heads buzzing with new ideas. Between exciting talks and meeting so many incredible, curious participants at our booth, it’s been a whirlwind of energy and innovation. 🚀 Our bees are flying home, but the connections we’ve made and the conversations we’ve had will stick with us. Huge thanks to everyone who stopped by, shared your thoughts, and grabbed some swag! 🐝 Shout-out to PyData Global for creating a space where old friends reunite and new ones are made. See you next time! 💛 Zander Matheson Jonas Best Federico Dolce NumFOCUS Jim Dowling Hopsworks

PyData NYC : 𝐰𝐡𝐞𝐫𝐞 𝐭𝐡𝐞 𝐟𝐮𝐭𝐮𝐫𝐞 𝐨𝐟 𝐬𝐭𝐫𝐞𝐚𝐦𝐢𝐧𝐠 𝐢𝐬 𝐛𝐞𝐢𝐧𝐠 𝐰𝐫𝐢𝐭𝐭𝐞𝐧. 🚀 Zander Matheson 🐝 just wrapped up his talk—proving that Python with a Rust heart isn’t just fast, it’s unstoppable! Who caught Zander’s talk? Share your thoughts below! 💛 PyData Global NumFOCUS

We’ve arrived! 🌟 Bytewax is live at PyData NYC , and we’re bringing all the energy to the floor! Swing by our booth to grab some of the coolest swag around and talk all things streaming data. ❗️And don’t forget—at 3:20 PM, Zander Matheson takes the stage in 𝘊𝘦𝘯𝘵𝘳𝘢𝘭 𝘗𝘢𝘳𝘬 𝘌𝘢𝘴𝘵 𝘰𝘯 𝘵𝘩𝘦 6𝘵𝘩 𝘧𝘭𝘰𝘰𝘳. He’ll explore how Bytewax leverages Python’s versatility and Rust’s speed to achieve outstanding performance. Learn how PyO3 powers Bytewax’s core, helping us tackle real-time streaming challenges while keeping development efficient and seamless. A huge shout-out to PyData Global , NumFOCUS , and especially Tomara Youngblood for lightning-fast support and Nolan Fortman for seamless organization. You make these conferences an absolute breeze! 💙 Come say hi, and let’s make the most of this amazing day! 🙌 Jonas Best Federico Dolce 🐝🐝

💥 It’s happening! PyData NYC by NumFOCUS is in full swing, and we’re ready to roll. Our team is putting the final touches on everything to meet you at our booth tomorrow morning. Have burning questions about streaming? Need insights or just want some Bytewax 🐝 swag? We’re here for it all. Make sure to swing by—we’d love to see you! 👋 https://lnkd.in/eFvumRyD

BYTE

IO:BYTEWAX

Bytewax