stop managing
data pipelines.
start shipping
features that matter.
The complexity of bringing together streaming, datalake, and schema management is holding your team back.
Wings is your open-source streaming platform. It uses zero-copy Iceberg storage to eliminate data duplication, giving you the power to own your entire data stack and simplify your architecture.
star us on githubpowered by
zero copy iceberg topics
wings stores topics data into an apache iceberg catalog. stream data with wings, or query using any apache iceberg reader
fine grained partitioning
Partition data based on your domain's key. not a scaling strategy. data in iceberg looks nicer.
open source
can self host all of it, no data or metadata sent to external servers.
native schema management
We manage the topics schema and allow schema operations such as adding and removing columns.
separate data and metadata
we separate data from metadata, and storage from compute. deployment is easy with the metadata server using cloud services for storage.
arrow flight sql
push and pull data using arrow flight. query any data and metadata using sql.
multi bucket
use express buckets for lower latency real time data, use normal buckets for compacted data
distributed cache
we leverage LiquidCache to implement distributed pushdown caching and reduce the number of s3 requests, improving latency and reducing cost.
extensible authorization and secret management
wings interacts with external services to provide authentication, authorization, and secret management. object store config is safely store in external vaults.
rust core, typescript sdk
wings is implemented in rust, leveraging the arrow and datafusion ecosystem. we provide a typescript sdk for best-in-class developer experience.