Lib.rs

› Keywords #dataflow #distributed-systems #async-stream #data-processing

#stream-processing

  1. aws-sdk-dynamodbstreams

    AWS SDK for Amazon DynamoDB Streams

    v1.94.0 6.8K #aws-sdk #dynamo-db #stream-processing #aws-dynamo-db #record #dynamodbstreams #developer-guide

  2. rusty_dumb_tools

    A collection of simply tools Rust modules

    v0.1.15 1.1K #arguments-parser #calculator #json-processor #module #demo #stream-processing #json-stream #infix #text-based #stream-parser

  3. wavelet

    High-performance graph-based stream processing runtime

    v0.6.1 1.8K #stream-processing #computation-graph #parent-node #data-source #graph-node #garbage-collection #graph-based #factories #execution-engine #build-time

  4. sea-streamer

    🌊 The stream processing toolkit for Rust

    v0.5.0 5.3K #stream-processing #async-stream #kafka #async-stream-processing

  5. repo-stream

    Fast and robust atproto CAR file processing

    v0.4.0 #bluesky #car #stream-processing #file-processing #driver #walker #benchmark #block-store #mst #async-stream-processing

  6. sentry_arroyo

    working with streaming data

    v2.37.1 2.5K #kafka #stream-processing #arroyo #streaming #message-processing #attempt #rebalancing

  7. fluvio-stream-model

    Fluvio Event Stream Model

    v0.50.1 1.2K #fluvio #event-stream #stream-processing #distributed-systems #real-time #stream-processing-engine #cloud-native #dataflow #real-time-data-processing #wasm

  8. fiddler

    Data Stream processor written in rust

    v4.4.1 #stream-processing #yaml-config #config-file #io #module

  9. fluvio-extension-common

    Fluvio extension common

    v0.50.1 2.1K #fluvio #extension #data-processing #real-time-processing #events #data-pipeline #event-driven-architecture #stream-processing #data-integration #cloud-native

  10. fluvio-stream-dispatcher

    Fluvio Event Stream access

    v0.50.1 1.2K #event-streaming #fluvio #stream-processing #data-processing #real-time-data-processing #event-stream #distributed-systems #cloud-native #stream-processing-engine #dataflow

  11. fluvio-types

    Fluvio common types and objects

    v0.50.1 2.0K #fluvio #distributed-systems #stream-processing #data-processing #cloud-native #real-time-data-processing #dataflow #wasm #stream-processing-engine #event-processing

  12. fiddler-cli

    Data Stream processor CLI written in rust

    v4.4.1 #stream-processing #config-file #io #input #lint

  13. fluvio-package-index

    Fluvio Package Index

    v0.50.1 1.3K #fluvio #latest #stream-processing #cloud-native #data-processing #distributed-systems #real-time-data-processing #dataflow #stream-processing-engine #streaming-processing

  14. pulse-ops

    Built-in operators and combinators for Pulse dataflows — map, filter, join, window, and custom processing logic

    v0.1.2 #event-time #stream-processing #pulse #operator #parquet #rocksdb #kafka #local-first #windowing #watermarks

  15. hydro_std

    Standard library of distributed systems building blocks for Hydro

    v0.15.0 #distributed-systems #hydro #building-block #stream-processing #framework #distributed-applications #processing-stream #intermediate-representation #memory-safety #dataflow

  16. rsp-rs

    A RDF Stream Processing engine in Rust, supporting RSP-QL queries with sliding windows and real-time analytics

    v0.3.5 #rdf #stream-processing #real-time #rsp-ql #sparql

  17. rust-stream-ext-concurrent

    Concurrent behavior extensions for any futures::stream::Stream objects

    v2.0.0 950 #future-stream #stream-processing #future-concurrency #extension #object #futures-unordered #concurrency-execution

  18. renoir

    Reactive Network of Operators In Rust

    v0.6.0 #operator #stream-processing #reactive #distributed-systems #block #dataflow #dataflow-programming #dataflow-graph #parallel-data-processing #distributed-data-processing

  19. vuo

    An asynchronous stream processing library for Rust, built on Actix, providing a rich set of functional operators

    v0.1.1 #stream-processing #async-stream-processing #actix #operator #actor #processing-pipeline #emit

  20. llm-optimizer-processor

    Data processing and transformation pipeline

    v0.1.1 #stream-processing #data-processing #standard-deviation #deduplicate #timestamp #event-time #performance-monitoring #llm #moving-average #sliding-window

  21. callysto

    Stream processing framework

    v0.1.11 550 #stream-processing #microservices #distributed-database #distributed #database

  22. streamweave

    Composable, async, stream-first computation in pure Rust

    v0.9.0 #string-interning #data-processing #async-stream #data-pipeline #rust #stream-processing #async-pipeline #async-data-processing #async-stream-processing

  23. fluvio-spu-schema

    Fluvio API for SPU

    v0.50.1 1.2K #fluvio #spu #api-for-spu #distributed-systems #data-processing #stream-processing #event-driven-architecture #real-time-data-processing #data-pipeline #cloud-native

  24. track-rails

    Rust Version of TrackRails Protocol

    v0.1.2 700 #data-processing #stream-processing #protocols #processing-stream

  25. pulse-core

    Core runtime and dataflow engine for Pulse — defines execution graph, operators, and streaming primitives

    v0.1.2 #prometheus #stream-processing #event-time #parquet #operator #rocksdb #kafka #local-first #metrics #watermarks

  26. indicator

    Abstractions for stream aggregation, we call them Indicator s

    v0.4.4 110 #stream-processing #aggregation #no-std

  27. azoth-bus

    Multi-consumer pub/sub bus built on Azoth primitives

    v0.2.1 #pub-sub #multi-consumer #azoth #events-bus #async-stream #retention #stream-processing #notifications #logging #policies

  28. sfo-io

    handling IO operations, providing asynchronous read/write and stream processing capabilities

    v0.1.15 150 #async-stream #async-io #stream-processing #capabilities #operation #iops

  29. sea-streamer-socket

    🌊 SeaStreamer backend-agnostic Socket API

    v0.5.2 6.1K #stream-processing #kafka #async-stream #async

  30. spring-stream

    Integrate sea-streamer with spring-rs

    v0.4.3 #stream-processing #kafka #redis-stream #spring

  31. sea-streamer-redis

    🌊 SeaStreamer Redis Backend

    v0.5.2 7.1K #stream-processing #async-stream #redis

  32. arcon

    A runtime for writing streaming applications

    v0.2.1 #streaming #stream-processing #run-time #arrow #conf #dataflow

  33. par-stream

    Asynchronous parallel streams analogous to rayon

    v0.10.2 3.0K #async-stream #stream-processing #parallel-worker #stream-combinator #data-processing #tokio-runtime #async-std-runtime #broadcast #analogous

  34. rlink

    High performance Stream Processing Framework

    v0.6.16 #stream-processing #flink #window

  35. rusty-tracks

    Rust client to connect to DataTracks

    v0.0.12 360 #stream-processing #data #stream-data

  36. xstream-util

    A command line tool to split a stream to child processes

    v2.0.0 #child-process #stream-processing #split #pipe #command-line-tool #piped

  37. sea-streamer-file

    🌊 SeaStreamer File Backend

    v0.5.2 6.4K #stream-processing #async-stream

  38. hydroflow_cli_integration

    hydro_cli integration for Hydroflow

    v0.5.2 430 #dataflow #hydroflow #stream-processing #service #hydro #intermediate-representation #memory-safety #dfir #distributed #ide

  39. sea-streamer-types

    🌊 SeaStreamer Traits & Types

    v0.5.2 6.7K #stream-processing #async-stream #async

  40. fionn-stream

    Streaming JSON/JSONL processing for fionn

    v0.2.0 #stream-processing #streaming-json #jsonl

  41. voice-stream

    Voice stream is a real-time audio stream processing with voice activity detection. This library provides a high-level interface for capturing audio input, performing voice detection using Silero VAD…

    v0.4.0 290 #real-time-audio #voice-activity #audio-stream #real-time-audio-processing #stream-processing #input-device #multi-channel #vad #voice-activity-detection #silero

  42. rspl

    A stream processor language

    v0.1.2 #stream-processing #demand-driven #state-machine #processing-stream #language

  43. hydro_optimize

    Automatic decoupling and partitioning

    v0.13.0 #hydro #decoupling #automatic #framework #partitioning #distributed #distributed-systems #stream-processing #intermediate-representation #dataflow

  44. fluvio-system-util

    Fluvio System components

    v0.1.1 #fluvio #stream-processing #distributed-systems #data-processing #cloud-native #system-utilities #stream-processing-engine #real-time-data-processing #dataflow #streaming-processing

  45. springql

    Open-source stream processor for IoT devices and in-vehicle computers

    v0.18.1 #stream-processing #iot

  46. noir-compute

    Network of Operators In Rust

    v0.2.0 #data-processing #stream-processing #operator #distributed-data-processing #block #noir #distributed-systems #dataflow-graph #dataflow-programming

  47. sea-streamer-stdio

    🌊 SeaStreamer Standard I/O Backend

    v0.5.0 7.1K #stream-processing #async-stream #async-stream-processing

  48. fluvio-runner-local

    Fluvio Engine Runner

    v0.3.0 #fluvio #stream-processing #distributed-systems #data-processing #wasm #dataflow #real-time #real-time-processing #data-pipeline

  49. sea-streamer-examples

    🌊 The stream processing toolkit for Rust

    v0.5.0 200 #stream-processing #kafka #sea-streamer #batch-processing #redis #blocking #websocket #async-await

  50. rsflow

    High-performance Rust flow processing engine

    v0.1.0 #stream-processing #data-processing #artificial-intelligence #stream-processing-engine #sql #kafka #real-time-data-processing #event-processing #data-stream #redis

  51. iterpipes

    Compositional, pipes-style stream processing

    v0.2.0 #stream-processing #iterator #pipe #compositional #abstraction-layer #input-item

  52. arkflow

    High-performance Rust flow processing engine

    v0.1.0 #stream-processing #stream-processing-engine #data #sql #protobuf #data-stream #kafka #batch-processing #json-processing #async-data-processing

  53. sea-streamer-kafka

    🌊 SeaStreamer Kafka / Redpanda Backend

    v0.5.0 7.1K #stream-processing #kafka #async-stream

  54. fluvio-controlplane

    Fluvio control plane API

    v0.6.0 #fluvio #control-plane #distributed-systems #stream-processing #api #cloud-native #dataflow #real-time-data-processing #wasm

  55. sea-streamer-fuse

    Stream processing toolbox

    v0.5.2 #stream-processing #async-stream #async-stream-processing

  56. d-rs

    stream processing utilities for the command line

    v0.2.0 #stream-processing #command-line-utilities #regex #split #grep #sed #awk

  57. arkflow-plugin

    High-performance Rust flow processing engine

    v0.1.0 #stream-processing #data #stream-processing-engine #sql #protobuf #dataflow #kafka #mqtt #batch-processing #processing-stream

  58. st2-logformat

    Adapter-agnostic definitions for data types used by ST2

    v0.1.0 #stream-processing #st2 #log-record #timely-dataflow #computation #logging #pag #critical-path

  59. fluxus-source-gharchive

    A Fluxus source component for processing and analyzing GitHub Archive data streams, providing efficient access to historical GitHub event data

    v0.1.0 #stream-processing #real-time #gharchive #data-stream #real-time-data-processing

  60. yomo

    development sdk

    v0.3.0 #sdk #serverless #edge-computing #low-latency #serverless-framework #geo-distributed #stream-processing #metaverse #app-framework

  61. parallel_reader

    reading from a file (or any Read stream) and processing it by chunks, in parallel

    v0.1.2 #stream-processing #read-stream #read-file #parallel #chunks #file-processing #processing-stream #async-stream

  62. fluvio-storage

    Storage for Fluvio platform

    v0.3.0 #fluvio #storage #storage-cli #logging #stream-processing #debugging #data-pipeline

  63. hadron-client

    The Hadron Rust client library

    v0.1.0-beta.1 #cloud-events #stream-processing #hadron #workflow #events

  64. fluxus-utils

    components for Fluxus stream processing engine

    v0.2.0 160 #data-processing #async #stream-processing #real-time-data-processing #real-time

  65. fluxus-sinks

    Sink components for Fluxus stream processing engine

    v0.2.0 110 #stream-processing #data-processing #real-time-data-processing #real-time #analytics #real-time-analytics

  66. fluxus-transformers

    Transformer components for Fluxus stream processing engine

    v0.2.0 120 #data-processing #stream-processing #async #real-time-analytics #real-time-data-processing #real-time

  67. fluxus-runtime

    Runtime implementation for Fluxus stream processing engine

    v0.2.0 #stream-processing #stream-processing-engine #fluxus #run-time #task-execution #async-stream-processing

  68. hamlet

    Html token definitions for stream processing

    v0.2.1 #stream-processing #html

  69. hydroflow_datalog_core

    Datalog implementation for Hydroflow

    v0.10.0 950 #hydroflow #logic-programming #datalog #dataflow #hydro #stream-processing #intermediate-representation #memory-safety #dfir #distributed

    70. Try searching with DuckDuckGo.

  70. fluxus-sink-telegram

    A Telegram sink component for the Fluxus stream processing framework, enabling real-time message delivery to Telegram channels and chats

    v0.1.0 #stream-processing #real-time #data-processing #telegram #analytics #real-time-data-processing

  71. callysto-avro

    Avro serde for Callysto Stream Processing Framework

    v0.1.2 #stream-processing #microservices #distributed-database #distributed-microservices #distributed #database

  72. dfir_datalog_core

    Datalog implementation for DFIR

    v0.13.0 #dfir #dataflow #framework #distributed #datalog #distributed-systems #hydro #stream-processing #intermediate-representation #memory-safety

  73. fluxus-sources

    Source components for Fluxus stream processing engine

    v0.2.0 120 #data-processing #real-time #stream-processing #async #analytics #real-time-data-processing

  74. blob-stream

    Blob transfer over chunks (datagrams)

    v0.0.3 150 #blob #stream-processing #binary-data #datagram #transfer #fixed-size #data-chunks #serialization #divided #binary-stream

  75. event-stream-processor

    Event stream processor for server side events

    v1.0.0 110 #stream-processing #events #server-side #event-stream #web-api #server-sent-events

  76. springql-foreign-service

    Foregin Sources / Sinks for SpringQL

    v0.4.0 #spring-ql #stream-processing #service

  77. springql-core

    SpringQL: Open-source stream processor for IoT devices and in-vehicle computers

    v0.18.1 120 #stream-processing #iot

  78. sonicd

    client library for Sonicd, a data streaming gateway

    v0.6.0 #data-streaming #data-source #gateway #client #connector #stream-data #websocket #stream-processing

  79. dfir_datalog

    Datalog proc-macro for DFIR

    v0.13.0 260 #dfir #datalog #hydro #framework #distributed #proc-macro #distributed-systems #intermediate-representation #stream-processing #dataflow

  80. springql-test-logger

    Logger for #[cfg(test)] in SpringQL

    v0.4.0 #spring-ql #stream-processing #iot

  81. arcon_error

    Arcon's common error utilities

    v0.1.1 #arcon #error #utilities #stream-processing

  82. arcon_state

    State management features for Arcon

    v0.2.1 #state-management #arcon #management-for-arcon #stream-processing #management-system

  83. hydroflow_macro

    Macro for using Hydroflow's Surface Syntax

    v0.10.0 #hydroflow #macro #syntax #surface #hydro #distributed #intermediate-representation #stream-processing #dataflow #memory-safety

  84. arcon_codegen

    Code generation for Arcon

    v0.1.4 #codegen #arcon #generation-for-arcon #part #stream-processing

  85. arkflow-core

    High-performance Rust flow processing engine

    v0.1.0 #stream-processing #stream-processing-engine #data #sql #flow #data-fusion #artificial-intelligence

  86. redis-streams-dump

    A small utility to dump Redis Streams content into a SeaStreamer file

    v0.3.0 #stream-processing #async-stream #redis

  87. hydroflow_datalog

    Datalog proc-macro for Hydroflow

    v0.10.0 140 #hydroflow #datalog #proc-macro #hydro #distributed #intermediate-representation #stream-processing #dataflow #memory-safety #dfir

  88. hydro_build_utils

    build and test utils for hydro

    v0.0.1 #hydro #framework #distributed #correct #distributed-systems #intermediate-representation #stream-processing #dataflow #memory-safety #dfir

  89. spaniel

    Base implementation of a Stream Processing Network Library (SPNL)

    v0.1.0 #stream-processing #networking #processing-stream #spnl

  90. example_test

    Test cargo example code

    v0.0.0 #framework #distributed #correct #cargo #distributed-systems #hydro #stream-processing #intermediate-representation #dataflow #memory-safety

  91. indicator_macros

    Abstractions for stream aggregation, we call them Indicator s

    v0.4.4 650 #stream-processing #aggregation #no-std

  92. mz

    Materialize root namespace

    v0.0.0 #materialize #sql #namespaces #root #profile #env-file #csv #stream-processing #config-file #sql-server