u/M0rdecay

▲ 10 r/golang

Neptunus v1.17.0 - now with Ollama in the middle of your ETL pipelines!

Neptunus is a data processing engine for consuming, transforming, and producing events. We’ve made a lot of progress since our last post:

  • gRPC inputs and outputs can now act as both clients and servers. Just provide your proto files in the configuration.
  • Parsers and serializers now support Avro, including schemas with an array as top-level type.
  • We’ve added lookups: background workers that fetch data at regular intervals. They’re useful for tasks like refreshing JWTs and loading settings from database tables.
  • Ollama can now be integrated directly into ETL pipelines with the Ollama processor.

And more! Check out the latest release and let us know what you think.

reddit.com
u/M0rdecay — 6 days ago