Akka Streams Kafka 0 11 Akka Consumer. a consumer subscribes to kafka topics and passes the messages into an akka stream. the underlying implementation is using the kafkaconsumer, see kafka api for a description of consumer groups, offsets, and other details. Akka.streams.kafka stages utilizes stream supervision deciders to dictate what happens when a failure or exception is thrown from inside the stream stage. these deciders are basically delegate functions that returns an akka.streams.supervision.directive enumeration to tell the stage how to behave when a specific exception occured during the.
Akka Streams Kafka Kinesis Following akka’s conventions there are two separate packages named akka.kafka.scaladsl and akka.kafka.javadsl with the api for scala and java. these packages contain producer and consumer classes with factory methods for the various akka streams flow, sink and source that are producing or consuming messages to from kafka. examples. 1. akka streams emerged as a dataflow centric abstraction for the akka actors model. these are high performance library built for the jvm and specially designed for general purpose microservices. whereas as long as kafka streams is concerned, these are client libraries used to process unbounded data. The first scenario represents a consumer which reads messages from kafka and pushes it through a non blocking processing stage, without commit. the reactive setup (akka plain consumer) gets very close (80%) to full speed achieved with a while loop pulling elements from a consumer (plain consumer). In this post i’m writing about, how to build kafka consumer with scala and akka streams (by using alpakka kafka connector). following are the steps to follow. i’m building sbt based scala.
Comments are closed.