Record (Message) In a kafka message, Key is not a mandatory field, but is must for compaction and grouping. Value is where the actual content/payload goes. Following picture shows a kafka message structure: Producer In kafka ecosystem, Producer is the one responsible for producing and pushing messages to kafka topics. A Producer is responsible for…
Read More →Author: Sumit Vyas
RabbitMQ Lets understand little bit about RabbitMQ and get familiar with its Messaging Architecture. When you use RabbitMQ as your messaging middleware, this is what happens -> Producers send messages to an Exchange (often compared to a post office/mailbox) which is connected to one more Queues and based on the binding policy set -> queues…
Read More →I am Sumit Vyas. I love -> to cook, eat, share, care, travel, music, read and spend time with my family! Life has been a divine journey so far, full of mixed experiences! My life path has made one thing clear for me, that nothing lasts forever – both good or bad and one should…
Read More →TOPIC When we talk about Kafka – Its all about messaging. Messages in a kafka are logically represented as Topics. So, what is a topic then? Topic is a central abstraction in a Kafka ecosystem. It is a logical entity, that spans across the length of kafka cluster. Topics are kept in a daemon service…
Read More →Time was 11 PM – sometime late July 2020, I think? I was hanging out with one of my friends, at our regular spot. We were talking about the uncertainties, challenges and the fear this COVID 19 pandemic has brought in our lives, recollecting few people we knew, that had passed away due to COVID…
Read More →Lets get into some demo, which will introduce us to lot of stuff. There will be a tendency to try to know everything but I suggest to hold on as in next blogs we will lot of stuff everything in detail. Download and setup Before installing/setting up kafka, please install java 8 on your dev…
Read More →Messaging as a integration paradigm Messaging has been one of the most important aspect of integration between software components from beginning. My first hand experience with messaging was with RabbitMQ, Weblogic JMS etc to name some. Lets look at a scenario where you’d need a messaging integration. Let us talk about Autonomous/Smart cars as I…
Read More →Event Sourcing What is Event Sourcing Event sourcing is an architectural pattern where you store application state in a sequence of events and in a microservices architecture this can be also seen as a way to replace synchronous blocking calls to other collaborating services with flow that instead broadcasts events to which other services subscribe….
Read More →Microservice? Let us try to understand, what a microservice is, by visiting the Java EE world where we used Weblogic, JBoss etc to deploy our apps? You would understand this portion of the article if you were lucky enough to have worked with those enterprise containers:-) Traditionally, in enterprise world you had one code base…
Read More →Quick introduction to Apache Livy Apache Livy is a service that enables access to spark cluster over REST interface. It enables easy submission of Spark jobs or snippets of Spark code, synchronous or asynchronous result retrieval, as well as Spark Context management, all via a simple REST interface or an RPC client library. There is…
Read More →