Author: Sumit Vyas

Kafka – Core Components
By: Date: August 11, 2021 Categories: Kafka,Messaging Tags: , , , ,

Record (Message) In a kafka message, Key is not a mandatory field, but is must for compaction and grouping. Value is where the actual content/payload goes. Following picture shows a kafka message structure: Producer In kafka ecosystem, Producer is the one responsible for producing and pushing messages to kafka topics. A Producer is responsible for…

Read More →
RabbitMQ – A walk through
By: Date: May 15, 2021 Categories: Messaging Tags: , , ,

RabbitMQ Lets understand little bit about RabbitMQ and get familiar with its Messaging Architecture. When you use RabbitMQ as your messaging middleware, this is what happens -> Producers send messages to an Exchange (often compared to a post office/mailbox) which is connected to one more Queues and based on the binding policy set -> queues…

Read More →
About Me
By: Date: April 18, 2021 Categories: Life

I am Sumit Vyas. I love -> to cook, eat, share, care, travel, music, read and spend time with my family! Life has been a divine journey so far, full of mixed experiences! My life path has made one thing clear for me, that nothing lasts forever – both good or bad and one should…

Read More →
Introduction to kafka
By: Date: October 19, 2020 Categories: Messaging Tags: , , , , , ,

Messaging as a integration paradigm Messaging has been one of the most important aspect of integration between software components from beginning. My first hand experience with messaging was with RabbitMQ, Weblogic JMS etc to name some. Lets look at a scenario where you’d need a messaging integration. Let us talk about Autonomous/Smart cars as I…

Read More →
Microservices, Event Sourcing and CQRS
By: Date: December 24, 2018 Categories: Microservices Tags: , ,

Event Sourcing What is Event Sourcing Event sourcing is an architectural pattern where you store application state in a sequence of events and in a microservices architecture this can be also seen as a way to replace synchronous blocking calls to other collaborating services with flow that instead broadcasts events to which other services subscribe….

Read More →
Apache Spark and Livy in Action
By: Date: March 18, 2018 Categories: Apache Spark Tags: , , , , ,

Quick introduction to Apache Livy Apache Livy is a service that enables access to spark cluster over REST interface. It enables easy submission of Spark jobs or snippets of Spark code, synchronous or asynchronous result retrieval, as well as Spark Context management, all via a simple REST interface or an RPC client library. There is…

Read More →