Posts -

Power your Kafka Streams application with Amazon MSK and AWS Fargate

Note: This blog post is a reproduction of an article I previously published on AWS Blog. I wanted to share it here for my readers who may not have seen it.

Introduction

Today, companies of all sizes across all verticals design and build event-driven architectures centered around real-time streaming and stream processing. Amazon Managed Streaming for Apache Kafka (Amazon MSK) is a fully managed service that makes it easy for you to build and run applications that use Apache Kafka to process streaming and event data. Apache Kafka is an open-source platform for building real-time streaming data pipelines and applications. With Amazon MSK, you can continue to use native Apache Kafka APIs to build event-driven architectures, stream changes to and from databases, and power machine learning and analytics applications.

Continue reading “Power your Kafka Streams application with Amazon MSK and AWS Fargate”

High-Speed Data Processing at Scale

A couple of weeks ago we organized DIAMeetUp(Data-intensive application meet up) at Irvine, CA. Where I and Cahlen Humphreys talk about “High-Speed Data Processing at Scale”.
Continue reading “High-Speed Data Processing at Scale”

Apache Hive + bzip2 txt file. Why?

Hi, folks! Several weeks ago I run into illogical behavior of Apache Hive and I couldn’t find any explanations to that, so I decided to write this blog post to share those observations, hoping somebody will benefit from that(I spent half of a day debugging this) or at least could explain “why?”. So here is the story, Continue reading “Apache Hive + bzip2 txt file. Why?”

Why we need Inner and Inner static classes in Java?

Have you ever wonder why we have 4 kinds of different nested classes? What is the main difference between them? How we use it and where?
Continue reading “Why we need Inner and Inner static classes in Java?”

Elasticsearch optimistic lock(Java)

Elasticsearch is an excellent search engine, but it has few complications. One of them is updating documents/records in the index and that’s because Elasticsearch does not support ACID transactions. Elasticsearch treats all its documents as immutable. Continue reading “Elasticsearch optimistic lock(Java)”