Wednesday, December 10, 2014

IoT, messaging: Apache Kafka | LinkedIn Data Team

Apache Kafka | LinkedIn Data Team:

Apache Kafka is a distributed publish-subscribe messaging system
kafka arch

Apache Kafka - Wikipedia, the free encyclopedia

"Apache Kafka is an open-source message broker project developed by the Apache Software Foundation written in Scala. The project aims to provide a unified, high-throughput, low-latency platform for handling real-time data feeds. The design is heavily influenced by transaction logs.[2]"

"A trio of LinkedIn engineers led by Jay Kreps — the person behind a good deal of LinkedIn’s recent infrastructure advances — is leaving the company to start their own business, called Confluent.

... can start looking at building internet-of-things or other sensor-based applications, or really anything that requires getting lots of data from lots of sources into the backend systems that need it."

No comments: