Saturday, June 13, 2015

Big Data event processing: Spark, Storm, Twitter Heron (!)

Infographic: The Four V's of Big Data | The Big Data Hub
The Four V's of Big Data

Choose your real-time weapon: Storm or Spark? @ InfoWorld
this is for Velocity: steaming data

bigdata - Apache Spark vs. Apache Storm - Stack Overflow

Spark, Storm and Real Time Analytics @ InfoQ


Twitter Has Replaced Storm with Heron @ InfoQ

"Twitter has replaced Storm with Heron which provides up to 14 times more throughput and up to 10 times less latency on a word count topology, and helped them reduce the needed hardware to a third.

Twitter used Storm to analyze large amounts of data in real time for years, and open sourced it back in 2011. The project was later incubated at Apache, becoming a top level project last fall. Having a quarterly release cycle, Storm has reached version 0.9.5 and is approaching the stable and desired version 1.0. But all this time, Twitter has been working on a replacement called Heron because Storm is no longer up to the task for their real-time processing needs.


Twitter’s new real-time requirements are: “billions of events per minute; have sub-second latency and predictable behavior at scale;"



"Compatibility with Storm: Heron provides full backward compatibility with Storm,"

"overall 3x reduction in hardware"



Removing the 140 character limit from Direct Messages - Announcements - Twitter Developers

History of Apache Storm and lessons learned - thoughts from the red planet - thoughts from the red planet (by Nathan Marz, creator of Storm)

Twitter Heron: Stream Processing at Scale | the morning paper

cover story: What is Code?

Paul Ford: What is Code? | Bloomberg BusinessWeek by Paul Ford

112 pages, 38000 words, with nice and accurate illustrations


What Is Code? An Essay in 38,000 Words by Paul Ford - Bloomberg Business

BloombergMedia/whatiscode · GitHub

abbreviated version
I Read This Mammoth Essay on Code To Make You 38 Thousand Times Smarter

Microsoft Surface Hub

Microsoft Surface Hub

The Untold Story Of Microsoft's Surface Hub | Fast Company | Business + Innovation


84"


55"

"Microsoft will begin taking Surface Hub orders on July 1—globally, in 24 markets—and expects the first units to reach customers in September. The 84-inch model, with a 4K screen and an Intel Core i7 processor, will have a suggested price of $19,999. It's designed for conference rooms that accommodate seven to 10 people. A 55-inch version with a 1080p screen and Core i5 chip, meant for smaller "huddle spaces," will go for $6999."


Plan to learn faster: Optimized Business @ O'Reilly

Plan to learn faster - O'Reilly Radar
not_like_this
"...illustrates a broken release strategy where at every release I get something I can’t use, until the last release when I get something I can."like_this
"...this way, in each release I deliver something people can actually use"

validated_learning_loop