Thanks to an impressive grab bag of improvements in version 2.0, Spark's quasi-streaming solution has become more powerful and easier to manage Flink and Dataflow bring new innovations and target some ...

The Spark streaming analytics engine is one of the most popular open source tools for weaving big data into modern applications architectures with over 800 contributors from 200 organizations. It ...

Databricks Inc. today took some serious steps toward boosting the value proposition of the popular open-source Apache Spark big data processing engine, which is facing potent new competition. The San ...

Two years in the making, Apache Spark 2.0 will officially debut in a few weeks from Databricks Inc., which just released a technical preview so Big Data developers could get their hands on the "shiny ...

As Apache Spark becomes more widely adopted, the focus has been on creating higher-level APIs that provide increased opportunities for automatic optimization. In the talk below, Michael Armbrust, ...

Despite challenges including a new location and a nasty Nor'easter that put a crimp on travel, Spark Summit East managed to draw more than 1,500 attendees to its February 7-9 run at the John B. Hynes ...

A monthly overview of things you need to know as an architect or aspiring architect. Unlock the full InfoQ experience by logging in! Stay updated with your favorite authors and topics, engage with ...