Monday, April 12, 2021

Supersize Me: Hadoop Upgrade Will Handle Even Bigger Data

InfoWorld: According to Hortonworks, the next version of the Apache Foundation’s Hadoop big data processing tool will support even more data and offer faster performance. Version 0.23 of the open source tool, currently an alpha release, will eventually run across 6,000-machine clusters, each with 16 or more cores, and process 10,000 concurrent jobs. The next version of Hadoop will also offer federation and high availability for the Hadoop Distributed File System (HDFS). In addition, it will incorporate the “Yarn” upgrades for MapReduce.

The Hadoop update should become available as a general release later this year.

Similar articles

Latest Articles

The Conversational AI Revolution:...

One of the things I’m looking forward to seeing at next week’s NVIDIA GTC event is an update on their Conversational AI efforts. I’m fascinated...

Edge Computing

Edge computing is a broad term that refers to a highly distributed computing framework that moves compute and storage resources closer to the exact...

Data-Driven Decision Making: Top...

The phrase data-driven decision making – certainly popular in the field of data analytics – may seem redundant. After all, nearly everything is driven...

Top Performing Artificial Intelligence...

As artificial intelligence has become a growing force in business, today’s top AI companies are leaders in this emerging technology. Often leveraging cloud computing and...