Thursday, December 1, 2022

Supersize Me: Hadoop Upgrade Will Handle Even Bigger Data

InfoWorld: According to Hortonworks, the next version of the Apache Foundation’s Hadoop big data processing tool will support even more data and offer faster performance. Version 0.23 of the open source tool, currently an alpha release, will eventually run across 6,000-machine clusters, each with 16 or more cores, and process 10,000 concurrent jobs. The next version of Hadoop will also offer federation and high availability for the Hadoop Distributed File System (HDFS). In addition, it will incorporate the “Yarn” upgrades for MapReduce.

The Hadoop update should become available as a general release later this year.

Similar articles

Latest Articles