It's become a annual tradition at Datamation to publish an complete roundup of all the open source projects we've featured throughout the year. This year's update includes a vast trove of open source software: 1,343 different projects, from 138 different categories, including two brand new categories.
This year's open source list has quite a few new additions related to cloud computing, the Internet of Things (IoT) and artificial intelligence (AI). It also has quite a few new projects related to marketing software.
Please note that this is not a ranking. The projects are organized into categories and then listed alphabetically within the categories.
As always, if you know of additional open source software that you'd like to see us cover in future lists, feel free to note them in the Comments section below.
|Table of Contents|
Sure, you’re a Windows user – in fact you’re using an up to date Windows OS. But in today’s world, it’s still entirely likely you’re looking for the best open source software for your PC. This list gathers some familiar names with lesser known apps, all with an eye toward boosting your Windows 10 machine. Which app do you think is the best open source software for Win10
There are countless websites that offer extensive lists of open source software to download. But finding the best open source website is easier said than done. To help, we’ve compiled a list of the very best open source websites – let the downloading begin.
In this aggregation of open source BI tools, you’ll certainly see some famous names: MySQL, Pentaho, along with some names that get less buzz as well. Of course in the rapidly changing business intelligence market, today’s big names could easily be surpassed over time by a little known tool – feature sets change quickly. Which open source BI tool on this list will be most popular in the years ahead?
There’s no debate about it: Windows XP is an aging operating system. For those looking to replace it – and yes, it’s time – with an open source operating system, this is the list for you. This survey of open source operating systems includes superstars like Ubuntu along with solid players like Knoppix. Come on, replace that old Windows OS!
It makes perfect sense: you’re using financial software to track your expenses, so naturally you’re interested in open source financial software. Open source – much of which is a free download – is made for penny pinchers. The open source financial software in this list may save you, in some cases, hundreds of dollars. A penny saved is a penny earned.
It’s clear that, as value propositions go, this one’s a no-brainer: replace your expensive apps with low-cost or free open source applications. Certainly there’s debate about feature sets: some commercial software partisans argue that the feature sets for open source applications do not match their commercial counterparts. Undoubtedly the other side disagrees strongly. You can be the judge – download a few open source applications and check them out. Do they compare?
Open source business software is, in many cases, the ideal solution for small businesses. If you’re as cash-strapped as many SMBs, you’ll certainly want to look at this list of open source business software. Bottom line: free or low cost is better than high priced, even if that requires giving up some familiar software choices to explore options that are lesser known. If money is tight, open source business software can often be a useful option.
Launched in 2013, this site aims to provide information on making other websites accessible to people with a variety of impairments, particularly those who are blind. You can read the content at the link above; if you'd like to contribute, visit the project's GitHub page. Operating System: OS Independent
This web-based accounting package was created with small and medium-sized businesses (SMBs) in mind. It includes CRM, work order and invoice capabilities as well as standard accounting features. Check out the online demo to see it in action. Operating System: OS Independent
Another web-based accounting option for SMBs, FrontAccounting boasts inventory tracking and manufacturing management abilities. It's been downloaded more than 200,000 times. Operating System: OS Independent
GnuCash combines personal finance software with small business accounting software, which some small business owners find helpful. It can track investments, create graphs, import financial data, set up scheduled transactions and perform standard double-entry accounting. Operating System: Windows, Linux, OS X
LedgerSMB combines ERP and accounting capabilities in a single package, and it also includes a flexible development framework for extending its features. It has been downloaded more than 86,000 times since 2006. Operating System: Windows, Linux, OS X
Used by more than 80,000 businesses, TurboCASH is a flexible accounting package that compares favorably with QuickBooks and Sage. It was created in the UK but also has a chart of accounts and currency features designed for U.S. businesses. Operating System: Windows
The OpenDisc project collects many of the most popular open source applications for Windows into one download. You can also get the project on a CD for a donation of $10. Operating System: Windows
ASSP claims to be "the absolute best SPAM fighting weapon that the world has ever known!" It offers easy, browser-based setup and works with most mail servers. Operating System: OS Independent.
Downloaded more than 1.3 million times, MailScanner is based on SpamAssassin and works with anti-virus software like ClamAV to protect mail servers at companies or ISPs. Support is available through third-party companies. Operating System: OS Independent.
10. Scrollout F1
This full-featured mail security solution incorporates anti-spam, anti-virus and other capabilities with an interface that the project creators say is as easy to use as a car radio. Paid support is available. Operating System: Windows, Linux.
This Apache project claims to be the "#1 Enterprise Open-Source Spam Filter." It uses a wide variety of methods to identify and block spam, and it works with nearly all mail servers. Operating System: primarily Linux and OS X, although Windows versions are available.
SpamBayes uses statistical algorithms to calculate the probability that an incoming message is spam, and it adapts over time as spammers change their methods. It's available as a plug-in for many popular email services and clients, including Outlook, Thunderbird and others. Operating System: OS Independent.
One of the most popular open source security applications, ClamAV has been incorporated into many different products and has been called "the de facto standard for mail gateway scanning." The core program works on UNIX-based systems, but the website also offers information on Immunet, a ClamAV-based Windows solution that is available in both free and paid versions. Operating System: Linux, but front-ends and additional versions are available for other OSes.
This variation on ClamAV adds an easy-to-use GUI to the popular anti-virus engine. Now ten years old, this is a mature project that is included in many Linux distributions. Operating System: Linux.
This Windows-based version of ClamAV boasts more than 600,000 users. It offers a scanning scheduler, integration with Windows Explorer and Outlook, automatic downloads of the updated malware database and support for Windows 7 and 8. Operating System: Windows.
The brainchild of a UC Berkeley PhD candidate, Caffe is a deep learning framework based on expressive architecture and extensible code. It's claim to fame is its speed, which makes it popular with both researchers and enterprise users. According to its website, it can process more than 60 million images in a single day using just one NVIDIA K40 GPU. It is managed by the Berkeley Vision and Learning Center (BVLC), and companies like NVIDIA and Amazon have made grants to support its development.
Short for Computational Network Toolkit, CNTK is one of Microsoft's open source artificial intelligence tools. It boasts outstanding performance whether it is running on a system with only CPUs, a single GPU, multiple GPUs or multiple machines with multiple GPUs. Microsoft has primarily utilized it for research into speech recognition, but it is also useful for applications like machine translation, image recognition, image captioning, text processing, language understanding and language modeling.
Deeplearning4j is an open source deep learning library for the Java Virtual Machine (JVM). It runs in distributed environments and integrates with both Hadoop and Apache Spark. It makes it possible to configure deep neural networks, and it's compatible with Java, Scala and other JVM languages.
The project is managed by a commercial company called Skymind, which offers paid support, training and an enterprise distribution of Deeplearning4j.
Like CNTK, the Distributed Machine Learning Toolkit (DMTK) is one of Microsoft's open source artificial intelligence tools. Designed for use in big data applications, it aims to make it faster to train AI systems. It consists of three key components: the DMTK framework, the LightLDA topic model algorithm, and the Distributed (Multisense) Word Embedding algorithm. As proof of DMTK's speed, Microsoft says that on an eight-cluster machine, it can "train a topic model with 1 million topics and a 10-million-word vocabulary (for a total of 10 trillion parameters), on a document collection with over 100-billion tokens," a feat that is unparalleled by other tools.
Focused more on enterprise uses for AI than on research, H2O has large companies like Capital One, Cisco, Nielsen Catalina, PayPal and Transamerica among its users. It claims to make is possible for anyone to use the power of machine learning and predictive analytics to solve business problems. It can be used for predictive modeling, risk and fraud analysis, insurance analytics, advertising technology, healthcare and customer intelligence.
It comes in two open source versions: standard H2O and Sparkling Water, which is integrated with Apache Spark. Paid enterprise support is also available.
Managed by a company called Numenta, NuPIC is an open source artificial intelligence project based on a theory called Hierarchical Temporal Memory, or HTM. Essentially, HTM is an attempt to create a computer system modeled after the human neocortex. The goal is to create machines that "approach or exceed human level performance for many cognitive tasks."
In addition to the open source license, Numenta also offers NuPic under a commercial license, and it also offers licenses on the patents that underlie the technology.
Developed by a company called Cycorp, OpenCyc provides access to the Cyc knowledge base and commonsense reasoning engine. It includes more than 239,000 terms, about 2,093,000 triples, and about 69,000 owl:sameAs links to external semantic data namespaces. It is useful for rich domain modeling, semantic data integration, text understanding, domain-specific expert systems and game AIs. The company also offers two other versions of Cyc: one for researchers that is free but not open source and one for enterprise use that requires a fee.
Designed for researchers and developers with advanced understanding of artificial intelligence, OpenNN is a C++ programming library for implementing neural networks. Its key features include deep architectures and fast performance. Extensive documentation is available on the website, including an introductory tutorial that explains the basics of neural networks. Paid support for OpenNNis available through Artelnics, a Spain-based firm that specializes in predictive analytics.
First developed by IBM, SystemML is now an Apache big data project. It offers a highly-scalable platform that can implement high-level math and algorithms written in R or a Python-like syntax. Enterprises are already using it to track customer service on auto repairs, to direct airport traffic and to link social media data with banking customers. It can run on top of Spark or Hadoop.
TensorFlow is one of Google's open source artificial intelligence tools. It offers a library for numerical computation using data flow graphs. It can run on a wide variety of different systems with single- or multi-CPUs and GPUs and even runs on mobile devices. It boasts deep flexibility, true portability, automatic differential capabilities and support for Python and C++. The website includes a very extensive list of tutorials and how-tos for developers or researchers interested in using or extending its capabilities.
Torch describes itself as "a scientific computing framework with wide support for machine learning algorithms that puts GPUs first." The emphasis here is on flexibility and speed. In addition, it's fairly easy to use with packages for machine learning, computer vision, signal processing, parallel processing, image, video, audio and networking. It relies on a scripting language called LuaJIT that is based on Lua.
Travel virtually to anywhere in the known universe at any time with Celestia. It displays hundreds of thousands of celestial bodies as they would appear in the night skies. Operating System: Windows, Linux, OS X.
Similar to Stellarium, KStars lets users view "up to 100 million stars, 13,000 deep-sky objects, all 8 planets, the sun and moon, and thousands of comets and asteroids." It also includes a number of tools helpful for amateur astronomers, such as an observation list, an FOV editor, a sky calendar, supernova alerts and a glossary of technical terms. (Note that in order to use KStars on Windows, you'll have to download KDE for Windows.) Operating System: Windows, Linux
Another option for budding astronomers, this one confines the point of view to planet earth rather than allowing users to zoom throughout the universe, but it is so accurate that it is used by many planetariums. Operating System: Windows, Linux, OS X.
Amarok invites users to rediscover their music. It integrates with a variety of Web services and includes features like dynamic playlists, collection management, bookmarking, file tracking and import from other music databases, including iTunes. Operating System: Windows, Linux, OS X, iOS.
Designed for use by professional audio engineers, musicians, soundtrack editors and composers, Ardour is a complete audio recording, mixing and editing suite. Key features include support for most hardware, flexible recording, unlimited multichannel tracks, unlimited undo/redo and much more. Operating System: Linux, OS X
This Java-based music player and manager displays complete information—including lyrics—for the song currently playing. It's a good option for users with particularly large music collections. Operating System: OS Independent
Unlike some audio players, Audacious doesn't use a lot of system resources, so it doesn't degrade system performance when you're using your PC for other tasks as well as listening to music. The latest update offers improved playlist shuffling, easier recording of Internet streams and a better equalizer interface. Operating System: Windows, Linux.
A perennial favorite among Linux desktop users, Audacity gets hundreds of thousands of downloads per month. It was updated in July with new scrubbing and seeking features, preset effects and improved plug-in installation. Operating System: Windows, Linux, OS X
Downloaded more than 60 million times, CDex is a simple, handy tool for converting CDs to data files. It supports multiple file formats, including WAV, MP3, FLAC, AAC, WMA and OGG. Operating System: Windows.
This suite of command-line tools includes the cdrecord CD/DVD/Blu-ray recording software, as well as tools for reading optical media, extracting audio, and more. It's a mature project that has been around for quite a few years. Operating System: Windows, Linux, OS X.
Cdrtfe serves as a front-end for cdrtools and some other command-line recording applications. It can burn audio CDs, data discs, bootable discs, DVD-Video discs, ISO images and other types of optical media. The latest version supports Windows 10. Operating System: Windows.
Based on an older version of Amarok, Clementine focuses on providing "a fast and easy-to-use interface for searching and playing your music." It supports Internet radio streams, cloud computing services like Dropbox and Google Drive, CUE sheets, tabbed playlists, audio CD playback and much more. Operating System: Windows, Linux, OS X, Android.
This self-proclaimed "ultimate music player" supports a very long list of file formats. Key features include cue sheet support, tabbed playlists, cover art display, 18-band graphic equalizer, tag editor, gapless playback and more. Operating System: Linux, Unix, Android.
EasyTAG allows users to view and edit the tag fields on MP3, MP2, MP4/AAC, FLAC, Ogg Vorbis, MusePack, Monkey's Audio, and WavPack files. It includes a tree-based browser and CDDB support for manual and automatic searches. Operating System: Windows, Linux
Another option for Linux users, Exaile offers both playback and a powerful music manager. Key features include smart playlists, advanced track tagging, multiple plug-ins, automatic album art, lyrics and much more. Operating System: Linux.
This tool was made for audiophiles who like to keep their original music in the lossless FLAC file format. FlacSquisher converts those files to MP3s so that users can take them with them on mobile devices without taking up too much space. Operating System: Windows.
Fre:AC stands for "free audio converter," and it can rip audio CDs or convert among numerous file formats. It's also portable, meaning that you can run it from a USB thumb drive without installing it on your system. Operating System: Windows.
Java-based Frinika is a lightweight but fairly complete music workstation. It includes a sequencer, soft-synths, real-time effects and recording capabilities. Operating System: OS Independent
Giada describes itself as "a free, minimal, hardcore audio tool for DJs, live performers and electronic musicians." It's not quite as full-featured as the other options on the list, but it is an effective, lightweight looping tool. Operating System: Linux.
Created for "all music enthusiasts," Guayadeque is a full-featured music management system that can handle large file collections. Noteworthy features include a configurable crossfader engine, configurable silence detector for gapless playback, labeling, smart play mode, last.fm support and more. Operating System: Linux
"Professional yet simple and intuitive," Hydrogen is a drum machine for Linux only. The video on the site helps you quickly see how it works and what it can do. Operating System: Windows, Linux, OS X.
Java-based Jajuk works on multiple platforms. Aimed at advanced users, it offers a very full feature set as well as an intuitive interface. Operating System: OS Independent.
Formerly a paid app, Jams is now an open source Android music player with an elegant interface. It can connect to Google Play Music for purchasing songs and includes features like tag support, blacklisting, 9-band equalizer, scrobbling, crossfade, album art download and more. Operating System: Android.
This KDE app plays both Midi and karaoke files, making it easy for you to serenade your sweetheart. It includes a piano player interface and also accepts input from external keyboards. Operating System: Windows
"Made by musicians, for musicians," LMMS is a full-featured music production system with plenty of presets and samples built in. Note that despite the word "Linux" in the name, it is available for Windows and OS X as well. Operating System: Windows, Linux, OS X
Made for professional DJs, Mixxx offers "everything you need to start making DJ mixes in a tight, integrated package." It supports more than 30 DJ MIDI controllers, integrates with iTunes and includes BPM detection and sync. Operating System: Windows, Linux, OS X.
Simply select a directory, and the MOC (Music On Console) audio player will play all files in that directory. Supported file formats include MP3, Ogg Vorbis, FLAC, Musepack, Speex, WAVE, AIFF, and AU. Operating System: Linux/Unix, OS X
Mp3splt is an audio utility that does just one thing—it lets you cut mp3 and ogg files into smaller files and rename them. It’s especially useful if you need to split an entire album into individual tracks. Operating System: Windows, Linux, OS X
If you are a musician, teacher or composer interested in generating your own sheet music, MuseScore makes it very easy and offers most of the same features you'll find in the proprietary software. The website includes some tutorials and plenty of other help to get you started, and the interface is very intuitive. Operating System: Windows, Linux, OS X
Nightingale promises users "a beautiful interface with a wide range of supported audio formats, all with multi-platform support." It has a large library of add-ons that extend its capabilities. Operating System: Windows, Linux, OS X.
Another open source option for creating your own drum loops and feeds, orDrumbox offers an easy-to-use interface. Features include auto-composition, poly-rhythms, an arpeggiator, automatic sounds/track matching , custom soft-synths and low-fi rendering. Operating System: Windows, Linux, OS X.
Qmmp, which stands for "Qt-based MultiMedia Player," offers features like support for skins, 10-band equalizer, streaming playback, cover art, cue sheet support and multiple playlists. Its interface is very simple and similar to older apps like Winamp and XMMS. Operating System: Windows, Linux
59. Radio Downloader
If your favorite online radio station only offers streaming content, you can turn it into a podcast you can listen to any time with Radio Downloader. It comes with built-in support for BBC content and a helpful "favourites" tab. Operating System: Windows
Rhythmbox is a Linux-only audio player for the GNOME desktop. The interface and feature set are fairly basic. Operating System: Linux.
This cross-platform command line tool calls itself the "Swiss Army knife of sound processing programs." It can convert files from one type to another, record and play audio files, and add effects. Operating System: Windows, Linux, OS X.
This app provides an interface to three other popular open source video tools: FFMPEG, MEncoder and Mplayer. It can convert video files, rip unprotected DVDs, add subtitles, download from YouTube, extract audio or video and more. Operating System: Windows.
63. XiX Music Player
This cross-platform player supports album art and lyrics, reverse play, crossfading, trimming, shuffle, repeat, song rating, search, and more. It's also small enough to run on a Raspberry Pi board. Operating System: Windows, Linux, OS X
This Linux-only tool was designed for beat mixing and scratch mixing. Features include needle drops, pitch changes, scratching, spinbacks and rewinds. Operating System: Linux.
Yoshimi is a Linux-only software synthesizer forked from an older version of ZynAddSubFX. The project name comes from a song by The Flaming Lips. Operating System: Linux.
This software synthesizer comes in Windows and Linux versions. Features include real-time, polyphonic, multitimbral and microtonal capabilities and a long list of effects and filters. Operating System: Windows, Linux.
The Advanced Maryland Automatic Network Disk Archiver, or AMANDA, is a popular network backup solution that can save data from Linux, Unix or Windows systems to hard drives, tape or optical media. Zmanda, which sponsors the project, offers commercial products based on the same technology. Operating System: Windows, Linux, OS X.
68. Areca Backup
For standalone systems, Area is an easy-to-use but versatile backup solution. Key features include delta backup, compression, encryption, filters, as-of-date recovery and more. Operating System: Windows, Linux
If you are looking to minimize the amount of storage space you need for backups, consider Attic, which includes built-in deduplication. It also includes optional 256-bit AES encryption and can transfer files to remote hosts via SSH. Operating System: Linux
This Ruby-based tool promises "easy full stack backup operations on UNIX-like systems." It includes a tool for modeling backups. Operating System: Linux, OS X
This tool makes it easier to coordinate and manage backups on your network. It incorporates several of the other tools on this list including Duplicity and rsync. Operating System: Linux
Robust enough for enterprise use, BackupPC backs up data from Linux and Windows systems to disk. Noteworthy features include a unique pooling scheme, optional compression, a web interface and support for mobile devices. Operating System: Windows, Linux
73. Back In Time
Inspired by an older solution called FlyBack, Back in Time takes snapshots of specified directories. It's easy to setup and includes a simple scheduler. Operating System: Linux
Another option for enterprises, Bacula is a network backup solution that aims to be easy to use and very efficient. Commercial support and services for the solution are available throughBacula Systems. Operating System: Windows, Linux, OS X
Forked from Bacula, Bareos is a popular open source backup option that is under very active development. Bareos.com offers paid support and services for the tool. Operating System: Windows, Linux, OS X
76. Box Backup
This "completely automatic" backup solution creates backups continuously and can also create snapshots when desired. It includes encryption and optional RAID capabilities. Operating System: Windows, Linux
Short for "BackUp And Restore Program," BURP is a network backup solution based on librsync (see below). It is designed to be easier to configure than some other open source solutions, and it can do delta backups. Operating System: Windows, Linux
Designed to replace Acronis True Image or Norton Ghost, Clonezilla is useful for both system deployment and backup and recovery. It comes in two flavors: live for standalone systems and SE for network backup or cloning multiple systems at once. Operating System: Linux
Powerful but lightweight, this backup tool takes up only 220KB of space on your drive. It supports multiple languages, has an intuitive interface and includes a scheduler. Operating System: Windows
Disk Archive, a.k.a. DAR, is an older command-line tool for backup. For those who prefer a GUI, one is available through DarGUI. Operating System: Windows, Linux, OS X
81. DirSync Pro
This "small but powerful," utility offers incremental backup, filtering and scheduling capabilities. It also boasts a user-friendly interface, and it offers the ability to analyze two sets of files or folders and detect the changes between them. Operating System: Windows
While this utility isn't a complete system backup solution, it does back up Windows drivers. It can also remove unwanted drivers. Operating System: Windows
Based on the librsync library, Duplicity creates encrypted archives and uploads them to remote or local servers. It can use GnuPG to encrypt and sign archives if desired. Operating System: Linux
FOG offers cross-platform cloning and imaging capabilities for networks of any size from 5 to 50,000 systems. It boasts that it "offers commercial-grade support at no cost." Operating System: Linux, Windows, OS X.
A tool for standalone systems, FreeFileSync aims to save users time when setting up and running backups. It is cross-platform and includes 64-bit support. Operating System: Linux, Windows, OS X
Although it was designed to help web developers push updates to their sites, FullSync can also be used by anyone to create backups. Key features include multiple modes, flexible rules, buffered filesystems, support for multiple file transfer protocols and more. Operating System: Linux, Windows, OS X
Grsync takes the older rsync synchronization tool and adds an easy-to-use GUI. Noteworthy features include unlimited sessions, highlighted errors, batch capabilities and more. Operating System: Linux, Windows, OS X
Like Grsync, LuckyBackup was also based on rsync. It has won several awards, but development on this project has slowed. Operating System: Linux, Windows
89. Mondo Rescue
For Linux and FreeBSD only, Mondo Rescue is a disaster recovery solution that supports tape, disk, network or optical media backups. According to its website, its users include "Lockheed-Martin, Nortel Networks, Siemens, HP, IBM, NASA's JPL, the US Dept of Agriculture, dozens of smaller companies." Operating System: Linux, Free BSD
Easy-to-use and secure, Obnam is a snapshot backup solution with built-in deduplication and encryption capabilities. It stores data to hard disks or online via SFTP. Operating System: Linux
This tool saves partitions of drives as image files, making it useful for backup or installing the same image on multiple systems. It can run across networks or on a standalone PC. Operating System: Linux
Redo boasts that it can get a crashed system back up and running in as little as 10 minutes. It's very easy to use and has bare-metal restore capabilities. Operating System: Windows, Linux
As you might expect from the name, this utility makes a snapshot of your file system for remote or local backup. According to the website, it can be set up in just a few minutes. Operating System: Linux, OS X
Rsync is a Unix-based file-transfer utility that has synchronization capabilities that make it suitable for creating backups or mirroring. It's a useful tool but is best used by advanced users. Operating System: Linux, Windows, OS X
For Linux users only, SafeKeep focuses on security and simplicity. It's a command line tool that is a good option for a small LAN. Operating System: Linux
96. SMS Backup+
This tool allows you to backup your text messages and call logs on Gmail. You can also transfer data from Gmail back to your phone. Operating System: Android
Designed to be as easy to use as possible, SnapBackup backs up files with just one click. It can copy files to a flash drive, external hard drive or the cloud, and it includes compression capabilities. Operating System: Windows, Linux, OS X
While this app is focused primarily on synchronization, it can be used for creating backups as well. Key features include analysis capabilities, blacklisting, restores and cross-platform support. Operating System: Windows, Linux, OS X
Like Synkron, Unison is a file synchronization tool. It can copy files between any two systems connected to the internet, and it has features in common with source code management tools as well as with backup utilities. Operating System: Windows, Unix
This client-server backup solution does both image and file backups. It promises "both data safety and a fast restoration time." Operating System: Windows, Linux
The Weex developers intended it primarily as a tool for pushing content to websites, but it can also be used to synchronize or backup files. It supports FTP file transfer. Operating System: Windows, Linux
Averaging more than 50,000 downloads every week, this tool is a very popular way to copy a disk image to a new machine. It's very useful for systems administrators and developers. Operating System: Windows
XSIbackup can backup VMwareESXi environments version 5.1 or greater. It's a command line tool with a scheduler, and it runs directly on the hypervisor. Operating System: VMwareESXi
Formerly known as Tachyon, Alluxio describes itself as "a memory-centric distributed storage system enabling reliable data sharing at memory-speed across cluster frameworks." It works with tools like Spark and Hadoop to speed performance on big data queries. Operating System: Linux, OS X
Part of the Hadoop ecosystem, this Apache project offers an intuitive Web-based interface for provisioning, managing, and monitoring Hadoop clusters. It also provides RESTful APIs for developers who want to integrate Ambari's capabilities into their own applications. Operating System: Windows, Linux, OS X.
This Apache project provides a data serialization system with rich data structures and a compact format. Schemas are defined with JSON and it integrates easily with dynamic languages. Operating System: OS Independent.
Cascading is an application development platform based on Hadoop. Commercial support and training are available. Operating System: OS Independent.
Based on Hadoop, Chukwa collects data from large distributed systems for monitoring purposes. It also includes tools for analyzing and displaying the data. Operating System: Linux, OS X.
109. Data Torrent RTS
Data Torrent has been around a while, but it first open sourced its Core RTS technology in June of this year. It claims to be "the industry's only open source enterprise-grade unified stream and batch platform." It comes in community, standard and enterprise versions. Operating System: Linux
Originally developed by Nokia, Disco is a distributed computing framework that, like Hadoop, is based on MapReduce. It includes a distributed filesystem and a database that supports billions of keys and values. Operating System: Linux, OS X.
Flume collects log data from other applications and delivers them into Hadoop. The website boasts, "It is robust and fault tolerant with tunable reliability mechanisms and many failover and recovery mechanisms." Operating System: Linux, OS X.
Created by Netflix, Genie allows IT administrators to manage Hadoop jobs running on cloud computing services. Netflix uses it to run many thousands of Hadoop jobs every day. Operating System: Windows, Linux, OS X
This Apache-sponsored project is the best-known big data tool available. Numerous companies, including Amazon Web Services, Cloudera, Hortonworks, IBM, Pivotal, SyncSort and VMware, offer related products or commercial support for Hadoop. Well-known users include Alibaba, AOL, eBay, Facebook, Google, Hulu, LinkedIn, Spotify, Twitter and Yahoo. Operating System: Windows, Linux, OS X
HDFS is the file system for Hadoop, but it can also be used as a standalone distributed file system. It's Java-based, fault-tolerant, highly scalable and highly configurable. Operating System: Windows, Linux, OS X.
This alternative to Hadoop also offers massive parallel processing and storage of big data workloads. Paid enterprise services are available. Operating System: Linux
Very popular with Web companies, Hypertable was developed by Google as a way to make databases more scalable. Its users include Baidu, eBay, Groupon and Yelp. It is compatible with Hadoop, and commercial support and training are available. Operating System: Linux, OS X
This Apache project describes itself as "a high-performance, integrated and distributed in-memory platform for computing and transacting on large-scale data sets in real-time, orders of magnitude faster than possible with traditional disk-based or flash technologies." The platform includes data grid, compute grid, service grid, streaming, Hadoop acceleration, advanced clustering, file system, messaging, events and data structure capabilities. Operating System: OS Independent.
Currently in beta trials, Kudu is an Apache project that is part of the Hadoop ecosystem. It combines a simple data model with columnar storage, low latency and distributed architecture. Operating System: Windows, Linux, OS X
This Netflix project provides an easy-to-understand graphical representation of Hadoop Pig jobs. It updates as the job executes so that administrators and developers no longer need to sift through log data. Operating System: Windows, Linux, OS X
Java-based Lucene performs full-text searches very quickly. According to the website, it can index more than 150GB per hour on modern hardware, and it includes powerful and efficient search algorithms. Development is sponsored by the Apache Software Foundation. Operating System: OS Independent.
Created by a company called Altamira Technologies, Lumify describes itself as an "open source big data analysis and visualization platform." It makes it easy to create 2D or 3D graphs that show the relationship between entities or to overlay data on maps. For those who are interested in learning more about how it works, the website offers several videos that show Lumify in action, and it also has a demo site that allows users to upload their own data and try out the software. Operating System: Linux.
An integral part of Hadoop, MapReduce is a programming model that provides a way to process large distributed datasets. It was originally developed by Google, and it also used by several other big data tools on our list, including CouchDB, MongoDB and Riak. Operating System: OS Independent.
Apache Mesos is a resource abstraction tool that makes it possible for enterprises to treat their entire data center as a single pool of resources, and it is popular with companies that are also running Hadoop, Spark and similar applications. Organizations that use it include Airbnb, CERN, Cisco, Coursera, Foursquare, Groupon, Netflix, Twitter and Uber. Operating System: Linux, OS X
This workflow scheduler is specifically designed to manage Hadoop jobs. It can trigger jobs by time or by data availability, and it integrates with MapReduce, Pig, Hive, Sqoop and many other related tools. Operating System: Linux, OS X.
The Pandas project includes data structures and data analysis tools based on the Python programming language. It allows organizations to use Python as an alternative to R for big data analysis projects. Operating System: Windows, Linux, OS X.
Apache Pig is a platform for distributed big data analysis. It relies on a programming language called Pig Latin, which boasts simplified parallel programming, optimization and extensibility. Operating System: OS Independent.
|Best Open Source Software for Windows 10|
|Open Source Replacements for Windows XP|