词条 | Quantcast File System |
释义 |
| name = Quantcast File System (QFS) | logo = | screenshot = | caption = | developer = Sriram Rao, Michael Ovsiannikov, Quantcast | latest release version = 1.1.4 | latest release date = {{start date and age|2015|03|05}}[1] | latest preview version = | latest preview date = | operating system = | programming language = C++ | genre = Distributed File System | license = Apache License 2.0 | website = {{URL|quantcast.github.com/qfs}} }} Quantcast File System (QFS) is an open-source distributed file system software package for large-scale MapReduce or other batch-processing workloads. It was designed as an alternative to the Apache Hadoop Distributed File System (HDFS), intended to deliver better performance and cost-efficiency for large-scale processing clusters. DesignQFS is software that runs on a cluster of hundreds or thousands of commodity Linux servers and allows other software layers to interact with them as if they were one giant hard drive. It has three components:
In a cluster of hundreds or thousands of machines, the odds are low that all will be running and reachable at any given moment, so fault tolerance is the central design challenge. QFS meets it with Reed–Solomon error correction. The form of Reed–Solomon encoding used in QFS stores redundant data in nine places and can reconstruct the file from any six of these stripes.[2] When it writes a file, it by default stripes it across nine physically different machines — six holding the data, three holding parity information. Any three of those can become unavailable. If any six remain readable, QFS can reconstruct the original data. The result is fault tolerance at a cost of a 50% expansion of data. QFS is written in the programming language C++, operates within a fixed memory footprint, and uses direct input and output (I/O). HistoryQFS evolved from the Kosmos File System (KFS), an open source project started by Kosmix in 2005. Quantcast adopted KFS in 2007, built its own improvements on it over the next several years, and released QFS 1.0 as an open source project in September, 2012.[3] References1. ^[https://github.com/quantcast/qfs/tree/1.1.4 Release 1.1.4] 2. ^QFS improves performance of Hadoop file system - Strata 3. ^Quantcast releases bigger, faster, stronger Hadoop file system — Tech News and Analysis External links{{Portal|Free and open-source software}}
3 : Hadoop|Free system software|Distributed file systems |
随便看 |
|
开放百科全书收录14589846条英语、德语、日语等多语种百科知识,基本涵盖了大多数领域的百科知识,是一部内容自由、开放的电子版国际百科全书。