| 词条 | Storm (event processor) | ||||||||||||||||||||||||||||||||||||||||
| 释义 |
| name = Apache Storm | logo = | developer = Backtype, Twitter | status = Active | latest release version = 1.2.2 | latest release date = {{release date|df=yes|2018|05|17}} | operating system = Cross-platform | size = | programming language = Clojure & Java | genre = Distributed stream processing | license = Apache License 2.0 | website = {{url|https://storm.apache.org/}} |logo caption = Distributed and fault-tolerant realtime computation}}Apache Storm is a distributed stream processing computation framework written predominantly in the Clojure programming language. Originally created by Nathan Marz[1] and team at BackType,[2] the project was open sourced after being acquired by Twitter.[3] It uses custom created "spouts" and "bolts" to define information sources and manipulations to allow batch, distributed processing of streaming data. The initial release was on 17 September 2011.[4] A Storm application is designed as a "topology" in the shape of a directed acyclic graph (DAG) with spouts and bolts acting as the graph vertices. Edges on the graph are named streams and direct data from one node to another. Together, the topology acts as a data transformation pipeline. At a superficial level the general topology structure is similar to a MapReduce job, with the main difference being that data is processed in real time as opposed to in individual batches. Additionally, Storm topologies run indefinitely until killed, while a MapReduce job DAG must eventually end.[5] Storm became an Apache Top-Level Project in September 2014[6] and was previously in incubation since September 2013.[7][8] DevelopmentApache Storm is developed under the Apache License, making it available to most companies to use.[9] Git is used for version control and Atlassian JIRA for issue tracking, under the Apache Incubator program.
Apache Storm ArchitectureThe Apache Storm cluster comprises following critical components:
Peer platformsStorm is but one of dozens of stream processing engines, for a more complete list see Stream processing. Twitter announced Heron on June 2, 2015[11] which is API compatible with Storm. There are other comparable streaming data engines such as Spark Streaming and Flink.[12] See also
References1. ^{{cite web|last=Marz|first=Nathan|title=About Nathan Marz|url=http://nathanmarz.com/about/|publisher=Nathan Marz|accessdate=28 March 2013}} 2. ^{{cite web|title=BackType Website (defunct)|url=http://www.backtype.com/|publisher=BackType|accessdate=28 March 2013}} 3. ^{{cite web|title=A Storm is coming: more details and plans for release|url=https://blog.twitter.com/2011/storm-coming-more-details-and-plans-release|work=Engineering Blog|publisher=Twitter Inc|accessdate=29 July 2015}} 4. ^{{cite web|title=Storm Codebase|url=https://github.com/nathanmarz/storm/commit/9d91adbdbde22e91779b91eb40805f598da5b004|publisher=Github|accessdate=8 February 2013}} 5. ^{{cite web|title=Tutorial - Components of a Storm cluster|url=http://storm.apache.org/documentation/Tutorial.html|work=Documentation|publisher=Apache Storm|accessdate=29 July 2015}} 6. ^{{cite web|title=Apache Storm Graduates to a Top-Level Project|url=http://hortonworks.com/blog/apache-storm-graduates-top-level-project/}} 7. ^{{cite web|title=Storm Project Incubation Status|url=http://incubator.apache.org/projects/storm.html|publisher=Apache Software Foundation|accessdate=29 October 2013}} 8. ^{{cite web|title=Storm Proposal|url=http://wiki.apache.org/incubator/StormProposal|publisher=Apache Software Foundation|accessdate=29 October 2013}} 9. ^{{cite web|title=Powered By Storm|url=http://storm.apache.org/documentation/Powered-By.html|work=Documentation|publisher=Apache Storm|accessdate=29 July 2015}} 10. ^{{Cite web|url=http://storm.apache.org/|title=Apache Storm|website=storm.apache.org|access-date=2017-08-18}} 11. ^{{cite web|title=Flying faster with Twitter Heron|url=https://blog.twitter.com/2015/flying-faster-with-twitter-heron|work=Engineering Blog|publisher=Twitter Inc|accessdate=3 June 2015}} 12. ^{{cite web |url=http://ieeexplore.ieee.org/xpl/articleDetails.jsp?arnumber=7530084 |format=PDF |title= Benchmarking Streaming Computation Engines: Storm, Flink and Spark Streaming |date=May 2016 |publisher=IEEE }} External links
8 : Distributed computing architecture|Parallel computing|Cloud applications|Cloud infrastructure|Apache Software Foundation|Software using the Apache license|Java platform|Distributed stream processing |
||||||||||||||||||||||||||||||||||||||||
| 随便看 |
|
开放百科全书收录14589846条英语、德语、日语等多语种百科知识，基本涵盖了大多数领域的百科知识，是一部内容自由、开放的电子版国际百科全书。