请输入您要查询的百科知识:

 

词条 Apache Impala
释义

  1. Description

  2. See also

  3. References

  4. External links

{{Infobox Software
| name = Apache Impala
| logo =
| screenshot =
| caption =
| developer = Apache Software Foundation
| latest release version = 3.0.0
| latest release date ={{Start date and age|2018|05|07}}
| latest preview version =
| latest preview date =
| programming language = C++, Java
| operating system = Cross-platform
| genre = Relational Hadoop-analytics
| license = Apache License 2.0
| website = {{URL |impala.apache.org}}
|repo=https://github.com/apache/impala|released={{Start date and age|2013|04|28}}}}Apache Impala is an open source massively parallel processing (MPP) SQL query engine for data stored in a computer cluster running Apache Hadoop.[1] Impala has been described as the open-source equivalent of Google F1, which inspired its development in 2012.[2]

Description

Apache Impala is a query engine that runs on Apache Hadoop.

The project was announced in October 2012 with a public beta test distribution[3][4] and became generally available in May 2013.[5]

Impala brings scalable parallel database technology to Hadoop, enabling users to issue low-latency SQL queries to data stored in HDFS and Apache HBase without requiring data movement or transformation. Impala is integrated with Hadoop to use the same file and data formats, metadata, security and resource management frameworks used by MapReduce, Apache Hive, Apache Pig and other Hadoop software.

Impala is promoted for analysts and data scientists to perform analytics on data stored in Hadoop via SQL or business intelligence tools. The result is that large-scale data processing (via MapReduce) and interactive queries can be done on the same system using the same data and metadata – removing the need to migrate data sets into specialized systems and/or proprietary formats simply to perform analysis.

Features include:

  • Supports HDFS and Apache HBase storage,
  • Reads Hadoop file formats, including text, LZO, SequenceFile, Avro, RCFile, and Parquet,
  • Supports Hadoop security (Kerberos authentication),
  • Fine-grained, role-based authorization with Apache Sentry,
  • Uses metadata, ODBC driver, and SQL syntax from Apache Hive.

In early 2013, a column-oriented file format called Parquet was announced for architectures including Impala.[6]

In December 2013, Amazon Web Services announced support for Impala.[7]

In early 2014, MapR added support for Impala.[8]

In 2015, another format called Kudu was announced, which Cloudera proposed to donate to the Apache Software Foundation along with Impala.[9]

Impala graduated to an Apache Top-Level Project (TLP) on 28 November 2017.[10]

See also

  • Apache Drill — similar open source project inspired by Dremel
  • Dremel — similar tool from Google
  • Presto — open source SQL query engine created by Facebook and supported by Teradata.

References

1. ^{{cite web|title=Apache Impala|url=http://impala.apache.org/|accessdate=15 September 2017}}
2. ^{{Cite news |url= https://www.wired.com/2012/10/cloudera-impala-hadoop/ |title= Man Busts Out of Google, Rebuilds Top-Secret Query Machine |author= Cade Metz |work= Wired Magazine |date= October 24, 2012 |access-date= October 10, 2016 }}
3. ^{{cite web |url= http://www.zdnet.com/cloudera-aims-to-bring-real-time-queries-to-hadoop-big-data-7000005951/ |title=Cloudera aims to bring real-time queries to Hadoop, big data |author= Larry Digna |date= October 24, 2012 |work= Between the lines blog |publisher= ZDNet |accessdate= January 20, 2014 }}
4. ^{{cite web |url= http://www.zdnet.com/clouderas-impala-brings-hadoop-to-sql-and-bi-7000006413/ |title=Cloudera’s Impala brings Hadoop to SQL and BI |author= Andrew Brust |date= October 25, 2012 |work= ZDNet |accessdate= January 20, 2014 }}
5. ^{{cite web |url= http://blog.cloudera.com/blog/2013/05/cloudera-impala-1-0-its-here-its-real-its-already-the-standard-for-sql-on-hadoop/ |title=Cloudera Impala 1.0: It’s Here, It’s Real, It’s Already the Standard for SQL on Hadoop |author= Marcel Kornacker, Justin Erickson |date= May 1, 2013 |accessdate= April 10, 2014 }}
6. ^{{Cite web |title= Parquet: Columnar Storage for Hadoop |work= Project web site |year= 2013 |url= http://parquet.io/ |accessdate= January 20, 2014 }}
7. ^{{Cite web |title= Announcing Support for Impala with Amazon Elastic MapReduce |publisher= Amazon.com |date= December 12, 2013 |url= http://aws.amazon.com/about-aws/whats-new/2013/12/12/announcing-support-for-impala-with-amazon-elastic-mapreduce/ |accessdate= January 20, 2014 }}
8. ^{{Cite web |title= Impala for MapR |publisher= MapR.com |date= February 2, 2014 |url= http://doc.mapr.com/display/MapR/Impala+for+MapR |accessdate= April 10, 2014 }}
9. ^{{Cite news |title= Cloudera to Donate Impala and Kudu Big Data Projects to Apache |date= November 18, 2015 |author= David Ramel |work= Application Development Trends |url= https://adtmag.com/articles/2015/11/18/cloudera-donates-projects.aspx |accessdate= October 10, 2016 }}
10. ^{{Cite web |title= The Apache Software Foundation Announces Apache® Impala™ as a Top-Level Project |url= https://blogs.apache.org/foundation/entry/the-apache-software-foundation-announces24 |date= November 28, 2017 |accessdate= November 30, 2017 }}

External links

  • Apache Impala project web site
  • [https://github.com/cloudera/impala Impala GitHub] project source code
{{DEFAULTSORT:Impala}}

3 : Cloud platforms|Free system software|Hadoop

随便看

 

开放百科全书收录14589846条英语、德语、日语等多语种百科知识,基本涵盖了大多数领域的百科知识,是一部内容自由、开放的电子版国际百科全书。

 

Copyright © 2023 OENC.NET All Rights Reserved
京ICP备2021023879号 更新时间:2024/9/21 12:47:23