请输入您要查询的百科知识：

　

词条 Data set
释义

  1. Properties

  2. Classic data sets

  3. See also

  4. References

  5. External links

{{about||IBM mainframe term for a file|Data set (IBM mainframe)|the telecommunications interface device|Modem}}

A data set (or dataset) is a collection of data. Most commonly a data set corresponds to the contents of a single database table, or a single statistical data matrix, where every column of the table represents a particular variable, and each row corresponds to a given member of the data set in question. The data set lists values for each of the variables, such as height and weight of an object, for each member of the data set. Each value is known as a datum. The data set may comprise data for one or more members, corresponding to the number of rows.

The term data set may also be used more loosely, to refer to the data in a collection of closely related tables, corresponding to a particular experiment or event. Less used names for this kind of data sets are data corpus and data stock. An example of this type is the data sets collected by space agencies performing experiments with instruments aboard space probes. Data sets that are so large that traditional data processing applications are inadequate to deal with them are known as big data.[1]

In the open data discipline, data set is the unit to measure the information released in a public open data repository. The European Open Data portal aggregates more than half a million data sets.[2] In this field other definitions have been proposed [3] but currently there is not an official one. Some other issues (real-time data sources,[4] non-relational data sets, etc.) increases the difficulty to reach a consensus about it.

Properties

Several characteristics define a data set's structure and properties. These include the number and types of the attributes or variables, and various statistical measures applicable to them, such as standard deviation and kurtosis.[5]

The values may be numbers, such as real numbers or integers, for example representing a person's height in centimeters, but may also be nominal data (i.e., not consisting of numerical values), for example representing a person's ethnicity. More generally, values may be of any of the kinds described as a level of measurement. For each variable, the values are normally all of the same kind. However, there may also be missing values, which must be indicated in some way.

In statistics, data sets usually come from actual observations obtained by sampling a statistical population, and each row corresponds to the observations on one element of that population. Data sets may further be generated by algorithms for the purpose of testing certain kinds of software. Some modern statistical analysis software such as SPSS still present their data in the classical data set fashion. If data is missing or suspicious an imputation method may be used to complete a data set.[6]

Classic data sets

Several classic data sets have been used extensively in the statistical literature:

  • Iris flower data set – Multivariate data set introduced by Ronald Fisher (1936).[7]
  • MNIST database – Images of handwritten digits commonly used to test classification, clustering, and image processing algorithms
  • Categorical data analysis – Data sets used in the book, An Introduction to Categorical Data Analysis.
  • Robust statistics – Data sets used in Robust Regression and Outlier Detection (Rousseeuw and Leroy, 1986). Provided on-line at the University of Cologne.
  • Time series – Data used in Chatfield's book, The Analysis of Time Series, are provided on-line by StatLib.
  • Extreme values – Data used in the book, An Introduction to the Statistical Modeling of Extreme Values are [https://web.archive.org/web/20060910161517/http://homes.stat.unipd.it/coles/public_html/ismev/ismev.dat a snapshot of the data as it was provided on-line by Stuart Coles], the book's author.
  • Bayesian Data Analysis – Data used in the book are provided on-line by Andrew Gelman, one of the book's authors.
  • The Bupa liver data – Used in several papers in the machine learning (data mining) literature.
  • Anscombe's quartet – Small data set illustrating the importance of graphing the data to avoid statistical fallacies

See also

{{Portal|Computing|Software}}
  • Data
  • Data blending
  • Data (computing)
  • Data store
  • Interoperability
  • Data collection system
{{Clear}}

References

1. ^{{cite journal | last1 = Snijders | first1 = C. | last2 = Matzat | first2 = U. | last3 = Reips | first3 = U.-D. | year = 2012 | title = 'Big Data': Big gaps of knowledge in the field of Internet | url = http://www.ijis.net/ijis7_1/ijis7_1_editorial.html | journal = International Journal of Internet Science | volume = 7 | issue = | pages = 1–5 }}
2. ^{{Cite web|url=http://www.europeandataportal.eu/data/en/dataset|title=European open data portal|last=|first=|date=|website=European open data portal|publisher=European Commission|access-date=2016-09-23}}
3. ^{{Cite web|url=http://www.meloda.org/dataset-definition/|title=Dataset definition – MELODA|website=www.meloda.org|access-date=2016-08-17}}
4. ^{{Cite journal|last=Atz|first=U|date=2014|title=The tau of data: A new metric to assess the timeliness of data in catalogues|url=http://duweb.donau-uni.ac.at/imperia/md/content/department/gpa/zeg/bilder/cedem/cedem14/cedem14_proceedings.pdf#page=258|journal=CEDEM 2014 Proceedings|volume=|issue=|doi=|pmid=|access-date=2016-08-01|via=}}
5. ^{{Cite book |url=https://books.google.com/books?id=uTzeRZFmaBgC&pg=PA100 |title=Principles of data mining and knowledge discovery |author=Jan M. Żytkow, Jan Rauch |postscript= |isbn=978-3-540-66490-1 |year=1999}}
6. ^{{cite book |title=Statistical Data Editing: Impact on Data Quality: Volume 3 of Statistical Data Editing, Conference of European Statisticians Statistical standards and studies |author=United Nations Statistical Commission |author2=United Nations Economic Commission for Europe |year=2007 |publisher=United Nations Publications |isbn=9211169526 |page=20 |url=https://books.google.com.au/books?id=X0wtLo2XY9gC |accessdate=19 July 2015}}
7. ^{{cite journal|author=Fisher, R.A. |title=The Use of Multiple Measurements in Taxonomic Problems| journal=Annals of Eugenics| volume=7 |pages=179–188| year=1936| url=http://digital.library.adelaide.edu.au/coll/special//fisher/138.pdf | doi=10.1111/j.1469-1809.1936.tb02137.x}}

External links

{{Wiktionary}}
  • Datahub – a community-managed home for open data sets
  • Data.gov
  • GCMD – the Global Change Master Directory containing over 20,000 descriptions of Earth science and environmental science data sets and services
  • [https://relational.fit.cvut.cz/ Relational data set repository]
  • Research Pipeline – a wiki/website with links to data sets on many different topics
  • StatLib–JASA Data Archive
  • UCI – a machine learning repository
  • UK Government Public Data
{{DEFAULTSORT:Data Set}}

2 : Computer data|Statistical data sets
随便看

　

开放百科全书收录14589846条英语、德语、日语等多语种百科知识，基本涵盖了大多数领域的百科知识，是一部内容自由、开放的电子版国际百科全书。

　

Copyright © 2023 OENC.NET All Rights Reserved
京ICP备2021023879号 更新时间：2024/9/21 19:39:40