“Data center”的意思、由来-开放百科全书

A data center (American English)^[1]^[2] or data centre (British English)^[3] is a building, dedicated space within a building, or a group of buildings^[4] used to house computer systems and associated components, such as telecommunications and storage systems.

Since IT operations are crucial for business continuity, it generally includes redundant or backup components and infrastructure for power supply, data communications connections, environmental controls (e.g. air conditioning, fire suppression) and various security devices. A large data center is an industrial-scale operation using as much electricity as a small town.^[5]^[6]

History

Data centers have their roots in the huge computer rooms of the 1940s, typified by ENIAC, one of the earliest examples of a data center.^[7]^[8] Early computer systems, complex to operate and maintain, required a special environment in which to operate. Many cables were necessary to connect all the components, and methods to accommodate and organize these were devised such as standard racks to mount equipment, raised floors, and cable trays (installed overhead or under the elevated floor). A single mainframe required a great deal of power, and had to be cooled to avoid overheating. Security became important – computers were expensive, and were often used for military purposes.^[7]^[9] Basic design-guidelines for controlling access to the computer room were therefore devised.

During the boom of the microcomputer industry, and especially during the 1980s, users started to deploy computers everywhere, in many cases with little or no care about operating requirements. However, as information technology (IT) operations started to grow in complexity, organizations grew aware of the need to control IT resources. The advent of Unix from the early 1970s led to the subsequent proliferation of freely available Linux-compatible PC operating-systems during the 1990s. These were called "servers", as timesharing operating systems like Unix rely heavily on the client-server model to facilitate sharing unique resources between multiple users. The availability of inexpensive networking equipment, coupled with new standards for network structured cabling, made it possible to use a hierarchical design that put the servers in a specific room inside the company. The use of the term "data center", as applied to specially designed computer rooms, started to gain popular recognition about this time.^[7]^[10]

The boom of data centers came during the dot-com bubble of 1997–2000.^[11]^[12] Companies needed fast Internet connectivity and non-stop operation to deploy systems and to establish a presence on the Internet. Installing such equipment was not viable for many smaller companies. Many companies started building very large facilities, called Internet data centers (IDCs), which provide commercial clients with a range of solutions for systems deployment and operation. New technologies and practices were designed to handle the scale and the operational requirements of such large-scale operations. These practices eventually migrated toward the private data centers, and were adopted largely because of their practical results. Data centers for cloud computing are called cloud data centers (CDCs). But nowadays, the division of these terms has almost disappeared and they are being integrated into the term "data center".

With an increase in the uptake of cloud computing, business and government organizations scrutinize data centers to a higher degree in areas such as security, availability, environmental impact and adherence to standards. Standards documents from accredited professional groups, such as the Telecommunications Industry Association, specify the requirements for data-center design. Well-known operational metrics for data-center availability can serve to evaluate the commercial impact of a disruption. Development continues in operational practice, and also in environmentally-friendly data-center design. Data centers typically cost a lot to build and to maintain.^[11]^[13]

Requirements for modern data centers

Modernization and data center transformation enhances performance and energy efficiency.^[14]

Information security is also a concern, and for this reason a data center has to offer a secure environment which minimizes the chances of a security breach. A data center must therefore keep high standards for assuring the integrity and functionality of its hosted computer environment.

Industry research company International Data Corporation (IDC) puts the average age of a data center at nine years old.^[14] Gartner, another research company, says data centers older than seven years are obsolete.^[15] The growth in data (163 zettabytes by 2025^[16]) is one factor driving the need for data centers to modernize.

Focus on modernization is not new: Concern about obsolete equipment was decried in 2007,^[17] and in 2011 Uptime Institute was concerned about the age of the equipment therein.^[18] By 2018 concern had shifted once again, this time to the age of the staff: "data center staff are aging faster than the equipment."^[19]

Meeting standards for data centers

The Telecommunications Industry Association's Telecommunications Infrastructure Standard for Data Centers^[20] specifies the minimum requirements for telecommunications infrastructure of data centers and computer rooms including single tenant enterprise data centers and multi-tenant Internet hosting data centers. The topology proposed in this document is intended to be applicable to any size data center.^[21]

Telcordia GR-3160, NEBS Requirements for Telecommunications Data Center Equipment and Spaces,^[22] provides guidelines for data center spaces within telecommunications networks, and environmental requirements for the equipment intended for installation in those spaces. These criteria were developed jointly by Telcordia and industry representatives. They may be applied to data center spaces housing data processing or Information Technology (IT) equipment. The equipment may be used to:

Data center transformation

Data center transformation takes a step-by-step approach through integrated projects carried out over time. This differs from a traditional method of data center upgrades that takes a serial and siloed approach.^[23] The typical projects within a data center transformation initiative include standardization/consolidation, virtualization, automation and security.

Machine room

The term "Machine Room" is at times used to refer to the large room within a Data Center where the actual Central Processing Unit is located; this may be separate from where high-speed printers are located. Air conditioning is most important in the machine room.^[35]^[36]^[37]

Aside from air-conditioning, there must be monitoring equipment, one type of which is to detect water prior to flood-level situations.^[38] One company, for several decades,^[39] has had share-of-mind: Water Alert.^[40] The company, as of 2018, has 2 competing manufacturers (Invetex,

Hydro-Temp) and 3 competing distributors (Longden,Northeast Flooring,^[41], Slayton^[42]).

A raised floor standards guide named GR-2930 was developed by Telcordia Technologies,

Although the first raised floor computer room was made by IBM in 1956^[44], and they've "been around since the 1960s,"^[45] it was the 1970s that made it more common

for computer centers to thereby allow cool air to circulate more efficienctly.^[46]^[47]

Lights out

The "lights-out" data center, also known as a darkened or a dark data center, is a data center that, ideally, has all but eliminated the need for direct access by personnel, except under extraordinary circumstances. Because of the lack of need for staff to enter the data center, it can be operated without lighting. All of the devices are accessed and managed by remote systems, with automation programs used to perform unattended operations. In addition to the energy savings, reduction in staffing costs and the ability to locate the site further from population centers, implementing a lights-out data center reduces the threat of malicious attacks upon the infrastructure.^[48]^[49]

Data center levels and tiers

The two organizations in the United States that publish data center standards are the Telecommunications Industry Association (TIA) and the Uptime Institute.

Telecommunications Industry Association

The Telecommunications Industry Association's TIA-942 standard for data centers, published in 2005 and updated four times since, defined four infrastructure levels.^[50]

Uptime Institute - Data Center Tier Standards

Data center design

The field of data center design has been growing for decades in various directions:

Local building codes may govern the minimum ceiling heights and other parameters. Some of the considerations in the design of data centers are:

Design criteria and tradeoffs

High availability

Various metrics exist for measuring the data-availability that results from data-center availability beyond 95% uptime, with the top of the scale counting how many "nines" can be placed after "99%".^[60]

Modularity and flexibility

Modularity and flexibility are key elements in allowing for a data center to grow and change over time. Data center modules are pre-engineered, standardized building blocks that can be easily configured and moved as needed.^[61]

A modular data center may consist of data center equipment contained within shipping containers or similar portable containers.^[62] Components of the data center can be prefabricated and standardized which facilitates moving if needed.^[63]

Environmental control

Electrical power

Backup power consists of one or more uninterruptible power supplies, battery banks, and/or diesel / gas turbine generators.^[66]

To prevent single points of failure, all elements of the electrical systems, including backup systems, are typically fully duplicated, and critical servers are connected to both the "A-side" and "B-side" power feeds. This arrangement is often made to achieve N+1 redundancy in the systems. Static transfer switches are sometimes used to ensure instantaneous switchover from one supply to the other in the event of a power failure.

Low-voltage cable routing

Computer cabinets are often organized into a hot aisle arrangement to maximize airflow efficiency.

Fire protection

Data centers feature fire protection systems, including passive and Active Design elements, as well as implementation of fire prevention programs in operations. Smoke detectors are usually installed to provide early warning of a fire at its incipient stage.

Security

Physical access is usually restricted. Layered security often starts with fencing, bollards and mantraps.^[69] Video camera surveillance and permanent security guards are almost always present if the data center is large or contains sensitive information. Fingerprint recognition mantraps is starting to be commonplace.

Logging access is required by some data protection regulations; some organizations tightly link this to access control systems. Multiple log entries can occur at the main entrance, entrances to internal rooms, and at equipment cabinets. Access control at cabinets can be integrated with intelligent power distribution units, so that locks are networked through the same appliance.^[70]

Energy use

Energy use is a central issue for data centers. Power draw ranges from a few kW for a rack of servers in a closet to several tens of MW for large facilities. Some facilities have power densities more than 100 times that of a typical office building.^[71] For higher power density facilities, electricity costs are a dominant operating expense and account for over 10% of the total cost of ownership (TCO) of a data center.^[72]

Power costs for 2012 often exceeded the cost of the original capital investment.^[73] Greenpeace estimated worldwide data center power consumption for 2012 as about 382 billion kWh.^[74] Global data centers used roughly 416 TWh in 2016, nearly 40% more than the entire United Kingdom; USA DC consumption was 90 billion kWh.^[75]

Greenhouse gas emissions

In 2007 the entire information and communication technologies or ICT sector was estimated to be responsible for roughly 2% of global carbon emissions with data centers accounting for 14% of the ICT footprint.^[76] The US EPA estimates that servers and data centers are responsible for up to 1.5% of the total US electricity consumption,^[77] or roughly .5% of US GHG emissions,^[78] for 2007. Given a business as usual scenario greenhouse gas emissions from data centers is projected to more than double from 2007 levels by 2020.^[76]

In an 18-month investigation by scholars at Rice University's Baker Institute for Public Policy in Houston and the Institute for Sustainable and Applied Infodynamics in Singapore, data center-related emissions will more than triple by 2020.

Energy efficiency and overhead

The most commonly used energy efficiency metric of data center energy efficiency is power usage effectiveness (PUE), calculated as the ratio of total power entering the data center divided by the power used by IT equipment.

It measures the percentage of power used by overhead (cooling, lighting, etc.). The average USA data center has a PUE of 2.0,^[77] meaning two watts of total power (overhead + IT equipment) for every watt delivered to IT equipment. State-of-the-art is estimated to be roughly 1.2.^[80] Google publishes quarterly efficiency from data centers in operation.^[81]

The U.S. Environmental Protection Agency has an Energy Star rating for standalone or large data centers. To qualify for the ecolabel, a data center must be within the top quartile of energy efficiency of all reported facilities.^[82] The United States passed the Energy Efficiency Improvement Act of 2015, which requires federal facilities — including data centers — to operate more efficiently. In 2014, California enacted title 24 of the California Code of Regulations, which mandates that every newly constructed data center must have some form of airflow containment in place, as a measure to optimize energy efficiency.

European Union also has a similar initiative: EU Code of Conduct for Data Centres.^[83]

Energy use analysis and projects

The focus of measuring and analyzing energy use goes beyond what's used by IT equipment; facility support hardware such as chillers and fans also use energy.^[84]

In 2011 server racks in data centers were designed for more than 25 kW and the typical server was estimated to waste about 30% of the electricity it consumed. The energy demand for information storage systems was also rising. A high availability data center was estimated to have a 1 mega watt (MW) demand and consume $20,000,000 in electricity over its lifetime, with cooling representing 35% to 45% of the data center's total cost of ownership. Calculations showed that in two years the cost of powering and cooling a server could be equal to the cost of purchasing the server hardware.^[85] Research in 2018 has shown that substantial amount of energy could still be conserved by optimizing IT refresh rates and increasing server utilization.^[86]

In 2011 Facebook, Rackspace and others founded the Open Compute Project (OCP) to develop and publish open standards for greener data center computing technologies. As part of the project Facebook published the designs of its server, which it had built for its first dedicated data center in Prineville. Making servers taller left space for more effective heat sinks and enabled the use of fans that moved more air with less energy. By not buying commercial off-the-shelf servers, energy consumption due to unnecessary expansion slots on the motherboard and unneeded components, such as a graphics card, was also saved.^[87] In 2016 Google joined the project and published the designs of its 48V DC shallow data center rack. This design had long been part of Google data centers. By eliminating the multiple transformers usually deployed in data centers, Google had achieved a 30% increase in energy efficiency.^[88] In 2017 sales for data center hardware built to OCP designs topped $1.2 billion and are expected to reach $6 billion by 2021.^[87]

Power and cooling analysis

Power is the largest recurring cost to the user of a data center.^[89] A power and cooling analysis, also referred to as a thermal assessment, measures the relative temperatures in specific areas as well as the capacity of the cooling systems to handle specific ambient temperatures.^[90] A power and cooling analysis can help to identify hot spots, over-cooled areas that can handle greater power use density, the breakpoint of equipment loading, the effectiveness of a raised-floor strategy, and optimal equipment positioning (such as AC units) to balance temperatures across the data center. Power cooling density is a measure of how much square footage the center can cool at maximum capacity.^[91] The cooling of data centers is the second largest power consumer after servers. The cooling energy varies from 10% of the total energy consumption in the most efficient data centers and goes up to 45% in standard air-cooled data centers.

Energy efficiency analysis

An energy efficiency analysis measures the energy use of data center IT and facilities equipment. A typical energy efficiency analysis measures factors such as a data center's power use effectiveness (PUE) against industry standards, identifies mechanical and electrical sources of inefficiency, and identifies air-management metrics.^[92] However, the limitation of most current metrics and approaches is that they do not include IT in the analysis. Case studies have shown that by addressing energy efficiency holistically in a data center, major efficiencies can be achieved that are not possible otherwise.^[93]

Computational fluid dynamics (CFD) analysis

This type of analysis uses sophisticated tools and techniques to understand the unique thermal conditions present in each data center—predicting the temperature, airflow, and pressure behavior of a data center to assess performance and energy consumption, using numerical modeling.^[94] By predicting the effects of these environmental conditions, CFD analysis in the data center can be used to predict the impact of high-density racks mixed with low-density racks^[95] and the onward impact on cooling resources, poor infrastructure management practices and AC failure or AC shutdown for scheduled maintenance.

Thermal zone mapping

Thermal zone mapping uses sensors and computer modeling to create a three-dimensional image of the hot and cool zones in a data center.^[96]

This information can help to identify optimal positioning of data center equipment. For example, critical servers might be placed in a cool zone that is serviced by redundant AC units.

Green data centers

Data centers use a lot of power, consumed by two main usages: the power required to run the actual equipment and then the power required to cool the equipment. Power-efficiency reduces the first category.^[6]

Cooling cost reduction from natural ways includes location decisions: When the focus is not being near good fiber connectivity, power grid connections and people-concentrations to manage the equipment, a data center can be miles away from the users. 'Mass' data centers like Google or Facebook don't need to be near population centers. Arctic locations can use outside air, which provides cooling, are getting more popular.^[97]

Renewable electricity sources are another plus. Thus countries with favorable conditions, such as: Canada,^[98] Finland,^[99] Sweden,^[100] Norway ^[101] and Switzerland,^[102] are trying to attract cloud computing data centers.

Energy reuse

It is very difficult to reuse the heat which comes from air cooled data centers. For this reason, data center infrastructures are more often equipped with heat pumps.^[103] An alternative to heat pumps is the adoption of liquid cooling throughout a data center. Different liquid cooling techniques are mixed and matched to allow for a fully liquid cooled infrastructure which captures all heat in water. Different liquid technologies are categorised in 3 main groups, Indirect liquid cooling (water cooled racks), Direct liquid cooling (direct-to-chip cooling) and Total liquid cooling (complete immersion in liquid). This combination of technologies allows the creation of a thermal cascade as part of temperature chaining scenarios to create high temperature water outputs from the data center.

Dynamic infrastucture

Dynamic Infrastructure^[104] provides the ability to intelligently, automatically and securely move workloads within a data center^[105] anytime, anywhere, for migrations, provisioning^[106], to enhance performance, or building co-location facilities. It also facilitates performing routine maintenance on either physical or virtual systems all while minimizing interruption.

Network infrastructure

Communications in data centers today are most often based on networks running the IP protocol suite. Data centers contain a set of routers and switches that transport traffic between the servers and to the outside world^[107] which are connected according to the data center network architecture. Redundancy of the Internet connection is often provided by using two or more upstream service providers (see Multihoming).

Some of the servers at the data center are used for running the basic Internet and intranet services needed by internal users in the organization, e.g., e-mail servers, proxy servers, and DNS servers.

Network security elements are also usually deployed: firewalls, VPN gateways, intrusion detection systems, and so on. Also common are monitoring systems for the network and some of the applications. Additional off site monitoring systems are also typical, in case of a failure of communications inside the data center.

Software/Data Backup

Offsite backup storage

Data backup techniques includes having an encrypted copy of the data offsite. Methods used for

Modular data center

For quick deployment or disaster recovery, several large hardware vendors have developed mobile/modular solutions that can be installed and made operational in very short time.

See also

References

1. ^{{cite newspaper |newspaper=The New York Times |date=March 6, 2018 |title=An Oregon Mill Town Learns to Love Facebook and Apple |url=https://www.nytimes.com/2018/03/06/business/apple-facebook-data-center.html}}
2. ^"data center .. buildings and equipment
3. ^{{cite web |website=BBC.com |date=July 13, 2017 |title=Google announces London cloud computing data centre |url=https://www.bbc.com/news/technology-40590080}}
4. ^{{cite newspaper |newspaper=The New York Times |url=https://www.nytimes.com/2016/08/27/technology/cloud-computing-brings-sprawling-centers-but-few-jobs-to-small-towns.html |title=Cloud Computing Brings Sprawling Centers, but Few Jobs |date=August 27, 2016 |quote=data center .. a giant .. facility .. 15 of these buildings, and six more .. under construction}}
5. ^{{cite news|title=Power, Pollution and the Internet|url=https://www.nytimes.com/2012/09/23/technology/data-centers-waste-vast-amounts-of-energy-belying-industry-image.html|accessdate=2012-09-25|newspaper=The New York Times|date=September 22, 2012|author=James Glanz}}
6. ^¹{{cite journal|url=https://www.academia.edu/6982393/Power_Management_Techniques_for_Data_Centers_A_Survey|title=Power Management Techniques for Data Centers: A Survey|first=Mittal,|last=Sparsh|publisher=}}
7. ^¹²{{cite web|title=Data Center Evolution: 1960 to 2000 |author=Angela Bartels |date=August 31, 2011 |url=https://blog.rackspace.com/datacenter-evolution-1960-to-2000}}
8. ^Old large computer rooms that housed machines like the U.S. Army's ENIAC, which were developed pre-1960 (1945), were now referred to as 'data centers.'
9. ^Til the early 60s, it was primarily the government that used computers, which were large mainframes housed in rooms that today we call datacenters.
10. ^In the 1990s, Minicomputers, now called servers, were housed in the old computer rooms (now called data centers). "Server rooms" were built within company walls, co-located with low-cost networking equipment.
11. ^¹²{{cite magazine |magazine=Datamation |author=Cynthia Harvey |date=July 10, 2017 |url=https://www.datamation.com/data-center/what-is-data-center.html |title=Data Center}}
12. ^There was considerable construction of Data Centers during the early 2000s, in the period of expanding dot-com businesses.
13. ^Cloud computing was supposed to be less expensive, yet ...
14. ^¹{{cite web|url=http://www.mspmentor.net/2011/08/17/hp-updates-data-transformation-solutions/|title=Mukhar, Nicholas. "HP Updates Data Center Transformation Solutions," August 17, 2011 |publisher=}}
15. ^{{cite web|url=https://www.forbes.com/2010/03/12/cloud-computing-ibm-technology-cio-network-data-centers.html |title=Sperling, Ed. "Next-Generation Data Centers," Forbes, March 15. 2010 |publisher=Forbes.com |date= |accessdate=2013-08-30}}
16. ^{{Cite web|url=https://www.seagate.com/files/www-content/our-story/trends/files/Seagate-WP-DataAge2025-March-2017.pdf|title=IDC white paper, sponsored by Seagate|last=|first=|date=|website=|archive-url=|archive-date=|dead-url=|access-date=}}
17. ^{{cite web |date=December 10, 2007|title=Data centers are aging, unsuited for new technologies|url=https://www.datacenterdynamics.com/news/data-centers-are-aging-unsuited-for-new-technologies-and-businesses-are-slow-to-respond-says-new-ari-survey}}
18. ^In May 2011, data center research organization Uptime Institute reported that 36 percent of the large companies it surveyed expect to exhaust IT capacity within the next 18 months. {{cite magazine |magazine=CIO magazine |title=Data Centers Turn to Outsourcing to Meet Capacity Needs|url=http://www.cio.com/article/681897/Data_Centers_Turn_to_Outsourcing_to_Meet_Capacity_Needs |author=James Niccolai}}
19. ^{{cite magazine |magazine=Network World |title=Data center staff are aging faster than the equipment |url=https://www.networkworld.com/article/3301883/data-center/data-center-staff-are-aging-faster-than-the-equipment.html |date=August 30, 2018}}
20. ^{{cite web|url=http://www.tia-942.org|title=TIA-942 Certified Data Centers - Consultants - Auditors - TIA-942.org|website=www.tia-942.org}}
21. ^{{cite web|url=http://www.tiaonline.org/standards/ |title=Archived copy |accessdate=2011-11-07 |deadurl=yes |archiveurl=https://web.archive.org/web/20111106042758/http://www.tiaonline.org/standards/ |archivedate=2011-11-06 |df= }}
22. ^{{cite web|url=http://telecom-info.telcordia.com/site-cgi/ido/docs.cgi?ID=SEARCH&DOCUMENT=GR-3160&|title=GR-3160 - Telecommunications Data Center - Telcordia|website=telecom-info.telcordia.com}}
23. ^{{cite web|url=http://www.datacenterknowledge.com/archives/2010/08/03/three-signs-it%E2%80%99s-time-to-transform-your-data-center/|title=Tang, Helen. "Three Signs it's time to transform your data center," August 3, 2010, Data Center Knowledge |publisher=}}
24. ^{{cite magazine |magazine=Fortune |date=February 16, 2017 |url=http://fortune.com/2017/02/15/data-center-consolidation-cloud |title=the Era of Great Data Center Consolidation |quote='Friends don't let friends build data centers,' said Charles Phillips, chief executive officer of Infor, a business software maker}}
25. ^{{cite web |url=https://www.datacenterknowledge.com/manage/wave-data-center-consolidation-different-first-one |title=This Wave of Data Center Consolidation is Different from the First One |date=February 8, 2018}}
26. ^{{cite web |url=http://www.infoworld.stfi.re/article/3156964/storage/12-new-years-resolutions-for-your-data.html |title=12 New Year's resolutions for your data}}
27. ^{{cite web |website=IBMsystemsMagazine.com |title=Stop Virtual Server Sprawl |url=http://ibmsystemsmag.com/power/systems-management/virtualization/stop-server-sprawl}}
28. ^{{cite web |url=http://www.eaton.com/content/dam/eaton/company/sustainability/files/thought-leadership-white-paper.pdf |title=Top reasons to upgrade vintage data centers}}
29. ^¹ Miller, Rich. "Complexity: Growing Data Center Challenge," Data Center Knowledge, May 16, 2007
30. ^Sims, David. "Carousel's Expert Walks Through Major Benefits of Virtualization," TMC Net, July 6, 2010
31. ^{{cite web|last=Delahunty |first=Stephen |title=The New urgency for Server Virtualization |work=InformationWeek |date=August 15, 2011 |url=http://www.informationweek.com/news/government/enterprise-architecture/231300585 |archive-url=https://web.archive.org/web/20120402220551/http://www.informationweek.com/news/government/enterprise-architecture/231300585 |archive-date=2012-04-02 |deadurl=yes }}
32. ^{{cite web|title=HVD: the cloud's silver lining |url=http://www.intrinsictechnology.co.uk/FileUploads/HVD_Whitepaper.pdf |archive-url=http://webarchive.nationalarchives.gov.uk/20121002231021/http%3A//www.intrinsictechnology.co.uk/FileUploads/HVD_Whitepaper.pdf |dead-url=yes |archive-date=2012-10-02 |publisher=Intrinsic Technology |accessdate=2012-08-30 }}
33. ^{{cite web|url=http://www.datacenterknowledge.com/archives/2008/12/02/gartner-virtualization-disrupts-server-vendors/|title=Gartner: Virtualization Disrupts Server Vendors|date=2 December 2008|publisher=}}
34. ^{{cite web|url=http://lippisreport.com/2011/05/securing-the-data-center-transformation-aligning-security-and-data-center-dynamics/|title=Ritter, Ted. Nemertes Research, "Securing the Data-Center Transformation Aligning Security and Data-Center Dynamics"|publisher=}}
35. ^{{cite web|title=Data Center and Server Room Standards |url=http://policy.ku.edu/IT/data-center-standards|quote=CRAC (Computer Room Air Conditioner) Units: ... kit used ... to support ... Data Center Machine Room Floor.}}
36. ^{{cite web|url=https://www.gearslutz.com/board/mastering-forum/1027987-computers-machine-room.html|title=computers in machine room|quote=... machine room is ... }}
37. ^{{cite web|title=IST Machine Room Uninterrupted Power Project|url=http://windows.uwaterloo.ca/ist_ups|quote=Our two Computer Room Air Conditioners (CRACs) ... providing redundant ...}}
38. ^(In this arena, only six companies were noted by Thomas, a financial data publisher) {{cite web |publisher=Thomas Publishing Company|url=https://www.thomasnet.com/products/computer-room-flooring-water-detectors-17261082-1.html|title=Computer Room Flooring Water Detectors Suppliers}}
39. ^{{cite newspaper |newspaper=Computerworld |date=June 7, 1982 |page=120|url=https://books.google.com/books?id=2LaqX2JB6_UC|title=How to Design A Computer Room|quote=Dorlen Products (Continued from Page 107) ... Liebert ...}}
40. ^URL https://www.wateralert.com - manufacturername: Doren Products
41. ^both ofwhich focus on raised floors; this is not their main business)
42. ^a soup-to-nutsdistributor/service company
43. ^{{cite web|title=GR-2930 - NEBS: Raised Floor Requirements|url=http://telecom-info.telcordia.com/site-cgi/ido/docs.cgi?ID=SEARCH&DOCUMENT=GR-2930&}}
44. ^¹{{cite web|url=http://ed-thelen.org/comp-hist/RaisedFloor-or-Non-Raised-Floor.pdf|title=Data Center Raised Floor History}}
45. ^{{cite web|url=https://www.accessfloorsystems.com/index.php/raised-floor-info/tips-for-ordering-replacement-raised-floor-tiles.html|title=Tips for Ordering Replacement Raised Floor Tiles}}
46. ^{{cite book |title=Data Center Handbook|url=https://books.google.com/books?isbn=1118436636 |isbn=1118436636|author=Hwaiyu Geng |date=2014}}
47. ^{{cite web|url=http://www.facilitiesnet.com/hvac/article/HVAC-The-Challenges-and-Benefits-of-Under-Floor-Air-Distribution-Systems--3516|author=Steven Spinazzola |date=2005 |website=FacilitiesNet.com|title=HVAC: The Challenge And Benefits of Under Floor Air Distribution Systems}}
48. ^{{cite book | first=Victor | last=Kasacavage | year=2002 | page=227 | title=Complete book of remote access: connectivity and security | series=The Auerbach Best Practices Series | publisher=CRC Press | isbn=0-8493-1253-1}}
49. ^{{cite book |author1=Burkey, Roxanne E. |author2=Breakfield, Charles V. | year=2000 | title=Designing a total data solution: technology, implementation and deployment | page=24 | series=Auerbach Best Practices | publisher=CRC Press | isbn=0-8493-0893-3 }}
50. ^{{cite web |url=http://global.ihs.com/doc_detail.cfm?currency_code=USD&customer_id=2125452B2C0A&oshid=2125452B2C0A&shopping_cart_id=292558332C4A2020495A4D3B200A&country_code=US&lang_code=ENGL&item_s_key=00414811&item_key_date=940819&input_doc_number=TIA-942&input_doc_title= |title=Telecommunications Infrastructure Standard for Data Centers |website=ihs.com |date=2005-04-12 |accessdate=2017-02-28}}
51. ^http://www.firstcomm.com/overview-of-data-center-availability-tiers/
52. ^{{cite web|title=About Data Center |website=ESDS.co.in (ESDS Pvt. Ltd.)|url=https://www.esds.co.in/blog/about-data-center}}
53. ^{{cite newspaper |newspaper=Computerworld |date=April 12, 2016 |author=Patrick Thibodeau|url=https://www.computerworld.com/article/3054603/data-center/a-65-story-data-center-design-that-soars-with-ideas.html|title=Envisioning a 65-story data center}}
54. ^{{cite web|url=https://www.youtube.com/watch?v=zRwPSFpLX8I|title=Google Container Datacenter Tour (video)}}
55. ^{{cite web|url=http://www.networkcomputing.com/data-center/231000669|title=Romonet Offers Predictive Modeling Tool For Data Center Planning|date=29 June 2011|publisher=}}
56. ^¹{{cite web|url=http://www.nxtbook.com/nxtbooks/bicsi/news_20100506/#/26|title=BICSI News Magazine - May/June 2010|website=www.nxtbook.com}}
57. ^{{cite web|url=http://www.datacenterjournal.com/design/hedging-your-data-center-power/|title=Hedging Your Data Center Power|publisher=}}
58. ^Clark, Jeffrey. "The Price of Data Center Availability—How much availability do you need?", Oct. 12, 2011, The Data Center Journal {{cite web |url=http://www.datacenterjournal.com/home/news/languages/item/2792-the-price-of-data-center-availability |title=Archived copy |accessdate=2012-02-08 |deadurl=yes |archiveurl=https://web.archive.org/web/20111203145721/http://www.datacenterjournal.com/home/news/languages/item/2792-the-price-of-data-center-availability |archivedate=2011-12-03 |df= }}
59. ^{{cite web|url=http://searchcio.techtarget.com/news/1312614/Five-tips-on-selecting-a-data-center-location|title=Five tips on selecting a data center location|publisher=}}
60. ^{{cite web|url=https://www.youtube.com/watch?v=DPcM5UePTY0|title=IBM zEnterprise EC12 Business Value Video}}
61. ^Niles, Susan. "Standardization and Modularity in Data Center Physical Infrastructure," 2011, Schneider Electric, page 4. {{cite web |url=http://www.apcmedia.com/salestools/VAVR-626VPD_R1_EN.pdf |title=Archived copy |accessdate=2012-02-08 |deadurl=yes |archiveurl=https://web.archive.org/web/20120416120624/http://www.apcmedia.com/salestools/VAVR-626VPD_R1_EN.pdf |archivedate=2012-04-16 |df= }}
62. ^{{cite web|url=http://www.datacenterknowledge.com/archives/2011/09/08/strategies-for-the-containerized-data-center/|title=Strategies for the Containerized Data Center|date=8 September 2011|publisher=}}
63. ^{{cite web|url=http://www.infoworld.com/d/green-it/hp-says-prefab-data-center-cuts-costs-in-half-837?page=0,0|title=HP says prefab data center cuts costs in half|first=James|last=Niccolai|publisher=}}
64. ^{{cite news| url=https://www.reuters.com/article/pressRelease/idUS141369+14-Sep-2009+PRN20090914 | work=Reuters | title=tw telecom and NYSERDA Announce Co-location Expansion | date=2009-09-14}}
65. ^{{cite web|url=http://www.datacenterdynamics.com/focus/archive/2013/09/air-air-combat-indirect-air-cooling-wars-0|title=Air to air combat - indirect air cooling wars|publisher=}}
66. ^Detailed explanation of UPS topologies {{cite web|url=http://www.emersonnetworkpower.com/en-US/Brands/Liebert/Documents/White%20Papers/Evaluating%20the%20Economic%20Impact%20of%20UPS%20Technology.pdf |format=PDF |title=EVALUATING THE ECONOMIC IMPACT OF UPS TECHNOLOGY |deadurl=yes |archiveurl=https://web.archive.org/web/20101122074817/http://emersonnetworkpower.com/en-US/Brands/Liebert/Documents/White%20Papers/Evaluating%20the%20Economic%20Impact%20of%20UPS%20Technology.pdf |archivedate=2010-11-22 |df= }}
67. ^{{cite web|url=https://www.cablinginstall.com/articles/print/volume-24/issue-4/features/data-center/cable-tray-systems-support-cables-journey-through-the-data-center.html|title=Cable tray systems support cables' journey through the data center}}
68. ^{{cite web|url=https://www.facilitiesnet.com/datacenters/article/Data-Center-Fire-Suppression-Systems-What-Facility-Managers-Should-Consider--14595|title=Data Center Fire Suppression Systems: What Facility Managers Should Consider}}
69. ^{{cite web|author=Sarah D. Scalet |url=http://www.csoonline.com/article/220665 |title=19 Ways to Build Physical Security Into a Data Center |publisher=Csoonline.com |date=2005-11-01 |accessdate=2013-08-30}}
70. ^{{Citation |title=Systems and methods for controlling an electronic lock for a remote device |date=2016-08-01 |url=https://patents.google.com/patent/US9865109B2/en|accessdate=2018-04-25}}
71. ^{{cite web |url=http://www1.eere.energy.gov/femp/program/dc_energy_consumption.html|title=Data Center Energy Consumption Trends|publisher=U.S. Department of Energy|accessdate=2010-06-10}}
72. ^J. Koomey, C. Belady, M. Patterson, A. Santos, K.D. Lange: Assessing Trends Over Time in Performance, Costs, and Energy Use for Servers Released on the web August 17th, 2009.
73. ^{{cite web|url=http://www1.eere.energy.gov/femp/pdfs/data_center_qsguide.pdf |title=Quick Start Guide to Increase Data Center Energy Efficiency |publisher=U.S. Department of Energy |accessdate=2010-06-10 |deadurl=yes |archiveurl=https://web.archive.org/web/20101122035456/http://www1.eere.energy.gov/femp/pdfs/data_center_qsguide.pdf |archivedate=2010-11-22 |df= }}
74. ^{{Cite web|url=https://storage.googleapis.com/p4-production-content/international/wp-content/uploads/2017/01/35f0ac1a-clickclean2016-hires.pdf|title=CLICKING CLEAN: WHO IS WINNING THE RACE TO BUILD A GREEN INTERNET|author=Greenpeace |date=2017}}
75. ^{{Cite news|url=https://www.forbes.com/sites/forbestechcouncil/2017/12/15/why-energy-is-a-big-and-rapidly-growing-problem-for-data-centers |title=Why Energy Is A Big And Rapidly Growing Problem For Data Centers|last=Danilak|first=Radoslav|work=Forbes|access-date=2018-07-06|language=en}}
76. ^¹{{cite web|url=http://www.smart2020.org/_assets/files/03_Smart2020Report_lo_res.pdf |title=Smart 2020: Enabling the low carbon economy in the information age |publisher=The Climate Group for the Global e-Sustainability Initiative |accessdate=2008-05-11 |deadurl=yes |archiveurl=https://web.archive.org/web/20110728032834/http://www.smart2020.org/_assets/files/03_Smart2020Report_lo_res.pdf |archivedate=2011-07-28 |df= }}
77. ^¹{{cite web|url=http://www.energystar.gov/ia/partners/prod_development/downloads/EPA_Datacenter_Report_Congress_Final1.pdf|title=Report to Congress on Server and Data Center Energy Efficiency|publisher=U.S. Environmental Protection Agency ENERGY STAR Program}}
78. ^A calculation of data center electricity burden cited in the Report to Congress on Server and Data Center Energy Efficiency and electricity generation contributions to green house gas emissions published by the EPA in the Greenhouse Gas Emissions Inventory Report. Retrieved 2010-06-08.
79. ^{{Cite news |author=Katrice R. Jalbuena |title=Green business news. |publisher=EcoSeed |date=October 15, 2010 |url=http://ecoseed.org/en/business-article-list/article/1-business/8219-i-t-industry-risks-output-cut-in-low-carbon-economy |accessdate=2010-11-11 |deadurl=yes |archiveurl=https://web.archive.org/web/20160618081417/http://ecoseed.org/en/business-article-list/article/1-business/8219-i-t-industry-risks-output-cut-in-low-carbon-economy |archivedate=2016-06-18 }}
80. ^{{cite web|url=https://microsite.accenture.com/svlgreport/Documents/pdf/SVLG_Report.pdf|title=Data Center Energy Forecast|publisher=Silicon Valley Leadership Group}}
81. ^{{cite web|url=https://www.google.com/about/datacenters/efficiency/internal/|title=Efficiency: How we do it – Data centers|publisher=Google|accessdate=2015-01-19}}
82. ^Commentary on introduction of Energy Star for Data Centers {{cite web|title=Introducing EPA ENERGY STAR for Data Centers |url=http://www.emerson.com/edc/post/2010/06/15/Introducing-EPA-ENERGY-STARc2ae-for-Data-Centers.aspx |format=Web site |publisher=Jack Pouchet |accessdate=2010-09-27 |date=2010-09-27 |deadurl=yes |archiveurl=https://web.archive.org/web/20100925210539/http://emerson.com/edc/post/2010/06/15/Introducing-EPA-ENERGY-STARc2ae-for-Data-Centers.aspx |archivedate=2010-09-25 |df= }}
83. ^{{cite web|url=http://iet.jrc.ec.europa.eu/energyefficiency/ict-codes-conduct/data-centres-energy-efficiency |title=EU Code of Conduct for Data Centres |publisher=iet.jrc.ec.europa.eu |date= |accessdate=2013-08-30 }}
84. ^{{cite web |url=http://www.gtsi.com/cms/documents/white-papers/green-it.pdf |title=UNICOM Global :: Home|website=www.gtsi.com}}
85. ^{{Cite book|title=Designing Green Networks and Network Operations: Saving Run-the-Engine Costs|author=Daniel Minoli|publisher=CRC Press|year=2011|isbn= 9781439816394|pages=5}}
86. ^{{cite journal |url=http://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=8263130 |title=A Comprehensive Reasoning Framework for Hardware Refresh in Data Centres|author=Rabih Bashroush |journal=IEEE Transactions on Sustainable Computing |date=2018}}
87. ^¹{{cite web |date=March 28, 2018 |title=What is the Open Compute Project? |author=Peter Sayer |publisher=NetworkWorld|url=https://www.networkworld.com/article/3266293/lan-wan/what-is-the-open-compute-project.html}}
88. ^{{cite web |date=March 9, 2016 |title=OCP Summit: Google joins and shares 48V tech |author=Peter Judge |publisher=DCD Data center Dynamics |url=https://www.datacenterdynamics.com/news/ocp-summit-google-joins-and-shares-48v-tech/}}
89. ^{{Citation | title = Choosing a Data Center | url = http://www.atlantic.net/images/pdf/choosing_a_data_center.pdf | publisher = Disaster Recovery Journal | year = 2009 | author = Cosmano, Joe | accessdate = 2012-07-21}}
90. ^{{cite web|url=http://www.internetnews.com/xSP/article.php/3690651/HPs+Green+Data+Center+Portfolio+Keeps+Growing.htm|title=HP's Green Data Center Portfolio Keeps Growing - InternetNews.|website=www.internetnews.com}}
91. ^{{Citation | title = How to Choose a Data Center | url = http://www.inc.com/guides/2010/11/how-to-choose-a-data-center_pagen_2.html | year = 2010 | author = Inc. staff | accessdate = 2012-07-21}}
92. ^{{cite web|url=http://www.triplepundit.com/2011/04/hp-launches-program-companies-integrate-manage-energy-carbon-reduction-strategies/|title=Siranosian, Kathryn. "HP Shows Companies How to Integrate Energy Management and Carbon Reduction," TriplePundit, April 5, 2011.|publisher=}}
93. ^{{cite journal|url=http://ieeexplore.ieee.org/document/7927928/|last1=Bashroush|first1=Rabih|last2=Woods|first2=Eoin|title=Architectural Principles for Energy-Aware Internet-Scale Applications|journal=IEEE Software|volume=34|issue=3|date=2017}}
94. ^Bullock, Michael. "Computation Fluid Dynamics - Hot topic at Data Center World," Transitional Data Services, March 18, 2010. {{webarchive|url=https://web.archive.org/web/20120103183406/http://blog.transitionaldata.com/aggregate/bid/37840/Seeing-the-Invisible-Data-Center-with-CFD-Modeling-Software|date=January 3, 2012}}
95. ^{{cite web|url=http://www.thegreengrid.org/~/media/WhitePapers/White_Paper_27_Impact_of_Virtualization_Data_On_Center_Physical_Infrastructure_020210.pdf?lang=en|title=Bouley, Dennis (editor). "Impact of Virtualization on Data Center Physical Infrastructure," The Green grid, 2010.|publisher=}}
96. ^{{cite web|url=http://searchdatacenter.techtarget.com/news/1265634/HP-Thermal-Zone-Mapping-plots-data-center-hot-spots|title=HP Thermal Zone Mapping plots data center hot spots|publisher=}}
97. ^{{cite web|url=http://www.gizmag.com/fjord-cooled-data-center/20938/|title=Fjord-cooled DC in Norway claims to be greenest|access-date=23 December 2011}}
98. ^[https://www.theglobeandmail.com/report-on-business/canada-called-prime-real-estate-for-massive-data-computers/article2071677/ Canada Called Prime Real Estate for Massive Data Computers - Globe & Mail] Retrieved June 29, 2011.
99. ^Finland - First Choice for Siting Your Cloud Computing Data Center.. Retrieved 4 August 2010.
100. ^{{cite web|url=http://www.stockholmbusinessregion.se/templates/page____41724.aspx?epslanguage=EN|title=Stockholm sets sights on data center customers|accessdate=4 August 2010|archiveurl=https://web.archive.org/web/20100819190918/http://www.stockholmbusinessregion.se/templates/page____41724.aspx?epslanguage=EN|archivedate=19 August 2010}}
101. ^In a world of rapidly increasing carbon emissions from the ICT industry, Norway offers a sustainable solution Retrieved 1 March 2016.
102. ^Swiss Carbon-Neutral Servers Hit the Cloud.. Retrieved 4 August 2010.
103. ^{{cite web|url=https://stockholmdataparks.com/wp-content/uploads/white-paper-cost-efficient-and-sustainable-data-center-cooling-2017-01-23-1.pdf|title=Data Center Cooling with Heat Recovery |website=StockholmDataParks.com|date=January 23, 2017}}
104. ^Method For Dynamic Information Technology Infrastructure Provisioning
105. ^The Dynamic Datacenter
106. ^Computation on Demand: The Promise of Dynamic Provisioning
107. ^{{cite journal|last1=Noormohammadpour|first1=Mohammad|last2=Raghavendra|first2=Cauligi|title=Datacenter Traffic Control: Understanding Techniques and Tradeoffs|journal=Communications Surveys & Tutorials, IEEE|date=16 July 2018|volume=20|issue=2|page=1492-1525|url=http://ieeexplore.ieee.org/document/8207422/}}
108. ^{{cite magazine |magazine=Forbes|url=https://www.forbes.com/sites/forbestechcouncil/2018/10/04/protecting-data-without-blowing-the-budget-part-1-onsite-backup |title=Protecting Data Without Blowing The Budget, Part 1: Onsite Backup|date=October 4, 2018}}
109. ^{{cite web|url=http://spectralogic.com/wp-content/uploads/white-paper-iron-mountain-vs-amazon-glacier.pdf|title=Iron Mountain vs Amazon Glacier: Total Cost Analysis}}
110. ^{{cite magazine |title=Iron Mountain introduces cloud backup and management service|url=https://www.networkworld.com/article/3224892/backup-recovery/iron-mountain-introduces-cloud-backup-and-management-service.html|date=September 14, 2017}}