Experimental Description of Information Technology Equipment Reliability Exposed to a Data Center Using Airside Economizer Operating in Recommended and Allowable ASHRAE Envelopes in an ANSI/ISA Classified G2 Environment

2020 ◽  
Vol 142 (2) ◽  
Author(s):  
Oluwaseun Awe ◽  
Jimil M. Shah ◽  
Dereje Agonafer ◽  
Prabjit Singh ◽  
Naveen Kannan ◽  
...  

Abstract Airside economizers lower the operating cost of data centers by reducing or eliminating mechanical cooling. It, however, increases the risk of reliability degradation of information technology (IT) equipment due to contaminants. IT Equipment manufacturers have tested equipment performance and guarantee the reliability of their equipment in environments within ISA 71.04-2013 severity level G1 and the ASHRAE recommended temperature-relative humidity (RH) envelope. IT Equipment manufacturers require data center operators to meet all the specified conditions consistently before fulfilling warranty on equipment failure. To determine the reliability of electronic hardware in higher severity conditions, field data obtained from real data centers are required. In this study, a corrosion classification coupon experiment as per ISA 71.04-2013 was performed to determine the severity level of a research data center (RDC) located in an industrial area of hot and humid Dallas. The temperature-RH excursions were analyzed based on time series and weather data bin analysis using trend data for the duration of operation. After some period, a failure was recorded on two power distribution units (PDUs) located in the hot aisle. The damaged hardware and other hardware were evaluated, and cumulative corrosion damage study was carried out. The hypothetical estimation of the end of life of components is provided to determine free air-cooling hours for the site. There was no failure of even a single server operated with fresh air-cooling shows that using evaporative/free air cooling is not detrimental to IT equipment reliability. This study, however, must be repeated in other geographical locations to determine if the contamination effect is location dependent.

Author(s):  
Jimil M. Shah ◽  
Oluwaseun Awe ◽  
Pavan Agarwal ◽  
Iziren Akhigbe ◽  
Dereje Agonafer ◽  
...  

Deployment of air-side economizers in data centers is rapidly gaining acceptance to reduce the cost of energy by reducing the hours of operation of CRAC units. Use of air-side economizers has the associated risk of introducing gaseous and particulate contamination into data centers, thus, degrading the reliability of Information Technology (IT) equipment. Sulfur-bearing gaseous contamination is of concern because it attacks the copper and silver metallization of the electronic components causing electrical opens and/or shorts. Particulate contamination with low deliquescence relative humidity is of concern because it becomes wet and therefore electrically conductive under normal data center relative humidity conditions. IT equipment manufacturers guarantee the reliability of their equipment operating in environment within ISA 71.04-2013 severity level G1 and within the ASHRAE recommended temperature-relative humidity envelope. The challenge is to determine the reliability degrading effect of contamination severity levels higher than G1 and the temperature and humidity allowable ranges A1–A3 well outside the recommended range. This paper is a first attempt at addressing this challenge by studying the cumulative corrosion damage to IT equipment operated in an experimental data center located in Dallas, known to have contaminated air with ISA 71.04-2013 severity level G2. The data center is cooled using an air-side economizer. This study serves several purposes including: the correlation of equipment reliability to levels of airborne corrosive contaminants and the study of the degree of reliability degradation when the equipment is operated, outside the recommended envelope, in the allowable temperature-relative humidity range in geographies with high levels of gaseous and particulate contamination. The operating and external conditions of a modular data center, located in a Dallas industrial area, using air-side economizer is described. The reliability degradation of servers exposed to outside air via an airside economizer was determined qualitatively examining the corrosion of components in the servers and comparing the results to the corrosion of components in a non-operating server stored in a protective environment. The corrosion-related reliability of the servers over almost the life of the product was related to continuous temperature and relative humidity for the duration of the experiment. This work provides guidance for data center administration for similar environment. From an industry perspective, it should be noted that in the four years of operation in the hot and humid Dallas climate using only evaporative cooling or fresh air cooling, we have not seen a single server failure in our research pod. That performance should highlight an opportunity for significant energy savings for data center operators in a much broader geographic area than currently envisioned with evaporative cooling.


Author(s):  
Prabjit Singh ◽  
Levente Klein ◽  
Dereje Agonafer ◽  
Jimil M. Shah ◽  
Kanan D. Pujara

The energy used by information technology (IT) equipment and the supporting data center equipment keeps rising as data center proliferation continues unabated. In order to contain the rising computing costs, data center administrators are resorting to cost cutting measures such as not tightly controlling the temperature and humidity levels and in many cases installing air side economizers with the associated risk of introducing particulate and gaseous contaminations into their data centers. The ASHRAE TC9.9 subcommittee, on Mission Critical Facilities, Data Centers, Technology Spaces, and Electronic Equipment, has accommodated the data center administrators by allowing short period excursions outside the recommended temperature-humidity range, into allowable classes A1-A3. Under worst case conditions, the ASHRAE A3 envelope allows electronic equipment to operate at temperature and humidity as high as 24°C and 85% relative humidity for short, but undefined periods of time. This paper addresses the IT equipment reliability issues arising from operation in high humidity and high temperature conditions, with particular attention paid to the question of whether it is possible to determine the all-encompassing x-factors that can capture the effects of temperature and relative humidity on equipment reliability. The role of particulate and gaseous contamination and the aggravating effects of high temperature and high relative humidity will be presented and discussed. A method to determine the temperature and humidity x-factors, based on testing in experimental data centers located in polluted geographies, will be proposed.


Author(s):  
Levente J. Klein ◽  
Sergio A. Bermudez ◽  
Fernando J. Marianno ◽  
Hendrik F. Hamann ◽  
Prabjit Singh

Many data center operators are considering the option to convert from mechanical to free air cooling to improve energy efficiency. The main advantage of free air cooling is the elimination of chiller and Air Conditioning Unit operation when outdoor temperature falls below the data center temperature setpoint. Accidental introduction of gaseous pollutants in the data center along the fresh air and potential latency in response of control infrastructure to extreme events are some of the main concerns for adopting outside air cooling in data centers. Recent developments of ultra-high sensitivity corrosion sensors enable the real time monitoring of air quality and thus allow a better understanding of how airflow, relative humidity, and temperature fluctuations affect corrosion rates. Both the sensitivity of sensors and wireless networks ability to detect and react rapidly to any contamination event make them reliable tools to prevent corrosion related failures. A feasibility study is presented for eight legacy data centers that are evaluated to implement free air cooling.


2017 ◽  
Vol 139 (2) ◽  
Author(s):  
Jimil M. Shah ◽  
Oluwaseun Awe ◽  
Betsegaw Gebrehiwot ◽  
Dereje Agonafer ◽  
Prabjit Singh ◽  
...  

Deployment of airside economizers (ASEs) in data centers is rapidly gaining acceptance to reduce cost of cooling energy by reducing hours of operation of computer room air conditioning (CRAC) units. Airside economization has associated risk of introducing gaseous and particulate contamination into data centers, thus degrading the reliability of information technology (IT) equipment. The challenge is to determine reliability degradation of IT equipment if operated in environmental conditions outside American Society of Heating, Refrigeration, and Air-Conditioning Engineers (ASHRAE) recommended envelope with contamination severity levels higher than G1. This paper is a first attempt at addressing this challenge by studying the cumulative corrosion damage to IT equipment operated in an experimental modular data center (MDC) located in an industrial area with measured level of air contaminants in ISA severity level G2. This study serves several purposes including: correlating IT equipment reliability to levels of airborne corrosive contaminants and studying degree of reliability degradation when IT equipment is operated outside ASHRAE recommended envelope at a location with high levels of contaminants. Reliability degradation of servers exposed to outside air via an airside economizer was determined qualitatively by examining corrosion of components in these servers and comparing the results to corrosion of components in other similar servers that were stored in a space where airside economization was not used. In the 4 years of the modular data center's servers' operation, none of the servers failed. This observation highlights an opportunity to significantly save data center cooling energy by allowing IT equipment to operate outside the currently recommended and allowable ASHRAE envelopes and outside the ISA severity level G1.


Author(s):  
Chris Muller ◽  
Chuck Arent ◽  
Henry Yu

Abstract Lead-free manufacturing regulations, reduction in circuit board feature sizes and the miniaturization of components to improve hardware performance have combined to make data center IT equipment more prone to attack by corrosive contaminants. Manufacturers are under pressure to control contamination in the data center environment and maintaining acceptable limits is now critical to the continued reliable operation of datacom and IT equipment. This paper will discuss ongoing reliability issues with electronic equipment in data centers and will present updates on ongoing contamination concerns, standards activities, and case studies from several different locations illustrating the successful application of contamination assessment, control, and monitoring programs to eliminate electronic equipment failures.


Author(s):  
Gautham Thirunavakkarasu ◽  
Satyam Saini ◽  
Jimil Shah ◽  
Dereje Agonafer

The percentage of the energy used by data centers for cooling their equipment has been on the rise. With that, there has been a necessity for exploring new and more efficient methods like airside economization, both from an engineering as well as business point of view, to contain this energy demand. Air cooling especially, free air cooling has always been the first choice for IT companies to cool their equipment. But, it has its downside as well. As per ASHRAE standard (2009b), the air which is entering the data center should be continuously filtered with MERV 11 or preferably MERV 13 filters and the air which is inside the data center should be clean as per ISO class 8. The objective of this study is to design a model data center and simulate the flow path with the help of 6sigma room analysis software. A high-density data center was modelled for both hot aisle and cold aisle containment configurations. The particles taken into consideration for modelling were spherical in shape and of diameters 0.05, 0.1 and 1 micron. The physical properties of the submicron particles have been assumed to be same as that of air. For heavier particles of 1 micron in size, the properties of dense carbon particle are chosen for simulating particulate contamination in a data center. The Computer Room Air Conditioning unit is modelled as the source for the particulate contaminants which represents contaminants entering along with free air through an air-side economizer. The data obtained from this analysis can be helpful in predicting which type of particles will be deposited at what location based on its distance from the source and weight of the particles. This can further help in reinforcing the regions with a potential to fail under particulate contamination.


Author(s):  
Dustin W. Demetriou ◽  
Vinod Kamath ◽  
Howard Mahaney

The generation-to-generation IT performance and density demands continue to drive innovation in data center cooling technologies. For many applications, the ability to efficiently deliver cooling via traditional chilled air cooling approaches has become inadequate. Water cooling has been used in data centers for more than 50 years to improve heat dissipation, boost performance and increase efficiency. While water cooling can undoubtedly have a higher initial capital cost, water cooling can be very cost effective when looking at the true lifecycle cost of a water cooled data center. This study aims at addressing how one should evaluate the true total cost of ownership for water cooled data centers by considering the combined capital and operational cost for both the IT systems and the data center facility. It compares several metrics, including return-on-investment for three cooling technologies: traditional air cooling, rack-level cooling using rear door heat exchangers and direct water cooling via cold plates. The results highlight several important variables, namely, IT power, data center location, site electric utility cost, and construction costs and how each of these influence the total cost of ownership of water cooling. The study further looks at implementing water cooling as part of a new data center construction project versus a retrofit or upgrade into an existing data center facility.


Author(s):  
Veerendra Mulay ◽  
Saket Karajgikar ◽  
Dereje Agonafer ◽  
Roger Schmidt ◽  
Madhusudan Iyengar

The power trend for Server systems continues to grow thereby making thermal management of Data centers a very challenging task. Although various configurations exist, the raised floor plenum with Computer Room Air Conditioners (CRACs) providing cold air is a popular operating strategy. The air cooling of data center however, may not address the situation where more energy is expended in cooling infrastructure than the thermal load of data center. Revised power trend projections by ASHRAE TC 9.9 predict heat load as high as 5000W per square feet of compute servers’ equipment footprint by year 2010. These trend charts also indicate that heat load per product footprint has doubled for storage servers during 2000–2004. For the same period, heat load per product footprint for compute servers has tripled. Amongst the systems that are currently available and being shipped, many racks exceed 20kW. Such high heat loads have raised concerns over limits of air cooling of data centers similar to air cooling of microprocessors. A hybrid cooling strategy that incorporates liquid cooling along with air cooling can be very efficient in these situations. A parametric study of such solution is presented in this paper. A representative data center with 40 racks is modeled using commercially available CFD code. The variation in rack inlet temperature due to tile openings, underfloor plenum depths is reported.


Author(s):  
Dan Comperchio ◽  
Sameer Behere

Data center cooling systems have long been burdened by high levels of redundancy requirements, resulting in inefficient system designs to satisfy a risk-adverse operating environment. As attitudes, technologies, and sustainability awareness change within the industry, data centers are beginning to realize higher levels of energy efficiency without sacrificing operational security. By exploiting the increased temperature and humidity tolerances of the information technology equipment (ITE), data center mechanical systems can leverage ambient conditions to operate in economization mode for increased times during the year. Economization provides one of the largest methodologies for data centers to reduce their energy consumption and carbon footprint. As outside air temperatures and conditions become more favorable for cooling the data center, mechanical cooling through vapor-compression cycles is reduced or entirely eliminated. One favorable method for utilizing low outside air temperatures without sacrificing indoor air quality is through deploying rotary heat wheels to transfer heat between the data center return air and outside air without introducing outside air into the white space. A metal corrugated wheel is rotated through two opposing airstreams with varying thermal gradients to provide a net cooling effect at significantly reduced electrical energy over traditional mechanical cooling topologies. To further extend the impacts of economization, data centers are also able to significantly raise operating temperatures beyond what is traditionally found in comfort cooling applications. The increase in the dry bulb temperature provided to the inlet of the information technology equipment, as well as an elevated temperature rise across the equipment significantly reduces the energy use within a data center.


Author(s):  
Satyam Saini ◽  
Pardeep Shahi ◽  
Pratik V Bansode ◽  
Jimil M. Shah ◽  
Dereje Agonafer

Abstract Continuous rise in cloud computing and other web-based services propelled the data center proliferation seen over the past decade. Traditional data centers use vapor-compression-based cooling units that not only reduce energy efficiency but also increase operational and initial investment costs due to involved redundancies. Free air cooling and airside economization can substantially reduce the IT Equipment (ITE) cooling power consumption, which accounts for approximately 40% of energy consumption for a typical air-cooled data center. However, this cooling approach entails an inherent risk of exposing the IT equipment to harmful ultrafine particulate contaminants, thus, potentially reducing the equipment and component reliability. The present investigation attempts to quantify the effects of particulate contamination inside the data center equipment and ITE room using CFD. An analysis of the boundary conditions to be used was done by detailed modeling of IT equipment and the data center white space. Both 2-D and 3-D simulations were done for detailed analysis of particle transport within the server enclosure. An analysis of the effect of the primary pressure loss obstructions like heat sinks and DIMMs inside the server was done to visualize the localized particle concentrations within the server. A room-level simulation was then conducted to identify the most vulnerable locations of particle concentration within the data center space. The results show that parameters such as higher velocities, heat sink cutouts, and higher aspect ratio features within the server tend to increase the particle concentration inside the servers.


Sign in / Sign up

Export Citation Format

Share Document