The Thermal Design of a Next Generation Data Center: A Conceptual Exposition

2008 ◽  
Vol 130 (4) ◽  
Author(s):  
Emad Samadiani ◽  
Yogendra Joshi ◽  
Farrokh Mistree

In the near future, electronic cabinets of data centers will house high performance chips with heat fluxes approaching 100 W/cm2 and associated high volumetric heat generation rates. With the power trends in the electronic cabinets indicating 60 kW cabinets in the near future, the current cooling systems of data centers will be insufficient and new solutions will need to be explored. Accordingly, the key issue that merits investigation is identifying and satisfying the needed specifications of the new thermal solutions, considering the design environment of the next generation data centers. Anchoring our work in the open engineering system paradigm, we identify the requirements of the future thermal solutions and explore various design specifications of an ideally open thermal solution for a next generation data center. To approach an open cooling system for the future data centers, the concept of a thermal solution centered on the multiscale (multilevel) nature of the data centers is discussed. The potential of this solution to be open, along with its theoretical advantages compared with the typical air-cooling solutions, is demonstrated through some scenarios. The realization problems and the future research needs are highlighted to achieve a practical open multiscale thermal solution in data centers. Such solution is believed to be both effective and efficient for the next generation data centers.

Author(s):  
Seungho Mok ◽  
Yogendra K. Joshi ◽  
Satish Kumar ◽  
Ronald R. Hutchins

This study focuses on developing computational models for hybrid or liquid cooled data centers that may reutilize waste heat. A data center with 17 fully populated racks with IBM LS20 blade servers, which consumes 408 kW at the maximum load, is considered. The hybrid cooling system uses a liquid to remove the heat produced by high power components, while the remaining low power components are cooled by air. The paper presents three hybrid cooling scenarios. For the first two cases, air is cooled by direct expansion (DX) cooling system with air-side economizer. Unlike the cooling air, two different approaches for cooling water are investigated: air-cooled chiller and ground water through liquid-to-liquid heat exchanger. Waste heat re-use for pre-heating building water in co-located facilities is also investigated for the second scenario. In addition to the hybrid cooling models, a fully liquid cooling system is modeled as the third scenario for comparison with hybrid cooling systems. By linking the computational models, power usage effectiveness (PUE) for all scenarios can be calculated for selected geographical locations and data center parameters. The paper also presents detailed analyses of the cooling components considered and comparisons of the PUE results.


Author(s):  
Tianyi Gao ◽  
Emad Samadiani ◽  
Roger Schmidt ◽  
Bahgat Sammakia

Thermal management of high power data centers poses challenges due to the high operational cost which is made worse due to the many inefficiencies that arise in them. Additional challenges arise due to the dynamic behaviors that occur during normal operation, and also during emergencies such as power outages or failure of some or all of the cooling equipment. Water and hybrid air plus water cooled data centers are an alternate cooling solution combining liquid cooling systems, such as rear door heat exchangers located within the racks themselves, in addition to the traditional raised floor cold aisle air cooling system. Such a solution may be used when some of the equipment in a data center is upgraded to higher end and higher power equipment which may not be manageable with the existing air cooling system. For a data center with a hybrid cooling system, the cold air supply and the cold water supply should increase in case of an emergency, such as a CRAC (Computer Room Air Conditioner) units’ failure. In this paper, a detailed computational study is conducted to investigate the dynamic response of the impact of a CRAC failure on both water side and air side in a representative hybrid cooling room. The room studied is an air cooled data center using the common cold aisle approach, with rear door heat exchangers installed on all of the racks. CRAC failure is investigated in a hybrid cooling room. The variation and fluctuation in an average rack inlet temperature, and inlet temperatures at different detail locations are presented in plots, showing the dynamic performance of a hybrid cooling data center subjected to the different CRAC failure scenarios. Different response time studies are also presented in this paper.


Author(s):  
Tianyi Gao ◽  
James Geer ◽  
Bahgat G. Sammakia ◽  
Russell Tipton ◽  
Mark Seymour

Cooling power constitutes a large portion of the total electrical power consumption in data centers. Approximately 25%∼40% of the electricity used within a production data center is consumed by the cooling system. Improving the cooling energy efficiency has attracted a great deal of research attention. Many strategies have been proposed for cutting the data center energy costs. One of the effective strategies for increasing the cooling efficiency is using dynamic thermal management. Another effective strategy is placing cooling devices (heat exchangers) closer to the source of heat. This is the basic design principle of many hybrid cooling systems and liquid cooling systems for data centers. Dynamic thermal management of data centers is a huge challenge, due to the fact that data centers are operated under complex dynamic conditions, even during normal operating conditions. In addition, hybrid cooling systems for data centers introduce additional localized cooling devices, such as in row cooling units and overhead coolers, which significantly increase the complexity of dynamic thermal management. Therefore, it is of paramount importance to characterize the dynamic responses of data centers under variations from different cooling units, such as cooling air flow rate variations. In this study, a detailed computational analysis of an in row cooler based hybrid cooled data center is conducted using a commercially available computational fluid dynamics (CFD) code. A representative CFD model for a raised floor data center with cold aisle-hot aisle arrangement fashion is developed. The hybrid cooling system is designed using perimeter CRAH units and localized in row cooling units. The CRAH unit supplies centralized cooling air to the under floor plenum, and the cooling air enters the cold aisle through perforated tiles. The in row cooling unit is located on the raised floor between the server racks. It supplies the cooling air directly to the cold aisle, and intakes hot air from the back of the racks (hot aisle). Therefore, two different cooling air sources are supplied to the cold aisle, but the ways they are delivered to the cold aisle are different. Several modeling cases are designed to study the transient effects of variations in the flow rates of the two cooling air sources. The server power and the cooling air flow variation combination scenarios are also modeled and studied. The detailed impacts of each modeling case on the rack inlet air temperature and cold aisle air flow distribution are studied. The results presented in this work provide an understanding of the effects of air flow variations on the thermal performance of data centers. The results and corresponding analysis is used for improving the running efficiency of this type of raised floor hybrid data centers using CRAH and IRC units.


Author(s):  
Kamran Nazir ◽  
Naveed Durrani ◽  
Imran Akhtar ◽  
M. Saif Ullah Khalid

Due to high energy demands of data centers and the energy crisis throughout the world, efficient heat transfer in a data center is an active research area. Until now major emphasis lies upon study of air flow rate and temperature profiles for different rack configurations and tile layouts. In current work, we consider different hot aisle (HA) and cold aisle (CA) configurations to study heat transfer phenomenon inside a data center. In raised floor data centers when rows of racks are parallel to each other, in a conventional cooling system, there are equal number of hot and cold aisles for odd number of rows of racks. For even number of rows of racks, whatever configuration of hot/cold aisles is adopted, number of cold aisles is either one greater or one less than number of hot aisles i.e. two cases are possible case A: n(CA) = n(HA) + 1 and case B: n(CA) = n(HA) − 1 where n(CA), n(HA) denotes number of cold and hot aisles respectively. We perform numerical simulations for two (case1) and four (case 2) racks data center. The assumption of constant pressure below plenum reduces the problem domain to above plenum area only. In order to see which configuration provides higher heat transfer across servers, we measure heat transfer across servers on the basis of temperature differences across racks, and in order to validate them, we find mass flow rates on rack outlet. On the basis of results obtained, we conclude that for even numbered rows of rack data center, using more cold aisles than hot aisles provide higher heat transfer across servers. These results provide guidance on the design and layout of a data center.


Energies ◽  
2020 ◽  
Vol 13 (21) ◽  
pp. 5719
Author(s):  
JiHyun Hwang ◽  
Taewon Lee

The recent expansion of the internet network and rapid advancements in information and communication technology are expected to lead to a significant increase in power consumption and the number of data centers. However, these data centers consume a considerable amount of electric power all year round, regardless of working days or holidays; thus, energy saving at these facilities has become essential. A disproportionate level of power consumption is concentrated in computer rooms because air conditioners in these rooms are required to operate throughout the year to maintain a constant indoor environment for stable operation of computer equipment with high-heat release densities. Considerable energy-saving potential is expected in such computer rooms, which consume high levels of energy, if an outdoor air-cooling system and air conditioners are installed. These systems can reduce the indoor space temperature by introducing a relatively low outdoor air temperature. Therefore, we studied the energy-saving effect of introducing an outdoor air-cooling system in a computer room with a disorganized arrangement of servers and an inadequate air conditioning system in a research complex in Korea. The findings of this study confirmed that annual energy savings of up to approximately 40% can be achieved.


Author(s):  
Mayumi Ouchi ◽  
Yoshiyuki Abe ◽  
Masato Fukagaya ◽  
Takashi Kitagawa ◽  
Haruhiko Ohta ◽  
...  

Energy consumption in data centers has seen a drastic increase in recent years. In data centers, server racks are cooled down in an indirect way by air-conditioning systems installed to cool the entire server room. This air cooling method is inefficient as information technology (IT) equipment is insufficiently cooled down, whereas the room is overcooled. The development of countermeasures for heat generated by IT equipment is one of the urgent tasks to be accomplished. We, therefore, proposed new liquid cooling systems in which IT equipment is cooled down directly and exhaust heat is not radiated into the server room. Three cooling methods have been developed simultaneously. Two of them involve direct cooling; a cooling jacket is directly attached to the heat source (or CPU in this case) and a single-phase heat exchanger or a two-phase heat exchanger is used as the cooling jacket. The other method involves indirect cooling; heat generated by CPU is transported to the outside of the chassis through flat heat pipes and the condensation sections of the heat pipes are cooled down by coolant with liquid manifold. Verification tests have been conducted by using commercial server racks to which these cooling methods are applied while investigating five R&D components that constitute our liquid cooling systems: the single-phase heat exchanger, the two-phase heat exchanger, high performance flat heat pipes, nanofluid technology, and the plug-in connector. As a result, a 44–53% reduction in energy consumption of cooling facilities with the single-phase cooling system and a 42–50% reduction with the flat heat pipe cooling system were realized compared with conventional air cooling system.


2020 ◽  
Vol 142 (2) ◽  
Author(s):  
Oluwaseun Awe ◽  
Jimil M. Shah ◽  
Dereje Agonafer ◽  
Prabjit Singh ◽  
Naveen Kannan ◽  
...  

Abstract Airside economizers lower the operating cost of data centers by reducing or eliminating mechanical cooling. It, however, increases the risk of reliability degradation of information technology (IT) equipment due to contaminants. IT Equipment manufacturers have tested equipment performance and guarantee the reliability of their equipment in environments within ISA 71.04-2013 severity level G1 and the ASHRAE recommended temperature-relative humidity (RH) envelope. IT Equipment manufacturers require data center operators to meet all the specified conditions consistently before fulfilling warranty on equipment failure. To determine the reliability of electronic hardware in higher severity conditions, field data obtained from real data centers are required. In this study, a corrosion classification coupon experiment as per ISA 71.04-2013 was performed to determine the severity level of a research data center (RDC) located in an industrial area of hot and humid Dallas. The temperature-RH excursions were analyzed based on time series and weather data bin analysis using trend data for the duration of operation. After some period, a failure was recorded on two power distribution units (PDUs) located in the hot aisle. The damaged hardware and other hardware were evaluated, and cumulative corrosion damage study was carried out. The hypothetical estimation of the end of life of components is provided to determine free air-cooling hours for the site. There was no failure of even a single server operated with fresh air-cooling shows that using evaporative/free air cooling is not detrimental to IT equipment reliability. This study, however, must be repeated in other geographical locations to determine if the contamination effect is location dependent.


Energies ◽  
2019 ◽  
Vol 12 (15) ◽  
pp. 2996 ◽  
Author(s):  
Jinkyun Cho ◽  
Beungyong Park ◽  
Yongdae Jeong

If a data center experiences a system outage or fault conditions, it becomes difficult to provide a stable and continuous information technology (IT) service. Therefore, it is critical to design and implement a backup system so that stability can be maintained even in emergency (unforeseen) situations. In this study, an actual 20 MW data center project was analyzed to evaluate the thermal performance of an IT server room during a cooling system outage under six fault conditions. In addition, a method of organizing and systematically managing operational stability and energy efficiency verification was identified for data center construction in accordance with the commissioning process. Up to a chilled water supply temperature of 17 °C and a computer room air handling unit air supply temperature of 24 °C, the temperature of the air flowing into the IT server room fell into the allowable range specified by the American Society of Heating, Refrigerating, and Air-Conditioning Engineers standard (18–27 °C). It was possible to perform allowable operations for approximately 320 s after cooling system outage. Starting at a chilled water supply temperature of 18 °C and an air supply temperature of 25 °C, a rapid temperature increase occurred, which is a serious cause of IT equipment failure. Due to the use of cold aisle containment and designs with relatively high chilled water and air supply temperatures, there is a high possibility that a rapid temperature increase inside an IT server room will occur during a cooling system outage. Thus, the backup system must be activated within 300 s. It is essential to understand the operational characteristics of data centers and design optimal cooling systems to ensure the reliability of high-density data centers. In particular, it is necessary to consider these physical results and to perform an integrated review of the time required for emergency cooling equipment to operate as well as the backup system availability time.


Author(s):  
Dustin W. Demetriou ◽  
Vinod Kamath ◽  
Howard Mahaney

The generation-to-generation IT performance and density demands continue to drive innovation in data center cooling technologies. For many applications, the ability to efficiently deliver cooling via traditional chilled air cooling approaches has become inadequate. Water cooling has been used in data centers for more than 50 years to improve heat dissipation, boost performance and increase efficiency. While water cooling can undoubtedly have a higher initial capital cost, water cooling can be very cost effective when looking at the true lifecycle cost of a water cooled data center. This study aims at addressing how one should evaluate the true total cost of ownership for water cooled data centers by considering the combined capital and operational cost for both the IT systems and the data center facility. It compares several metrics, including return-on-investment for three cooling technologies: traditional air cooling, rack-level cooling using rear door heat exchangers and direct water cooling via cold plates. The results highlight several important variables, namely, IT power, data center location, site electric utility cost, and construction costs and how each of these influence the total cost of ownership of water cooling. The study further looks at implementing water cooling as part of a new data center construction project versus a retrofit or upgrade into an existing data center facility.


Author(s):  
Tianyi Gao ◽  
James Geer ◽  
Russell Tipton ◽  
Bruce Murray ◽  
Bahgat G. Sammakia ◽  
...  

The heat dissipated by high performance IT equipment such as servers and switches in data centers is increasing rapidly, which makes the thermal management even more challenging. IT equipment is typically designed to operate at a rack inlet air temperature ranging between 10 °C and 35 °C. The newest published environmental standards for operating IT equipment proposed by ASHARE specify a long term recommended dry bulb IT air inlet temperature range as 18°C to 27°C. In terms of the short term specification, the largest allowable inlet temperature range to operate at is between 5°C and 45°C. Failure in maintaining these specifications will lead to significantly detrimental impacts to the performance and reliability of these electronic devices. Thus, understanding the cooling system is of paramount importance for the design and operation of data centers. In this paper, a hybrid cooling system is numerically modeled and investigated. The numerical modeling is conducted using a commercial computational fluid dynamics (CFD) code. The hybrid cooling strategy is specified by mounting the in row cooling units between the server racks to assist the raised floor air cooling. The effect of several input variables, including rack heat load and heat density, rack air flow rate, in row cooling unit operating cooling fluid flow rate and temperature, in row coil effectiveness, centralized cooling unit supply air flow rate, non-uniformity in rack heat load, and raised floor height are studied parametrically. Their detailed effects on the rack inlet air temperatures and the in row cooler performance are presented. The modeling results and corresponding analyses are used to develop general installation and operation guidance for the in row cooler strategy of a data center.


Sign in / Sign up

Export Citation Format

Share Document