Optimal Design and Modeling of Server Cabinets With In-Row Coolers and Air Conditioning Units in a Modular Data Center

Author(s):  
Uschas Chowdhury ◽  
Walter Hendrix ◽  
Thomas Craft ◽  
Willis James ◽  
Ankit Sutaria ◽  
...  

Abstract In a data center, electronic equipment such as server and switches dissipate heat and the corresponding cooling systems contribute to typically 25–35% of total energy consumption. The heat load continues to increase as there is a greater need for miniaturization and convergence. In 2014, data centers in the U.S. consumed an estimated 70 billion kWh, representing about 1.8% of total U.S. electricity consumption. Based on current trend estimates, U.S. data centers are projected to consume approximately 73 billion kWh in 2020 [1]. Many research and strategies are adopted to minimize energy cost. The recommended dry bulb temperature for long-term operation and reliability for air cooling is between 18–27°C and the largest allowable inlet temperature range to operate at is between 5°C and 45°C with American Society of Heating, Refrigeration, and Air-Conditioning Engineers (ASHRAE) enabling much broader allowable zones) [2]. But understanding a proper cooling system is very important especially for thermal management of IT equipment with high heat loads such as 1U or 2U multi-core, high-end servers and blade servers which provide more computing per watt. Many problems like high inlet temperature due to the mixing of hot air with cold air, local hot spots, lower system reliability, increased failure, and downtime may occur. Among many other approaches to managing high-density racks, in-row coolers are used in between racks to provide cold air and minimize local hot spots. This paper describes a computational study being performed by applying in-row coolers for different rack power configuration with and without aisle containment. The power, as well as the number of racks, are varied to study the effect of raised inlet temperature for the IT equipment in a Computational Fluid Dynamics (CFD) model developed in 6SigmaRoom with the help of built-in library items. A comparative analysis is also performed for a typical small-sized non-raised facility to investigate the efficacy and limitations of in-row coolers in thermal management of IT equipment with variation in rack heat load and containment. Several other aspects like a parametric study of variable opening areas of duct between racks and in-row coolers, the variation of operating flow rate and failure scenarios are also studied to find proper flow distribution, uniformity of outlet temperature and predict better performance, energy savings and reliability. The results are presented for general guidance for flexible and quick installation and safe operation of in-row coolers to improve thermal efficiency.

Author(s):  
Veerendra Mulay ◽  
Saket Karajgikar ◽  
Dereje Agonafer ◽  
Roger Schmidt ◽  
Madhusudan Iyengar

The power trend for Server systems continues to grow thereby making thermal management of Data centers a very challenging task. Although various configurations exist, the raised floor plenum with Computer Room Air Conditioners (CRACs) providing cold air is a popular operating strategy. The air cooling of data center however, may not address the situation where more energy is expended in cooling infrastructure than the thermal load of data center. Revised power trend projections by ASHRAE TC 9.9 predict heat load as high as 5000W per square feet of compute servers’ equipment footprint by year 2010. These trend charts also indicate that heat load per product footprint has doubled for storage servers during 2000–2004. For the same period, heat load per product footprint for compute servers has tripled. Amongst the systems that are currently available and being shipped, many racks exceed 20kW. Such high heat loads have raised concerns over limits of air cooling of data centers similar to air cooling of microprocessors. A hybrid cooling strategy that incorporates liquid cooling along with air cooling can be very efficient in these situations. A parametric study of such solution is presented in this paper. A representative data center with 40 racks is modeled using commercially available CFD code. The variation in rack inlet temperature due to tile openings, underfloor plenum depths is reported.


Author(s):  
Veerendra Mulay ◽  
Dereje Agonafer ◽  
Roger Schmidt

The power trend for Server systems continues to grow thereby making thermal management of Data centers a very challenging task. Although various configurations exist, the raised floor plenum with Computer Room Air Conditioners (CRACs) providing cold air is a popular operating strategy. The air cooling of data center however, may not address the situation where more energy is expended in cooling infrastructure than the thermal load of data center. Revised power trend projections by ASHRAE TC 9.9 predict heat load as high as 5000W per square feet of compute servers’ equipment footprint by year 2010. These trend charts also indicate that heat load per product footprint has doubled for storage servers during 2000–2004. For the same period, heat load per product footprint for compute servers has tripled. Amongst the systems that are currently available and being shipped, many racks exceed 20kW. Such high heat loads have raised concerns over limits of air cooling of data centers similar to air cooling of microprocessors. Thermal management of such dense data center clusters using liquid cooling is presented.


Author(s):  
Veerendra Mulay ◽  
Saket Karajgikar ◽  
Dereje Agonafer ◽  
Roger Schmidt ◽  
Madshusudan Iyengar ◽  
...  

The power trend for server systems continues to grow thereby making thermal management of data centers a very challenging task. Although various configurations exist, the raised floor plenum with Computer Room Air Conditioners (CRACs) providing cold air is a popular operating strategy. In prior work, numerous data center layouts employing raised floor plenum and the impact of design parameters such as plenum depth, ceiling height, cold isle location, tile openings and others on thermal performance of data center were presented. The air cooling of data center however, may not address the situation where more energy is expended in cooling infrastructure than the thermal load of data center. Revised power trend projections by ASHRAE TC 9.9 predict heat loads as high as 5000W per square feet of compute servers’ equipment footprint by year 2010. These trend charts also indicate that heat load per product footprint has doubled for storage servers during 2000–2004. For the same period, heat load per product footprint for compute servers has tripled. Amongst the systems that are currently available and being shipped, many racks exceed 20kW. Such high heat loads have raised concerns over air cooling limits of data centers similar to that of microprocessors. A hybrid cooling strategy that incorporates liquid cooling along with air cooling can be very efficient in such situations. The impact of such an operating strategy on thermal management of data center is discussed in this paper. A representative data center is modeled using commercially available CFD code. The change in rack temperature gradients, recirculation cells and CRAC demand due to use of hybrid cooling is presented in a detailed parametric study. It is shown that the hybrid cooling strategy improves the cooling of data center which may enable full population of rack and better management of system infrastructure.


Author(s):  
Amip J. Shah ◽  
Van P. Carey ◽  
Cullen E. Bash ◽  
Chandrakant D. Patel

As heat dissipation in data centers rises by orders of magnitude, inefficiencies such as recirculation will have an increasingly significant impact on the thermal manageability and energy efficiency of the cooling infrastructure. For example, prior work has shown that for simple data centers with a single Computer Room Air-Conditioning (CRAC) unit, an operating strategy that fails to account for inefficiencies in the air space can result in suboptimal performance. To enable system-wide optimality, an exergy-based approach to CRAC control has previously been proposed. However, application of such a strategy in a real data center environment is limited by the assumptions inherent to the single-CRAC derivation. This paper addresses these assumptions by modifying the exergy-based approach to account for the additional interactions encountered in a multi-component environment. It is shown that the modified formulation provides the framework necessary to evaluate performance of multi-component data center thermal management systems under widely different operating circumstances.


Author(s):  
Tianyi Gao ◽  
James Geer ◽  
Russell Tipton ◽  
Bruce Murray ◽  
Bahgat G. Sammakia ◽  
...  

The heat dissipated by high performance IT equipment such as servers and switches in data centers is increasing rapidly, which makes the thermal management even more challenging. IT equipment is typically designed to operate at a rack inlet air temperature ranging between 10 °C and 35 °C. The newest published environmental standards for operating IT equipment proposed by ASHARE specify a long term recommended dry bulb IT air inlet temperature range as 18°C to 27°C. In terms of the short term specification, the largest allowable inlet temperature range to operate at is between 5°C and 45°C. Failure in maintaining these specifications will lead to significantly detrimental impacts to the performance and reliability of these electronic devices. Thus, understanding the cooling system is of paramount importance for the design and operation of data centers. In this paper, a hybrid cooling system is numerically modeled and investigated. The numerical modeling is conducted using a commercial computational fluid dynamics (CFD) code. The hybrid cooling strategy is specified by mounting the in row cooling units between the server racks to assist the raised floor air cooling. The effect of several input variables, including rack heat load and heat density, rack air flow rate, in row cooling unit operating cooling fluid flow rate and temperature, in row coil effectiveness, centralized cooling unit supply air flow rate, non-uniformity in rack heat load, and raised floor height are studied parametrically. Their detailed effects on the rack inlet air temperatures and the in row cooler performance are presented. The modeling results and corresponding analyses are used to develop general installation and operation guidance for the in row cooler strategy of a data center.


Author(s):  
Veerendra Mulay ◽  
Dereje Agonafer ◽  
Gary Irwin ◽  
Darshan Patell

Rising heat load trends in data center facilities have raised concerns over energy usage. The environmental protection agency has reported that the energy used in 2006 by data center industry was 1.5% of the total energy usage by entire nation. The experts agree that by year 2010, this usage will approach 2% of the annual energy use nationwide. Although many new concepts such as airside economizers and cogeneration are gaining traction, many data center facilities spend considerable energy in cooling. In this study, various cabinet designs are discussed. Isolating the supplied cold air from hot exhaust air is always a challenge in thermal management of data center facilities. A cabinet design that employs chimney to aid the isolation of hot and cold air is discussed. A computational model of representative data center is created to study the effectiveness of design under various supply air fractions.


2014 ◽  
Vol 2014 ◽  
pp. 1-9 ◽  
Author(s):  
Muhammad Tayyab Chaudhry ◽  
T. C. Ling ◽  
S. A. Hussain ◽  
Atif Manzoor

A rise in inlet air temperature may lower the rate of heat dissipation from air cooled computing servers. This introduces a thermal stress to these servers. As a result, the poorly cooled active servers will start conducting heat to the neighboring servers and giving rise to hotspot regions of thermal stress, inside the data center. As a result, the physical hardware of these servers may fail, thus causing performance loss, monetary loss, and higher energy consumption for cooling mechanism. In order to minimize these situations, this paper performs the profiling of inlet temperature sensitivity (ITS) and defines the optimum location for each server to minimize the chances of creating a thermal hotspot and thermal stress. Based upon novel ITS analysis, a thermal state monitoring and server relocation algorithm for data centers is being proposed. The contribution of this paper is bringing the peak outlet temperatures of the relocated servers closer to average outlet temperature by over 5 times, lowering the average peak outlet temperature by 3.5% and minimizing the thermal stress.


Author(s):  
Amip J. Shah ◽  
Van P. Carey ◽  
Cullen E. Bash ◽  
Chandrakant D. Patel

Recent work has proposed an exergy-based strategy to achieve optimal system-wide performance via localized control of individual data center thermal management components. This paper presents the results of a case study where the proposed approach is applied to a data center with two rows of computing racks and two Computer Room Air-Conditioning (CRAC) units. The formulated model is used to predict the optimal data center configuration in terms of supply temperatures, flowrates, and rack heat load configurations. Two extreme cases are chosen: one with the maximum experimental heat load in the data center, and one with a minimal experimental heat load. For each case, the optimal settings for each CRAC unit were predicted using the model and using temperature + flow measurements in the data center. The setpoints predicted by the model for optimal CRAC flow and supply temperature were within 25% of the experimentally determined optima.


Author(s):  
Amip J. Shah ◽  
Van P. Carey ◽  
Cullen E. Bash ◽  
Chandrakant D. Patel

Recent compaction and miniaturization of electronic equipment has caused a dramatic increase in the amount of heat dissipated within data centers housing compute, network, and storage systems. The efficient thermal management of these systems is complicated by the intricate interdependence among the various components of the thermal architecture, including the heat-dissipating computer racks, the Computer Room Air-Conditioning (CRAC) units, and the physical airspace within the room. To account for this interdependence, an approach based on the thermodynamic metric of exergy has been proposed, which allows for prediction of an optimal CRAC operating point that corresponds to the point of minimal irreversibility for the overall system. To validate the formulated theory, predictions from the model have been compared with actual data center power consumption measurements. Initial comparisons indicate good agreement, suggesting that the proposed theory has great applicability for efficient data center thermal management.


2021 ◽  
Author(s):  
Zhihang Song ◽  
Wan Chen

Abstract Commonly encountered thermal management challenges of today’s rapidly changing power density, raised-floor hot/cold aisle data centers include typically uncontrollable tile flow non-uniformity along the above-floor cold aisle. For example, the operational cooling provision intensity near the Computer Room Airflow Conditioner (CRAC) unit can be far less than that on the other side (far away from the CRAC unit). This undesired trend leads to an unbalanced aisle-level air cooling and subsequent inefficient power consumption. In this study, the CRAC turbofan blower flow boundary conditions were thoroughly investigated. Computational Fluid Dynamics (CFD) based simulations were employed to describe and evaluate the differently configured CRAC turbofan blower flow conditions (i.e., normal, angled, and sheared CRAC flow patterns) as well as their impacts upon the air cooling performance. This work indicates that the considered turbofan blower boundary condition, together with their underlying transportation mechanism within the plenum, might contribute an essential influence to the flow structure adjacent to the tile perforations. In particular, it was found that the sheared CRAC turbofan blower airflow pattern is capable of giving rise to favorable tile flow straightening manners. This finding further promotes an improvement of the consequently obtained aisle-level air cooling effectiveness and efficiencies, contributing to more advanced data center thermal management in the future.


Sign in / Sign up

Export Citation Format

Share Document