Creating a Calibrated CFD Model of a Midsize Data Center

Author(s):  
Zachary M. Pardey ◽  
James W. VanGilder ◽  
Christopher M. Healey ◽  
David W. Plamondon

Calibrating a CFD model against measured data is the first step to successfully utilizing this technology for change-management and the optimization of an existing data center. To date, there has been very little published on this calibration process; more focus has been placed on the use of CFD at the design stage and the development of modeling techniques and solvers. Further, few studies which feature comprehensive comparisons of CFD-predicted and measured data have been published for real data centers, and many that have, demonstrated only modest agreement at best. This study provides another such comparison — for a 7,400 ft2 (687 m2), 138-rack, raised-floor facility. The goals of the study are to benchmark the level of agreement that can be practically obtained and also to investigate the level of modeling detail required. Additionally, specific practical advice covering both CFD modeling and experimental measurements is provided. A plenum-only CFD model is compared to measured tile airflow rates and a room-model, which uses measured tile flow rates as boundary conditions, is compared to temperatures measured at each rack inlet. The level of agreement is among the best published to date and demonstrates that a CFD model can be adequately calibrated against measured data and is of value for ongoing data center operation.

2013 ◽  
Vol 135 (3) ◽  
Author(s):  
Waleed A. Abdelmaksoud ◽  
Thong Q. Dang ◽  
H. Ezzat Khalifa ◽  
Roger R. Schmidt

There is a need in the IT industry for CFD models that are capable of accurately predicting the thermal distributions in high power density open-aisle air-cooled data centers for use in the design of these facilities with reduced cooling needs. A recent detailed evaluation of a small data center cell equipped with one high power rack using current CFD practice showed that the CFD results were not accurate. The simulation results exhibited pronounced hot/cold spots in the data center while the test data were much more diffused, indicating that the CFD model under-predicted the mixing process between the cold tile flow and the hot rack exhaust flow with the warm room air. In this study, a parametric study was carried out to identify CFD modeling issues that contributed to this error. Through a combined experimental and computational investigation, it was found that the boundary condition imposed at the perforated surfaces (e.g., perforated tiles and rack exhaust door) as fully open surfaces was the main source of error. This method enforces the correct mass flux but the initial jet momentum is under-specified. A momentum source model proposed for these perforated surfaces is found to improve the CFD results significantly. Another CFD modeling refinement shown to improve CFD predictions is the inclusion of some large-scale geometrical features of the perforated surfaces (e.g., lands/gaps) in the CFD model, but this refinement requires the use of grids finer than those typically used in practice.


Author(s):  
Sami A. Alkharabsheh ◽  
Bharathkrishnan Muralidharan ◽  
Mahmoud Ibrahim ◽  
Saurabh K. Shrivastava ◽  
Bahgat G. Sammakia

This paper presents the results of an experimentally validated Computational Fluid Dynamics (CFD) model for a data center with fully implemented fan curves on both the servers and the Computer Room Air Conditioner (CRAC). Open and contained cold aisle systems are considered experimentally and numerically. This work is divided into open (uncontained) cold aisle system calibration and validation, and fully contained cold aisle system calibration and leakage characterization. In the open system, the CRAC unit is calibrated using the manufacturer fan curve. Tiles flow measurements are used to calibrate the floor leakage. The fan curves of the load banks are generated experimentally. A full physics based model of the system is validated with two different CRAC fan speeds. The results showed a very good agreement with the tile flow measurements, with an approximate average error of 5%, indicating that the average model prediction of the tile flow is five percent lower that the measured values. In the fully contained cold aisle system, a detailed containment CFD model based on experimental measurements is developed. The model is validated by comparing the flow rate through the perforated floor tiles with the experimental measurements. The CFD results are in a good agreement with the experimental data. The average error is about 6.7%. Temperature measurements are used to calibrate other sources of containment and racks leaks including mounting rails and clearance between racks. The temperature measurements and the CFD results agree well with average error less than 2%. Detailed and equivalent modeling methods for the floor and containment system are investigated. It is found that the simple equivalent models are able to predict the flow rates however they did not succeed in providing detailed fluid flow information. While the detailed models succeeded in explaining the physical phenomena and predicting the flow rates with noticeable tradeoffs regarding the computational time. Important conclusions can be drawn from this study. In order to accurately model the containment system, both the CRAC and the load banks fan curves should be simulated in the numerical model. Unavoidable racks and containment leaks could cause inlet temperature increase even if the cold aisle is overprovisioned with cold air. It is also noted that heat conduction through the floor tiles causes a slight increase the inlet temperature of the cold aisles. Finally, it is noteworthy that using detailed modeling is necessary to understand the details of the thermal systems, however simpler and faster to compute equivalent models can be used in extended optimization studies that show relative rankings of different designs.


2004 ◽  
Vol 126 (4) ◽  
pp. 510-518 ◽  
Author(s):  
Roger Schmidt ◽  
Ethan Cruz

This paper focuses on the effect on rack inlet air temperatures as a result of maldistribution of airflows exiting the perforated tiles located adjacent to the fronts of the racks. The flow distribution exiting the perforated tiles was generated from a computational fluid dynamics (CFD) tool called Tileflow (trademark of Innovative Research, Inc.). Both raised floor heights and perforated tile-free areas were varied in order to explore the effect on rack inlet temperatures. The flow distribution exiting the perforated tiles was used as boundary conditions to the above-floor CFD model. A CFD model was generated for the room with electronic equipment installed on a raised floor. Forty racks of data processing (DP) equipment were arranged in rows in a data center cooled by chilled air exhausting from perforated floor tiles. The chilled air was provided by four A/C units placed inside a room 12.1 m wide×13.4 m long. Because the arrangement of the racks in the data center was symmetric, only half of the data center was modeled. The numerical modeling for the area above the raised floor was performed using a commercially available finite control volume computer code called Flotherm (trademark of Flomerics, Inc.). The flow was modeled using the k-e turbulence model. Results are displayed to provide some guidance on the design and layout of a data center.


Author(s):  
Roger Schmidt ◽  
Ethan Cruz

This paper focuses on the effect on inlet rack air temperatures as a result of maldistribution of airflows exiting the perforated tiles located adjacent to the fronts of the racks. The flow distribution exiting the perforated tiles was generated from a computational fluid dynamics (CFD) tool called Tileflow (Trademark of Innovative Research, Inc.). Both raised floor heights and perforated tile free area were varied in order to explore the effect on rack inlet temperatures. The flow distribution exiting the perforated tiles was used as boundary conditions to the above floor CFD model. A CFD model was generated for the room with electronic equipment installed on a raised floor. Fourty racks of data processing (DP) equipment were arranged in rows in a data center cooled by chilled air exhausting from perforated floor tiles. The chilled air was provided by four A/C units placed inside a room 12.1 m wide × 13.4 m long. Since the arrangement of the racks in the data center was symmetric only one-half of the data center was modeled. The numerical modeling for above the raised floor was performed using a commercially available finite control volume computer code called Flotherm (Trademark of Flomerics, Inc.). The flow was modeled using the k-e turbulence model. Results are displayed to provide some guidance on the design and layout of a data center.


Author(s):  
Betsegaw Gebrehiwot ◽  
Nikhil Dhiman ◽  
Kasturi Rajagopalan ◽  
Dereje Agonafer ◽  
Naveen Kannan ◽  
...  

An information technology (IT) container needs to be supplied with cold air to cool IT equipment housed in it. The type of cooling system to be used depends on many factors including geographical location of the modular data center. Data centers located in regions where the climate is cold benefit from use of air-side economization (ASE) and those located in hot and dry climate benefit from use of direct and/or indirect evaporative cooling (DIEC) systems. In terms of energy saving, ASE, direct evaporative cooling (DEC) system, and indirect evaporative (IEC) systems are better than compressor based cooling systems such as computer room air conditioning (CRAC) units and air handling units (AHU). In this study, an existing DIEC unit which can also be operated in ASE mode is modeled in a computational fluid dynamics (CFD) tool. The cooling unit is intended to be used for supplying cold air to a containerized data center with specified volume flow rate, dry-bulb temperature and relative humidity. The CFD model is compared with published data of the cooling unit to see how well the CFD model represents the actual system and few design improvement ideas are tested by modifying the CFD model and running simulations. Results show that supplying air horizontally or as a downdraft to an IT container has negligible effect on the overall system. Results also show that orientation of dampers and placement of blanking panels inside the mixing chamber could affect the lifespan of air filters.


Author(s):  
Vaibhav K. Arghode ◽  
Pramod Kumar ◽  
Yogendra Joshi ◽  
Thomas S. Weiss ◽  
Gary Meyer

Effective air flow distribution through perforated tiles is required to efficiently cool servers in a raised floor data center. We present detailed computational fluid dynamics (CFD) modeling of air flow through a perforated tile and its entrance to the adjacent server rack. The realistic geometrical details of the perforated tile, as well as of the rack are included in the model. Generally models for air flow through perforated tiles specify a step pressure loss across the tile surface, or porous jump model based on the tile porosity. An improvement to this includes a momentum source specification above the tile to simulate the acceleration of the air flow through the pores, or body force model. In both of these models geometrical details of tile such as pore locations and shapes are not included. More details increase the grid size as well as the computational time. However, the grid refinement can be controlled to achieve balance between the accuracy and computational time. We compared the results from CFD using geometrical resolution with the porous jump and body force model solution as well as with the measured flow field using Particle Image Velocimetry (PIV) experiments. We observe that including tile geometrical details gives better results as compared to elimination of tile geometrical details and specifying physical models across and above the tile surface. A modification to the body force model is also suggested and improved results were achieved.


2018 ◽  
Vol 140 (1) ◽  
Author(s):  
Jayati Athavale ◽  
Yogendra Joshi ◽  
Minami Yoda

Abstract This paper presents an experimentally validated room-level computational fluid dynamics (CFD) model for raised-floor data center configurations employing active tiles. Active tiles are perforated floor tiles with integrated fans, which increase the local volume flow rate by redistributing the cold air supplied by the computer room air conditioning (CRAC) unit to the under-floor plenum. The numerical model of the data center room consists of one cold aisle with 12 racks arranged on both sides and three CRAC units sited around the periphery of the room. The commercial CFD software package futurefacilities6sigmadcx is used to develop the model for three configurations: (a) an aisle populated with ten (i.e., all) passive tiles; (b) a single active tile and nine passive tiles in the cold aisle; and (c) an aisle populated with all active tiles. The predictions from the CFD model are found to be in good agreement with the experimental data, with an average discrepancy between the measured and computed values for total flow rate and rack inlet temperature less than 4% and 1.7 °C, respectively. The validated models were then used to simulate steady-state and transient scenarios following cooling failure. This physics-based and experimentally validated room-level model can be used for temperature and flow distributions prediction and identifying optimal number and locations of active tiles for hot spot mitigation in data centers.


2020 ◽  
Vol 8 (3) ◽  
pp. 211 ◽  
Author(s):  
Stephan Helma

Undoubtedly, the Wageningen B-screw Series is the most widely used systematic propeller series. It is very popular to preselect propeller dimensions during the preliminary design stage before performing a more thorough optimisation, but in the smaller end of the market it is often used to merely select the final propeller. Over time, the originally measured data sets were faired and scaled to a uniform Reynolds number of 2 · 106 to increase the reliability of the series. With the advent of the computer, polynomials for the thrust and torque values were calculated based on the available data sets. The measured data are typically presented in the well-known open-water curves of thrust and torque coefficients K T and K Q versus the advance coefficient J . Changing the presentation from these diagrams to efficiency maps reveals some unsuspected and surprising behaviours, such as multiple extrema when optimising for efficiency or even no optimum at all for certain conditions, where an optimum could be expected. These artefacts get more pronounced at higher pitch to diameter ratios and low blade numbers. The present work builds upon the paper presented by the author at the AMT’17 and smp’19 conferences and now includes the extended efficiency maps, as suggested by Danckwardt, for all propellers of the Wageningen B-screw Series.


Author(s):  
Roger Schmidt ◽  
Ethan Cruz

This paper focuses on the effect on inlet rack air temperatures when adjacent racks are removed. Only the above floor (raised floor) flow and temperature distributions were analyzed for various air flowrates exhausting from the perforated tiles and the rack. A Computational Fluid Dynamic (CFD) model was generated for the room with electronic equipment installed on a raised floor with particular focus on the effects on rack inlet temperatures of these high powered racks. The baseline case was with forty racks of data processing (DP) equipment arranged in rows in a data center cooled by chilled air exhausting from perforated floor tiles. The chilled air was provided by four A/C units placed inside a room 12.1 m wide × 13.4 m long. Since the arrangement of the racks in the data center was symmetric only one-half of the data center was modeled. To see the effect of missing racks adjacent to high powered racks various configurations were analyzed. The numerical modeling was performed using a commercially available finite control volume computer code called Flotherm (Trademark of Flomerics, Inc.). The flow was modeled using the k-e turbulence model. Results are displayed to provide some guidance on the design and layout of a data center.


Author(s):  
Husam A. Alissa ◽  
Kourosh Nemati ◽  
Bahgat Sammakia ◽  
Alfonso Ortega ◽  
David King ◽  
...  

The perpetual increase of data processing has led to an ever increasing need for power and in turn to greater cooling challenges. High density (HD) IT loads have necessitated more aggressive and direct approaches of cooling as opposed to the legacy approach by the utilization of row-based cooling. In-row cooler systems are placed between the racks aligned with row orientation; they offer cool air to the IT equipment more directly and effectively. Following a horizontal airflow pattern and typically occupying 50% of a rack’s width; in-row cooling can be the main source of cooling in the data center or can work jointly with perimeter cooling. Another important development is the use of containment systems since they reduce mixing of hot and cold air in the facility. Both in-row technology and containment can be combined to form a very effective cooling solution for HD data centers. This current study numerically investigates the behavior of in-row coolers in cold aisle containment (CAC) vs. perimeter cooling scheme. Also, we address the steady state performance for both systems, this includes manufacturer’s specifications such as heat exchanger performance and cooling coil capacity. A brief failure scenario is then run, and duration of ride through time in the case of row-based cooling system failure is compared to raised floor perimeter cooling with containment. Non-raised floor cooling schemes will reduce the air volumetric storage of the whole facility (in this small data center cell it is about a 20% reduction). Also, the varying thermal inertia between the typical in-row and perimeter cooling units is of decisive importance. The CFD model is validated using a new data center laboratory at Binghamton University with perimeter cooling. This data center consists of one main Liebert cooling unit, 46 perforated tiles with 22% open area, 40 racks distributed on three main cold aisles C and D. A computational slice is taken of the data center to generalize results. Cold aisle C consists of 16 rack and 18 perforated tiles with containment installed. In-row coolers are then added to the CFD model. Fixed IT load is maintained throughout the simulation and steady state comparisons are built between the legacy and row-based cooling schemes. An empirically obtained flow curve method is used to capture the flow-pressure correlation for flow devices. Performance scenarios were parametrically analyzed for the following cases: (a) Perimeter cooling in CAC, (b) In-row cooling in CAC. Results showed that in-row coolers increased the efficiency of supply air flow utilization since the floor leakage was eliminated, and higher pressure build up in CAC were observed. This reduced the rack recirculation when compared to the perimeter cooled case. However, the heat exchanger size demonstrated the limitation of the in-row to maintain controlled set point at increased air flow conditions. For the pump failure scenario, experimental data provided by Emerson labs were used to capture the thermal inertia effect of the cooling coils for in-row and perimeter unit, perimeter cooled system proved to have longer ride through time.


Sign in / Sign up

Export Citation Format

Share Document