Computational Analysis for Thermal Optimization of Server for Single Phase Immersion Cooling

2019 ◽  
Author(s):  
Dhruvkumar Gandhi ◽  
Uschas Chowdhury ◽  
Tushar Chauhan ◽  
Pratik Bansode ◽  
Satyam Saini ◽  
...  
Keyword(s):  
Thermal Performance ◽  
Single Phase ◽  
Data Centers ◽  
Dielectric Fluid ◽  
Air Cooling ◽  
Processing Unit ◽  
Input Output ◽  
Dielectric Fluids ◽  
Immersion Cooling ◽  
Oil Immersion

Abstract Complete immersion of servers in synthetic dielectric fluids is rapidly becoming a popular technique to minimize the energy consumed by data centers for cooling purposes. In general, immersion cooling offers noteworthy advantages over conventional air-cooling methods as synthetic dielectric fluids have high heat dissipation capacities which are roughly about 1200 times greater than air. Other advantages of dielectric fluid immersion cooling include even thermal profile on chips, reduction in noise and addressing reliability and operational enhancements like whisker formation and electrochemical migration. Nevertheless, lack of data published and availability of long-term reliability data on immersion cooling is insufficient which makes most of data centers operators reluctant to implement this technique. The first part of this paper will compare thermal performance of single-phase oil immersion cooled HP ProLiant DL160 G6 server against air cooled server using computational fluid dynamics on 6SigmaET®. Focus of the study are major components of the server like Central Processing Unit (CPU), Dual in Line Memory Module (DIMM), Input/output Hub (IOH) chip and Input/output controller Hub (ICH). The second part of this paper focuses on thermal performance optimization of oil immersion cooled servers by varying inlet oil temperature, flow rate and using different fluid.

CFD Analysis of Thermal Shadowing and Optimization of Heatsinks in 3rd Generation Open Compute Server for Single-Phase Immersion Cooling

2019 ◽  
Author(s):  
Jimil M. Shah ◽  
Ravya Dandamudi ◽  
Chinmay Bhatt ◽  
Pranavi Rachamreddy ◽  
Pratik Bansode ◽  
...  
Keyword(s):  
Thermal Management ◽  
Power Density ◽  
Heat Sink ◽  
Single Phase ◽  
Data Centers ◽  
Air Cooling ◽  
Third Generation ◽  
Dielectric Fluids ◽  
Immersion Cooling ◽  
The Impact

Abstract In today’s networking world, utilization of servers and data centers has been increasing significantly. Increasing demand of processing and storage of data causes a corresponding increase in power density of servers. The data center energy efficiency largely depends on thermal management of servers. Currently, air cooling is the most widely used thermal management technology in data centers. However, air cooling has started to reach its limits due to high-powered processors. To overcome these limitations of air cooling in data centers, liquid immersion cooling methods using different dielectric fluids can be a viable option. Thermal shadowing is an effect in which temperature of a cooling medium increases by carrying heat from one source and results in decreasing its heat carrying capacity due to reduction in the temperature difference between the maximum junction temperature of successive heat sink and incoming fluid. Thermal Shadowing is a challenge for both air and low velocity oil flow cooling. In this study, the impact of thermal shadowing in a third-generation open compute server using different dielectric fluids is compared. The heat sink is a critical part for cooling effectiveness at server level. This work also provides an efficient range of heat sinks with computational modelling of third generation open compute server. Optimization of heat sink can allow to cool high-power density servers effectively for single-phase immersion cooling applications. A parametric study is conducted, and significant savings in the volume of a heat sink have been reported.

Computational Form Factor Study of a 3rd Generation Open Compute Server for Single-Phase Immersion Cooling

2019 ◽  
Author(s):  
Jimil M. Shah ◽  
Chinmay Bhatt ◽  
Pranavi Rachamreddy ◽  
Ravya Dandamudi ◽  
Satyam Saini ◽  
...  
Keyword(s):  
Form Factor ◽  
Thermal Management ◽  
Single Phase ◽  
Data Centers ◽  
Computational Study ◽  
Research Work ◽  
Modern World ◽  
Management Technique ◽  
Air Cooling ◽  
Immersion Cooling

Abstract Networking and computing dependency has been increasing in the modern world, thus, boosting the growth of data centers in leading business domains like banking, education, transportation, social media etc. Data center is a facility that incorporates an organization’s IT operations and equipment, as well as where it stores, processes and manages the data. To fulfill the increasing demands of data storage and data processing, a corresponding increase in server performance is needed. This causes a subsequent increment in power consumption and heat generation in the servers due to high performance processing units. Currently, air cooling is the most widely used thermal management technique in data centers, but it has started to reach its limitations in cooling high packaging densities. Therefore, industries are looking for single-phase immersion cooling using various dielectric fluids to reduce the operational and cooling costs by enhancing the thermal management of servers. This research work aims at increasing the rack density by reducing the form factor of a 3rd Generation Open Compute Server using single-phase immersion cooling. A computational study is conducted in the operational range of temperatures and the thermal efficiency is optimized. A parametric study is conducted by changing the inlet velocities and inlet temperatures of cooling liquid for different heights of the open compute 3rd generation server. A comparative study is then carried out for white mineral oil and synthetic fluid (EC100).

Evaluating the Reliability of Passive Server Components for Single-Phase Immersion Cooling

2021 ◽  
Author(s):  
Jimil M. Shah ◽  
Keerthivasan Padmanaban ◽  
Hrishabh Singh ◽  
Surya Duraisamy Asokan ◽  
Satyam Saini ◽  
...  
Keyword(s):  
Thermal Cycling ◽  
Single Phase ◽  
Printed Circuit Board ◽  
Structural Integrity ◽  
Circuit Board ◽  
Dielectric Fluid ◽  
Air Cooling ◽  
Passive Components ◽  
Material Compatibility ◽  
Immersion Cooling

Abstract The adoption of Single-phase Liquid Immersion Cooling (Sp-LIC) for Information Technology equipment provides an excellent cooling platform coupled with significant energy savings. There are, however, very limited studies related to the reliability of such cooling technology. The Accelerated Thermal Cycling (ATC) test given ATC JEDEC is relevant just for air cooling but there is no such standard for immersion cooling. The ASTM benchmark D3455 with some appropriate adjustments was adopted to test the material compatibility because of the air and dielectric fluid differences in the heat capacitance property and corresponding ramp rate during thermal cycling. For this study, accelerated thermal degradation of the printed circuit board (PCB), passive components, and fiber optic cables submerged in air, white mineral oil, and synthetic fluid at a hoisted temperature of 45C and 35% humidity is undertaken. This paper serves multiple purposes including designing experiments, testing and evaluating material compatibility of PCB, passive components, and optical fibers in different hydrocarbon oils for single-phase immersion cooling. Samples of different materials were immersed in different hydrocarbon oils and air and kept in an environmental chamber at 45C for a total of 288 hours. Samples were then evaluated for their mechanical and electrical properties using Dynamic Mechanical Analyzer (DMA) and a multimeter, respectively. The cross-sections of some samples were also investigated for their structural integrity using SEM. The literature gathered on the subject and quantifiable data gathered by the authors provide the primary basis for this research document.

Measurement of the Thermal Performance of a Custom-Build Single-Phase Immersion Cooled Server at Various High and Low Temperatures for Prolonged Time

2019 ◽  
Vol 142 (1) ◽  
Author(s):  
Pratik V. Bansode ◽  
Jimil M. Shah ◽  
Gautam Gupta ◽  
Dereje Agonafer ◽  
Harsh Patel ◽  
...  
Keyword(s):  
Relative Humidity ◽  
Single Phase ◽  
Data Centers ◽  
Operating Cost ◽  
Climatic Conditions ◽  
Junction Temperature ◽  
Dielectric Fluid ◽  
Air Cooling ◽  
Liquid Cooling ◽  
Environmental Chamber

Abstract The next radical change in the thermal management of data centers is to shift from conventional cooling methods like air-cooling to direct liquid cooling to enable high thermal mass and corresponding superior cooling. There has been in the past few years a limited adoption of direct liquid cooling in data centers because of its simplicity and high heat dissipation capacity. Single-phase engineered fluid immersion cooling has several other benefits like better server performance, even temperature profile, and higher rack densities and the ability to cool all components in a server without the need for electrical isolation. The reliability aspect of such cooling technology has not been well addressed in the open literature. This paper presents the performance of a fully single-phase dielectric fluid immersed server over wide temperature ranges in an environmental chamber. The server was placed in an environmental chamber and applied extreme temperatures ranging from −20 °C to 10 °C at 100% relative humidity and from 20 to 55 °C at constant 50% relative humidity for extended durations. This work is a first attempt of measuring the performance of a server and other components like pump including flow rate drop, starting trouble, and other potential issues under extreme climatic conditions for a completely liquid-submerged system. Pumping power consumption is directly proportional to the operating cost of a data center. The experiment was carried out until the core temperature reached the maximum junction temperature. This experiment helps to determine the threshold capacity and the robustness of the server for its applications in extreme climatic conditions.

Experimental Analysis for Optimization of Thermal Performance of a Server in Single Phase Immersion Cooling

2019 ◽  
Author(s):  
Pravin A. Shinde ◽  
Pratik V. Bansode ◽  
Satyam Saini ◽  
Rajesh Kasukurthy ◽  
Tushar Chauhan ◽  
...  
Keyword(s):  
Power Consumption ◽  
Thermal Performance ◽  
Heat Dissipation ◽  
Operating Cost ◽  
Heat Removal ◽  
Dielectric Fluid ◽  
Inlet Temperature ◽  
Processing Unit ◽  
Central Processing ◽  
Immersion Cooling

Abstract Liquid immersion cooling of servers in synthetic dielectric fluids is an emerging technology which offers significant cooling energy savings and increased power densities for data centers. A noteworthy advantage of using immersion cooling is high heat dissipation capacity which is roughly 1200 times greater than air. Other advantages of dielectric fluid immersion cooling include high rack density, better server performance, even temperature profile, reduction in noise etc. The enhanced thermal properties of oil lead to the considerable savings in both upfront and operating cost over traditional methods. In this study, a server is completely submerged in a synthetic dielectric fluid. Experiments are conducted to observe the effects of varying the volumetric flow rate and oil inlet temperature on thermal performance and power consumption of the server. Various parameters like total server power consumption, the temperature of all heat generating components like Central Processing Unit (CPU), Dual in Line Memory Module (DIMM), input/output hub (IOH) chip, Platform Controller Hub (PCH), Network Interface Controller (NIC) are measured at steady state. Since this is an air-cooled server, the results obtained from the experiments will help in proposing better heat removal strategies like heat sink optimization, better ducting and server architecture. Assessment has been made on the effect of thermal shadowing caused by the two CPUs on the nearby components like DIMMs and PCH.

Measurement of the Thermal Performance of a Single-Phase Immersion Cooled Server at Elevated Temperatures for Prolonged Time

2018 ◽  
Author(s):  
Pratik V. Bansode ◽  
Jimil M. Shah ◽  
Gautam Gupta ◽  
Dereje Agonafer ◽  
Harsh Patel ◽  
...  
Keyword(s):  
Thermal Performance ◽  
Single Phase ◽  
Elevated Temperatures ◽  
Operating Cost ◽  
Failure Criteria ◽  
Climatic Conditions ◽  
Temperature Cycling ◽  
Dielectric Fluid ◽  
Air Cooling ◽  
Power Draw

Fully immersion of servers in electrically nonconductive (dielectric) fluid has recently become a promising technique for minimizing cooling energy consumption in data centers. The improved thermal properties of these dielectric fluids facilitate considerable savings in both upfront and operating cost over traditional air-cooling. This technology provides an opportunity for accommodating increased power densities. It also minimizes the common operational issues of air cooling technique like overheating and temperature swing in the system, fan failures, dust, air quality, and corrosion. This paper presents various data about the thermal performance of a fully single-phase dielectric fluid immersed server over wide temperature ranges (environment temperatures) from 25°C to 55°C for prolonged periods in an environmental chamber. This work explores the effects of high temperatures on the performance of a server and other components like pump, along with potential issues associated with extreme climatic conditions. The experimental data serves as a means to determine failure criteria for the server and pump by subjecting the system to accelerated thermal aging conditions i.e. around 55°C, consequently simulating the most extreme environmental condition that the server may encounter. Connector seals are inspected for expected degradation upon temperature cycling typically at such extreme conditions. Throttling limit for the server and pump power draw for different temperatures was determined to assess pump performance. Determining the relations between component behavior and operating temperature provides an accurate measure of lifetime of a server. The scope of this paper can be expanded by reviewing the effects of low temperatures on server and component performance. Changes to various performance parameters like power draw of pump and server at the higher and the lower operating temperatures and an understanding of issues like condensation can be used to quantify upper and lower limits for pump and server performance.

scholarly journals Thermal Performance and Efficiency of a Mineral Oil Immersed Server Over Varied Environmental Operating Conditions

2017 ◽  
Vol 139 (4) ◽  
Author(s):  
Richard Eiland ◽  
John Edward Fernandes ◽  
Marianna Vallejo ◽  
Ashwin Siddarth ◽  
Dereje Agonafer ◽  
...  
Keyword(s):  
Flow Rate ◽  
Thermal Performance ◽  
Data Center ◽  
Mineral Oil ◽  
Operating Conditions ◽  
Published Data ◽  
Inlet Temperature ◽  
Air Cooling ◽  
Bulk Fluid ◽  
Oil Immersion

Complete immersion of servers in dielectric mineral oil has recently become a promising technique for minimizing cooling energy consumption in data centers. However, a lack of sufficient published data and long-term documentation of oil immersion cooling performance make most data center operators hesitant to apply these approaches to their mission critical facilities. In this study, a single server was fully submerged horizontally in mineral oil. Experiments were conducted to observe the effects of varying the volumetric flow rate and oil inlet temperature on thermal performance and power consumption of the server. Specifically, temperature measurements of the central processing units (CPUs), motherboard (MB) components, and bulk fluid were recorded at steady-state conditions. These results provide an initial bounding envelope of environmental conditions suitable for an oil immersion data center. Comparing with results from baseline tests performed with traditional air cooling, the technology shows a 34.4% reduction in the thermal resistance of the system. Overall, the cooling loop was able to achieve partial power usage effectiveness (pPUECooling) values as low as 1.03. This server level study provides a preview of possible facility energy savings by utilizing high temperature, low flow rate oil for cooling. A discussion on additional opportunities for optimization of information technology (IT) hardware and implementation of oil cooling is also included.

A Numerical Study of Single Phase Dielectric Fluid Immersion Cooling of Multichip Modules

2012 ◽  
Vol 2012 (1) ◽  
pp. 000581-000590
Author(s):  
Roy W. Knight ◽  
Seth Fincher ◽  
Sushil H. Bhavnani ◽  
Daniel K. Harris ◽  
R. Wayne Johnson
Keyword(s):  
Single Phase ◽  
Printed Circuit Board ◽  
Numerical Study ◽  
Design Guidelines ◽  
Circuit Board ◽  
Dielectric Fluid ◽  
Multichip Modules ◽  
Ansys Fluent ◽  
Immersion Cooling ◽  
Numerical Parametric Study

Immersion, single phase free convection cooling of multichip modules on a printed circuit board in a pool of dielectric fluid was examined numerically, with experimental verification of baseline cases. A multi-chip module with multiple thermal test cells with temperature sensing capability was simulated. The commercially available computational fluid dynamics program from ANSYS, Fluent, was used with the electronics packaging front end, Icepak, employed to create the models and compact conduction modules. Simulations were first performed of an experimental test vehicle which had five 18 mm by 18 mm die, arranged in a cross pattern, equally spaced die, 25 mm between them. Two of the die were aligned vertically with the center die, two aligned horizontally with it. The board was suspended vertically in a large pool of dielectric fluid. Heat was dissipated in the die at a flux of up to 2 W/cm2, based on the die surface area. Simulation results were compared with experimentally measured die temperature values and excellent agreement was seen for the cases of one die heated and all five die uniformly heated with the board cooled by FC-72. A numerical parametric study was performed to examine the effect of die size and spacing on temperature rise. In addition to FC-72, immersion cooling in Novec 649 and HFE 7100 were modeled. Design guidelines are suggested for dielectric fluid immersion cooled multichip modules.

New Thermal Management Systems for Data Centers

2012 ◽  
Vol 4 (3) ◽  
Author(s):  
Mayumi Ouchi ◽  
Yoshiyuki Abe ◽  
Masato Fukagaya ◽  
Takashi Kitagawa ◽  
Haruhiko Ohta ◽  
...  
Keyword(s):  
Heat Exchanger ◽  
Single Phase ◽  
Data Centers ◽  
Cooling System ◽  
Heat Pipes ◽  
Air Cooling ◽  
Liquid Cooling ◽  
Two Phase ◽  
Cooling Jacket ◽  
Cooling Methods

Energy consumption in data centers has seen a drastic increase in recent years. In data centers, server racks are cooled down in an indirect way by air-conditioning systems installed to cool the entire server room. This air cooling method is inefficient as information technology (IT) equipment is insufficiently cooled down, whereas the room is overcooled. The development of countermeasures for heat generated by IT equipment is one of the urgent tasks to be accomplished. We, therefore, proposed new liquid cooling systems in which IT equipment is cooled down directly and exhaust heat is not radiated into the server room. Three cooling methods have been developed simultaneously. Two of them involve direct cooling; a cooling jacket is directly attached to the heat source (or CPU in this case) and a single-phase heat exchanger or a two-phase heat exchanger is used as the cooling jacket. The other method involves indirect cooling; heat generated by CPU is transported to the outside of the chassis through flat heat pipes and the condensation sections of the heat pipes are cooled down by coolant with liquid manifold. Verification tests have been conducted by using commercial server racks to which these cooling methods are applied while investigating five R&D components that constitute our liquid cooling systems: the single-phase heat exchanger, the two-phase heat exchanger, high performance flat heat pipes, nanofluid technology, and the plug-in connector. As a result, a 44–53% reduction in energy consumption of cooling facilities with the single-phase cooling system and a 42–50% reduction with the flat heat pipe cooling system were realized compared with conventional air cooling system.

Evaluation of Single Phase Immersion Cooling System for High Performance Server Chassis Using Dielectric Coolants

2020 ◽  
Author(s):  
Shuai Shao ◽  
Tianyi Gao ◽  
Huawei Yang ◽  
Jie Zhao ◽  
Jiajun Zhang
Keyword(s):  
Power Density ◽  
Thermal Performance ◽  
Data Center ◽  
High Performance ◽  
Single Phase ◽  
Cooling System ◽  
Thermal Power ◽  
Fluid Temperature ◽  
Primary Loop ◽  
Immersion Cooling

Abstract Along with advancements in microelectronics packaging, the power density of processor units has steadily increased over time. Data center servers equipped for high performance computing (HPC) often use multiple central processing units (CPUs) and graphical processing units (GPUs), thereby resulting in an increased power density, exceeding 1 kW per U. Many data center organizations are evaluating single phase immersion technology as a potential energy and resource saving cooling option. In this work immersion cooling was studied at a power level of 2.7kW/U with a 5U-height immersion cooling tank. Heat generated by a simulated GPU server was transferred to the secondary loop coolant, and then exchanged with the primary loop facility coolant through the heat exchanger. The chiller supply and return temperature and flow rate was controlled for the primary loop. The simulated GPU server chassis was designed to provide thermal power equivalent to a high power density server. Eight simulated power heaters, of which each unit was the size of a GPU chipset, was assembled in the comparable location to a real IT equipment on a 4U server chassis. Power for the GPU simulated chassis was able to support up to 2700 W maximum. Three investigations for this immersion cooling system evaluation were performed through comprehensive testing. The first is to identify the key decision making factor(s) for evaluating the thermal performance of 4 hydrocarbon-based dielectric coolants, including power parametric analysis, transient analysis, power cycling test, and fluid temperature profiling. The second is to develop an optimization strategy for the immersion system thermal performance. The third is to verify the capability of an 1U heat sink to support high density processor units over 300 W per GPU in an immersion cooling solution.

Sign in / Sign up

Export Citation Format

Share Document