Semiconductors, Data Centers & AI

Friday 8 November 2024 - An outline of the ongoing development of specialized AI accelerators and the impact of ARM architectures on the CPU market for HPC; Trends and developments in memory and storage technologies for AI and HPC workloads and the advanced semiconductor packaging technologies to realize next-generation solutions; Examination of the growing role of silicon photonics in high-speed interconnects for HPC and how co-packaged optics will increase bandwidths whilst reducing power consumption; Discussion of the push towards liquid cooling in data centers, driven by increasing AI workloads; Insights from IDTechEx's ten-year forecasting for the HPC market

As of 2024, single-phase direct-to-chip (D2C) cooling dominates the high-end GPU thermal management market. However, with the increasing thermal design power (TDP), two-phase D2C cooling will be required.

Emerging advanced semiconductor packaging technologies, such as 2.5D and 3D hybrid bonding, are crucial for enhancing system performance across various applications such as AI and high-performance computing. This article explores the technology development trends in 2.5D and 3D packaging technologies and the key market growth drivers.

Thursday 14 November 2024 - Chiplet Technology: Revolutionizing Semiconductor Design and Integration; Definition and significance of chiplets in modern semiconductor design; Comparison with SoC and SiP technologies; Introduction to heterogeneous integration; Drivers and advantages of adopting chiplet technology; Brief overview of challenges in implementing chiplets; Insights into the future potential and impact of chiplet technology

Given helium's critical role in semiconductor production, onshoring chip manufacturing will have a significant knock-on impact on the helium demand for semiconductor manufacturing.

Leading companies like AMD and Intel have adopted chiplet designs in products such as AMD's EPYC processors and Intel's Ponte Vecchio GPUs. This widespread adoption underscores the growing importance of chiplets in high-performance computing applications.

Wednesday 30 October 2024 - Data Center Liquid Cooling - 6-Fold Market Size Expansion in 10 Years; Air cooling overview; Direct-to-chip cooling: An exploration of technical barriers and advantages of single- and two-phase D2C cooling; Immersion cooling: An examination of single-phase and two-phase immersion and their technical and commercial barriers; Coolant comparison and regulations: A comparative analysis of coolants used in liquid cooling systems, including costs, regulatory requirements and operating temperature; Data center cooling value chain and liquid cooling on the data center facility level; Cost analysis of data center cooling; Thermal interface materials: An overview of the critical TIMs in efficient heat transfer within cooling systems; Market size forecast and future opportunities

The global commercialization of autonomous trucks in 2024 is being shaped significantly by regional regulations and government policies. To enable the growth of autonomous trucking, the U.S., Europe and China have adopted different approaches, primarily influenced by their respective regulatory environments, infrastructure development, and governmental support.

The rapid rise of AI and HPC (high performing computing) applications is driving a fundamental shift in data center cooling strategies. As chips like Nvidia's B200 and Intel's Falcon Shores GPU push the limits of thermal design power, direct-to-chip and immersion cooling solutions are becoming critical to managing the heat loads in modern data centers.

CPO represents a significant leap in data transmission technology by integrating the optical engine and the switching silicon onto the same substrate. This design eliminates the need for signals to traverse the PCB, further reducing the electrical channel path and significantly improving performance.