How Can Chiplets Accelerate Generative AI Applications?

March 27, 2024
This superpanel explores the role of chiplets in advancing ever-expanding generative AI technology.

Check out Electronic Design's coverage of Chiplet Summit 2024. This video is also part of the TechXchanges: Generating AI and Chiplets - Electronic Design Automation Insights.

What you’ll learn:

  • Why chiplet technology will affect embedded deployment of generative AI.
  • How chiplets will be used to accelerate generative AI.

 

Generative AI is the biggest topic in computer technology today. Everyone is talking about ChatGPT, its originator OpenAI, and its top executive Sam Altman. So, what role can chiplets play as applications roll out in areas ranging from accounting to zoology?

Surely chiplets can provide faster, more powerful AI chips, as well as devices that can bring generative AI to the edge. Also, the chiplet form can be a way to add generative AI accelerators to processor designs. Still other applications include high-speed memory and I/O devices sitting close to processors inside packages to allow for more in-memory computation and fewer data moves.

A superpanel of experts across the industry, hosted by William Wong, Senior Content Director for Electronic Design, provided their takes on chiplets and AI. The panelists included:

  • Nick Ilyadis, Vice President of Product Planning at Achronix. He’s a recognized software and hardware development and quality control expert with over 35 years of data and semiconductor engineering and manufacturing experience, and 72 issued patents.
  • Durgesh Srivastava, Senior Director Hardware Engineering at NVIDIA. He drives Arm’s Server SoC architecture for cloud and enterprise applications, focusing on rack-level optimizations and memory disaggregation.
  • Rohit Mittal, Systems and Silicon Lead at Google. He works on tensor processing units (TPUs) that power AI in Google. Before joining Google, he was director in Intel’s Cloud and Data Center Products Groups, leading product development and management organizations for servers, silicon photonics, and networking.
  • Paul Fahey, Vice President of Technology at SK Hynix. He’s active with JEDEC and is involved in HBM marketing.
  • Kevin Chen heads the corporate VC group of Lam Research, which invests across the semi ecosystem.  Previously, he’s led product marketing and development teams at Applied Materials and AMD, and served as CEO of a VC-backed tech startup.
  • Paul Borrill, Chief Product Officer at Daedaelus and an expert on software infrastructures. He contributed to systems development at NASA, Sun Microsystems, Quantum, VERITAS, and Apple. Paul co-founded the IEEE Hot Interconnects Symposium and the Storage Networking Industry Association (SNIA).

Check out more of our coverage of Chiplet Summit 2024 and other videos/articles in the TechXchanges: Generating AI and Chiplets - Electronic Design Automation Insights.

About the Author

William G. Wong | Senior Content Director - Electronic Design and Microwaves & RF

I am Editor of Electronic Design focusing on embedded, software, and systems. As Senior Content Director, I also manage Microwaves & RF and I work with a great team of editors to provide engineers, programmers, developers and technical managers with interesting and useful articles and videos on a regular basis. Check out our free newsletters to see the latest content.

You can send press releases for new products for possible coverage on the website. I am also interested in receiving contributed articles for publishing on our website. Use our template and send to me along with a signed release form. 

Check out my blog, AltEmbedded on Electronic Design, as well as his latest articles on this site that are listed below. 

You can visit my social media via these links:

I earned a Bachelor of Electrical Engineering at the Georgia Institute of Technology and a Masters in Computer Science from Rutgers University. I still do a bit of programming using everything from C and C++ to Rust and Ada/SPARK. I do a bit of PHP programming for Drupal websites. I have posted a few Drupal modules.  

I still get a hand on software and electronic hardware. Some of this can be found on our Kit Close-Up video series. You can also see me on many of our TechXchange Talk videos. I am interested in a range of projects from robotics to artificial intelligence. 

Sponsored Recommendations

Comments

To join the conversation, and become an exclusive member of Electronic Design, create an account today!