New College Grad - AI Infrastructure & HBM Architecture Engineer

Job Title

New College Grad - AI Infrastructure & HBM Architecture Engineer

Role Summary

Entry-level engineering role supporting analysis and modeling of next-generation AI memory and system environments, with emphasis on HBM architecture decisions.

Work with senior engineers across DTPCO, Design, and Product/System teams to collect data, build performance models, and develop tools that inform memory-system and AI-cluster architecture trade-offs.

Experience Level

Entry-level (New college graduate). Suitable for recent graduates or current graduate students beginning their engineering careers.

Responsibilities

Contribute to research, modeling, and tooling that guide HBM and system-level memory design for AI workloads.

• Research trends in compute, networking, and storage to anticipate future AI workload evolution.
• Collect and synthesize data to inform HBM bandwidth, latency, and system-level memory requirements.
• Help develop or refine simulation frameworks modeling AI cluster performance and memory-subsystem behavior.
• Build first-order performance models for HBM bandwidth, latency, GPU/CPU interactions, and memory-hierarchy trade-offs.
• Participate in creating trend dashboards using CSP benchmarks and industry datasets.
• Collaborate with DTPCO mentors to identify architectural intercept opportunities for next-generation AI systems.

Requirements

Must-have technical skills and knowledge for effective contribution; education requirements are listed separately below.

• Strong foundational understanding of computer architecture, digital systems, and hardware/software interaction.
• Interest in memory subsystem design (HBM, DDR, caches) and its impact on AI/ML workloads.
• Deep understanding of the LLM pipeline and identification of critical bottlenecks.
• Programming experience in Python, C/C++, or similar languages.

Nice-to-have

• Exposure to AI workload behavior, ML training pipelines, or large-scale system bottlenecks.
• Ability to convert research findings into concise technical summaries or recommendations.
• Comfort learning new tools, simulation frameworks, and data-analysis workflows.

Education Requirements

Currently pursuing a Masters degree or PhD in Electrical Engineering, Computer Engineering, Computer Science, or a related field. (The posting specifies enrollment in a graduate program; no alternative-equivalent experience language was provided.)

About the Company

Company: Micron Technology

Headquarters: Boise, Idaho, USA

Micron Technology is a global leader in memory and storage solutions, dedicated to transforming how the world uses information. The company offers a diverse portfolio of high-performance DRAM, NAND, and NOR memory products under the Micron and Crucial brands. With a commitment to customer focus and technological innovation, Micron drives advancements in artificial intelligence, 5G, and other data-centric applications, empowering users to learn, communicate, and progress.