NVIDIA logo

Senior Hardware Architect Artificial Intelligence

NVIDIA
August 21, 2026
Full-time
On-site
Yokne'am Illit, Israel
SoC Architecture Jobs, Level - Senior

Job Title

Senior Hardware Architect, Artificial Intelligence

Role Summary

Lead the definition and adoption of AI-driven architecture workflows across NVIDIA's networking architecture teams. The role combines domain architecture leadership for NICs, switches and related silicon with collaboration with AI engineering to build agentic tools, evaluation harnesses, and processes that shorten design cycles and improve output quality.

Experience Level

Senior β€” typically requires 6+ years in hardware, firmware, or system architecture (NIC, switch, DPU, CPU, or SoC).

Responsibilities

Technical leadership and delivery across architecture and AI engineering to create production-ready AI-assisted architecture flows.

  • Define roadmap for AI-driven architecture flows: data collection, modeling, agent design, review and validation standards.
  • Work with architects to identify hard problems and design agentic flows to shorten time to robust solutions.
  • Partner with AI engineering to translate architecture workflows into production agents, integrations, and evaluation harnesses.
  • Serve as domain authority for architecture output quality and verify AI-assisted results meet standards.
  • Drive adoption through beta cycles, feedback loops, training, and cross-team coordination.
  • Represent technical direction to senior architecture and product leadership.

Requirements

Must-have technical experience, skills, and behaviors for immediate effectiveness in the role.

  • 6+ years in hardware, firmware, or system architecture for NICs, switches, DPUs, CPUs, or SoCs, including defining microarchitecture specs, performance models, or architecture decision documents.
  • Practical ability to understand and adopt agentic AI workflows and tools (e.g., popular LLM/agent toolchains).
  • Strong judgment on engineering quality and experience defining validation strategies for automated outputs.
  • Proven ability to explain AI workflows to architects and to communicate architectural trade-offs to non-architect engineers.
  • Track record of driving adoption of tools or processes across technical organizations.
  • Nice to have: hands-on experience applying LLMs, agents, or prompt-plus-code pipelines to engineering work; expertise in high-speed networking silicon (InfiniBand, Ethernet, switch fabric, NIC/RDMA); familiarity with transformer/LLM training and inference parallelism; experience measuring engineering productivity or shipping internal platform tools at scale.

Education Requirements

B.A., M.Sc., or Ph.D. in Computer Engineering, Electrical Engineering, Computer Science, or a related field β€” or equivalent practical experience.


About the Company

Company: NVIDIA

Headquarters: Santa Clara, California, USA

NVIDIA is a global leader in accelerated computing, renowned for its innovative solutions in AI and digital twins that transform diverse industries. The company specializes in networking technologies, providing end-to-end InfiniBand and Ethernet solutions for servers and storage that optimize performance and scalability. NVIDIA serves sectors such as high-performance computing, enterprise data centers, and cloud computing, constantly reinventing its products and services to stay ahead in the market.

NVIDIA logo

Date Posted: 2026-08-20