PMTS Software Development Engineer

Job Title

PMTS Software Development Engineer

Role Summary

Develop and optimize low-level GPU kernels and software to accelerate inference and training of large machine learning models. Design and implement distributed training/inference strategies across multiple GPUs and nodes, profile system performance, and apply parallel computing techniques to improve scalability and efficiency.

Work with machine learning researchers, software and architecture teams, and infrastructure engineers to integrate optimized kernels into production systems and document best practices and implementation guidelines.

Experience Level

Mid-level (Mid-Career). Minimum five (5) years of relevant engineering experience in the job offered or a closely related role; alternate experience paths described in Education Requirements.

Responsibilities

Primary responsibilities include kernel development, performance optimization, and cross-team integration.

• Design, implement, and optimize low-level GPU kernels to accelerate model inference and training.
• Develop and implement distributed training and inference strategies (data and model parallelism) across multiple GPUs and nodes.
• Profile applications and systems to identify bottlenecks; use profiling tools to optimize hardware resource utilization.
• Apply parallel computing techniques, multi-threading, and GPU synchronization mechanisms to improve throughput and scalability.
• Explore and implement model quantization and memory-reduction techniques for edge and cloud deployment.
• Create benchmarks, testing procedures, and validation suites to measure performance and stability of optimized models and frameworks.
• Collaborate with architecture, software, ML research, and infrastructure teams to integrate optimizations into production pipelines.
• Produce clear documentation of optimizations, implementation steps, and best practices for maintainability and knowledge transfer.

Requirements

Must-have technical skills, experience, and competencies.

• Minimum five (5) years of professional engineering experience in the job offered or a closely related role.
• At least two (2) years of experience designing, implementing, and testing computer hardware and related workflows.
• Experience optimizing GPU kernels and implementing high-performance compute code for ML workloads.
• Experience with distributed training techniques and scaling across multiple GPUs/nodes.
• Proven ability with profiling and performance analysis tools to identify and eliminate bottlenecks.
• Strong knowledge of parallel computing, multi-threading, and GPU synchronization strategies.
• Experience with model quantization techniques and memory/computation reduction strategies.
• Hands-on experience with Verilog RTL coding, UVM testbench development, and VLSI design.
• Experience with FPGA development and associated tool flows.
• Proficiency in scripting languages such as Python, Perl, and TCL/TK for automation and tooling.
• Ability to collaborate across hardware, architecture, and software teams and produce clear technical documentation.

Education Requirements

Master's degree (or foreign equivalent) in Computer Science, Computer Engineering, Electrical Engineering, Software Engineering, or a related field is required. Employer will accept a Bachelor’s degree (or foreign equivalent) in those fields plus seven (7) years of progressive post-baccalaureate experience as an alternate combination. The posting references "foreign equivalent" degrees where applicable.

About the Company

Company: Advanced Micro Devices

Headquarters: Sunnyvale, California, USA

Advanced Micro Devices, or AMD, is a global semiconductor company that designs and manufactures microprocessors, graphics processors, and related technologies for a variety of computing devices. Known for pushing the boundaries of innovation, AMD's mission is to deliver high-performance computing solutions for AI, data centers, gaming, and embedded applications. They foster a collaborative, inclusive culture focused on creativity and problem-solving, aiming to drive progress and excellence in technology.