Software Engineer, Systems ML - Frameworks/Compilers/Kernels
Meta PlatformsJob Title
Software Engineer, Systems ML - Frameworks/Compilers/Kernels
Role Summary
Member of the MTIA (Meta Training & Inference Accelerator) Software team within the PyTorch AI framework organization. Build compiler stack, runtimes, high-performance kernels and tooling to accelerate training and inference on MTIA AI hardware.
Collaborate with AI researchers and hardware design teams to analyze models, implement compiler optimizations, and tune performance for production ML workloads.
Experience Level
Senior-level. Preferred guidance in the posting: BS +7 years, MS +4 years, or PhD +3 years of relevant experience.
Responsibilities
Primary responsibilities include designing, implementing, and optimizing software components across frameworks, compilers, runtimes, and kernels.
- Develop PyTorch framework components, AI compiler and runtime, or high-performance kernels targeted to MTIA hardware.
- Analyze deep learning networks and implement compiler optimization algorithms.
- Work with AI researchers to accelerate models (recommendation systems, generative AI, computer vision, NLP, etc.).
- Partner with hardware teams to design hardware-specific compiler optimizations.
- Performance tune framework and software components for latency, memory bandwidth, and compute utilization.
Requirements
Must-have technical skills and practical experience.
- Proficient in C/C++ software development.
- Experience in AI framework development or accelerating deep learning models on hardware architectures.
- Experience in performance tuning or optimization of ML systems and software components.
Nice-to-have:
- Experience with compiler optimizations (loop optimizations, vectorization, parallelization) and familiarity with MLIR, LLVM, IREE, XLA, TVM, or Halide.
- Experience developing training and inference framework components and runtime performance analysis tooling.
- Knowledge of GPU, CPU, or AI accelerator architectures and experience with frameworks such as PyTorch, TensorFlow, ONNX, TensorRT.
- Experience with CUDA, OpenMP/OpenCL, or accelerator kernel programming and accelerating libraries (cuBLAS, cuDNN, CUTLASS, HIP/ROCm).
- Experience applying responsible AI practices and ongoing AI skill development.
Education Requirements
Bachelor's degree in Computer Science, Computer Engineering or a relevant technical field, or equivalent practical experience. Preferred combinations listed in the posting: Bachelor's +7+ years, Master's +4+ years, or PhD +3+ years of experience in AI framework development or accelerating deep learning models on hardware architectures.
About the Company
Company: Meta Platforms
Headquarters: Menlo Park, California, United States
American technology company that develops social networking products (Facebook, Instagram, WhatsApp) and invests in virtual/augmented reality hardware and software through Reality Labs, focusing on connectivity, advertising, and immersive computing experiences.
