תיאור תפקיד:
We are looking for an AI Performance Engineer to help optimize large language model inference across the full systems stack.
You will work on improving the performance, efficiency, scalability, and reliability of LLM serving infrastructure, from low-level GPU kernel optimization to single-node runtime performance and distributed cluster-wide inference optimization.
This role sits at the intersection of systems engineering, GPU computing, and AI infrastructure.
You will work closely with researchers, ML engineers, infrastructure engineers, and product teams to make state-of-the-art AI models faster, more efficient, and easier to serve at scale.
What You’ll Do
• Optimize LLM inference performance across the full stack, including kernels, runtimes, model execution, networking, scheduling, and distributed serving.
• Analyze and improve GPU utilization, memory bandwidth, latency, throughput, and cost efficiency.
• Develop, tune, or integrate high-performance GPU kernels using technologies such as CUDA, Triton, CUTLASS, or similar frameworks.
• Improve single-node inference performance through runtime optimization, memory management, batching, quantization, parallelism, and profiling.
דרישות:
What We’re Looking For We are looking for candidates with strong experience in at least one of the following areas:
• Performance engineering and low-level software optimization.
• GPU kernel development and optimization.
• AI/ML systems optimization, especially for inference or distributed training/serving.
• Ideal Qualifications:
• Strong programming skills in C++, CUDA, Python, or similar systems-oriented languages.
• Experience profiling and optimizing software for latency, throughput, memory usage, or hardware utilization.
• Familiarity with GPU architectures and performance characteristics.
• Experience with one or more of CUDA, Triton, CUTLASS, ROCm, NCCL, TensorRT, XLA, TVM, vLLM, TensorRT-LLM, PyTorch, or similar technologies.
• Understanding of LLM inference techniques such as batching, KV cache management, quantization, speculative decoding, parallelism strategies, and distributed serving.
• Experience working with large-scale distributed systems, high-performance computing, networking, or cluster scheduling is a plus.
• Ability to reason from first principles, use profiling data effectively, and drive measurable performance improvements.
• Strong communication skills and ability to collaborate across research, engineering, and infrastructure teams.
היקף משרה:
משרה מלאה
קוד משרה:
JB-5254
אזור:
מרכז - תל אביב, פתח תקווה, רמת גן וגבעתיים, בקעת אונו וגבעת שמואל, חולון ובת-ים, מודיעין, שוהם
שרון - חדרה וזכרון יעקב, נתניה ועמק חפר, רעננה, כפר סבא והוד השרון, ראש העין, הרצליה ורמת השרון
השפלה - ראשון לציון ונס- ציונה, רמלה לוד, רחובות, יבנה
|