תיאור תפקיד:
Senior Data Scientist / ML Engineer – LLMs & Decision Models | Maternity Leave Replacement | 50% Position | Ramat Gan
A leading high-tech company is looking for a Senior Data Scientist / ML Engineer to optimize its AI platform, which powers intelligent agents used by thousands of businesses worldwide. The role focuses on reducing LLM costs by replacing expensive LLM calls with in-house decision models, while maintaining quality. In a later phase, the focus will expand to fine-tuning small open-source models as cost-efficient alternatives. What you’ll do
Phase 1: Decision Models in Production Collaborate with feature teams to identify opportunities to replace LLM calls with decision models.
Build evaluation datasets and Python benchmarks, analyze failures, and define quality criteria.
Assess potential cost savings based on production volumes and serving costs, ensuring no drop in quality.
Coordinate implementation and rollout with Data Scientists, Engineers, and the ML Serving team, providing evaluations and technical guidance.
Phase 2: Fine-Tuned Small Models Fine-tune small open-source models for specific tasks and broader use cases.
Evaluate and validate their performance before production rollout.
Success means: reducing reliance on expensive LLMs and delivering measurable cost savings without compromising quality.
דרישות:
What you bring
Hands-on experience fine-tuning open language models, using methods such as supervised fine-tuning, distillation, or LoRA, with PyTorch and Hugging Face.
Strong Python skills and experience designing ML or LLM evaluations and analyzing quality and cost tradeoffs.
Experience collaborating with engineering teams to bring models into production, with an understanding of inference and serving constraints.
Ability to drive work across teams, communicate findings clearly, and identify worthwhile model replacement opportunities.
Nice to Have
Experience with KServe, vLLM, or similar model serving infrastructure is a strong plus.
Experience with classification or decision models built on LLMs, including probability calibration.
The Details
Contract for 6–12 months, about 50% time. Freelancers are welcome.
We are also hiring for a Senior Applied AI Scientist role. If you fit both, we would love to hear from you.
היקף משרה:
משרה חלקית
קוד משרה:
245440
אזור:
מרכז - תל אביב, פתח תקווה, רמת גן וגבעתיים, בקעת אונו וגבעת שמואל, חולון ובת-ים, מודיעין, שוהם
שרון - חדרה וזכרון יעקב, נתניה ועמק חפר, רעננה, כפר סבא והוד השרון, ראש העין, הרצליה ורמת השרון
ירושלים - ירושלים, יהודה ושומרון, בית שמש
דרום - אשדוד, קרית גת, אשקלון, קרית מלאכי
השפלה - ראשון לציון ונס- ציונה, רמלה לוד, רחובות, יבנה
|