ML Engineer (Model Distillation/Knowledge Distillation)

HCLTech · Bengaluru, Karnataka, India · Full Time · Onsite

Posted

Location: Noida or Bengaluru About the Role We believe small, well-distilled models can match much larger systems at a fraction of the cost — and that belief is only as good as the distillation pipeline behind it. As a Distillation Engineer, you'll build and run that pipeline. What You'll Do Design and run teacher-student distillation pipelines to produce small, efficient models Implement quantization-aware training and model compression techniques Manage student-model refresh cycles as teacher models and training data improve Evaluate distilled-model quality against both public benchmarks and real production tasks Collaborate with our evaluation and data teams on synthetic data generation for distillation What You'll Bring5+ years of relevant experience in machine learning engineering or applied research Hands-on experience with knowledge distillation and teacher-student training Experience with quantization-aware training and model compression techniques Proficiency in Py Torch and Python Comfort iterating quickly on model quality tradeoffs under compute constraints Education Master's or Ph D in Machine Learning, Computer Science, or a related quantitative field. Nice to Have A master's or Ph D in Machine Learning, ideally with a publication record in model compression or efficient inference Experience building small, production-quality language models

Apply on HCLTech's site