AI/ML [Sagemaker with AWS] - 5+yrs

Nasugroup.com · Bengaluru, Karnataka, India · Onsite

Posted

This role is responsible for designing, deploying, and operating scalable AI/ML and Generative AIplatforms on AWS. The engineer will enable robust ML Ops, LLM Ops, and Dev Ops practices,supporting production-grade AI solutions (including LLMs and agent-based systems) across lending,risk, and customer journeys. Key Responsibilities1. AI/ML & Gen AI Operations (AI Ops) Operate and support production ML and Gen AI workloads on AWS Monitor: o Model performance, drift, and reliabilityo LLM outputs (hallucination, latency, response quality) Ensure high availability of AI services powering lending workflows2. ML Ops & LLM Ops (AWS Native) Build and manage end-to-end ML pipelines using: o Amazon Sage Maker (training, deployment, pipelines) o Sage Maker Model Registry for versioning Implement: o CI/CD pipelines for ML and Gen AI workloadso Experiment tracking and reproducibility Enable LLM Ops practices: o Prompt lifecycle managemento Evaluation frameworks for Gen AI outputs 3. Dev Ops & Cloud Engineering (AWS) Design and manage infrastructure using: o Terraform / AWS Cloud Formation Implement CI/CD pipelines using: o AWS Code Pipeline, Code Build, Git Hub Actions Orchestrate workloads with: o EKS (Kubernetes) and Docker Ensure scalability, resilience, and cost optimisation4. Gen AI & Agentic AI Enablement Deploy and manage: o Amazon Bedrock (LLMs, foundation models) o RAG pipelines using vector databases (Open Search, Pinecone, etc.) Enable runtime support for: o AI agents and multi-agent workflows Integrate AI systems with: o APIs, event-driven services, and enterprise platforms 5. Data & Pipeline Integration Build pipelines using: o AWS Glue, Lambda, Step Functions Manage data storage and access via: o S3, Redshift, Dynamo DB Enable real-time and batch AI workflows6. Monitoring, Observability & Reliability Implement monitoring using: o Cloud Watch, Prometheus, Grafana Track: o Model metrics, pipeline performance, system health Define SLAs/SLOs and manage incident response7. Security, Risk & Compliance Ensure secure AI deployments using: o IAM, KMS, Secrets Manager Implement data governance and privacy controls Enforce Responsible AI and model governance standards8. Collaboration & Enablement Work with: o AI Architects, Data Scientists, Platform Engineers Enable teams with: o Reusable ML Ops templates and frameworkso Self-service AI deployment capabilities Key Skills and Experience AWS AI/ML & Cloud Stack Strong experience with: o Amazon Sage Maker (end-to-end ML lifecycle) o Amazon Bedrock (Gen AI / LLMs) Familiarity with: o Open Search, S3, Lambda, API Gateway ML Ops / LLM Ops Experience implementing: o ML pipelines, model registries, CI/CD for ML Knowledge of: o Prompt engineering workflowso Gen AI evaluation techniques Dev Ops & Platform Engineering Hands-on experience with: o Docker, Kubernetes (EKS) o Terraform / Cloud Formation CI/CD: o Code Pipeline, Jenkins, Git Hub Actions Programming Python (primary), Bash scripting Experience building APIs (Fast API preferred) Monitoring & Reliability Experience with: o Cloud Watch, ELK stack, Prometheus Understanding of: o AI system observability and logging.

Apply on Nasugroup.com's site