Data Engineer

Tata Consultancy Services · Bengaluru, Karnataka, India · Full Time · Onsite

Posted

JD Join us for our Walk-in Drive in Bangalore on 19th September 2026 (Saturday) and explore exciting career opportunities. If you are interested, please apply with your updated resume. Role : Pyspark Data Engineer / Pyspark Developer Experience : 4 to 10 years Location : Bangalore Mode : Work from Office Responsibilities:• Data Processing: Design, develop, and maintain data processing solutions using Py Spark, Apache Spark, and Python.• Data Pipeline Development: Develop and optimize data pipelines using Py Spark, Apache Spark, and cloud-based data platforms.• Data Integration: Integrate data from various sources, including relational databases, No SQL databases, and cloud storage.• Data Transformation: Develop and implement data transformation logic using Py Spark, Apache Spark, and Python.• Collaboration: Work with cross-functional teams to identify and prioritize project requirements, provide technical guidance, and ensure data quality.Required Skills: • Py Spark: In-depth knowledge of Py Spark, Apache Spark, and Python.• Data Processing: Strong understanding of data processing concepts, including data ingestion, data transformation, and data storage.• Cloud Experience: Experience with cloud-based data platforms, including AWS, Azure, or Google Cloud.• Expertise in Data Frames & Spark SQL, Spark Streaming with Apache Kafka real-time data ingestion pipelines• Very good conceptual understanding of Multithreading, distributed computing concepts of Pyspark • Programming: Proficiency in programming languages, including Python, Java, or Scala.• Communication: Excellent communication and collaboration skills.

Apply on Tata Consultancy Services's site