Cloudera Developer

T-Systems Information and Communication Technology India Private Limited (T-Systems ICT India Pvt. Ltd.) is a proud recipient of the prestigious Great Place To Work® Certification™. As a wholly owned subsidiary of T-Systems International GmbH, T-Systems India operates across Pune, Bangalore, and Nagpur, boasting a dedicated team of 3500+ employees providing services to group customers. T-Systems offers integrated end-to-end IT solutions, driving the digital transformation of companies in all industries, including automotive, manufacturing, logistics, and transportation, as well as healthcare and the public sector. T-Systems develops vertical, company-specific software solutions for these sectors. T-Systems International GmbH is an information technology and digital transformation company with a presence in over 20 countries and a revenue of more than €4 billion. T-Systems is a world-leading provider of digital services and has over 20 years of experience in the transformation and management of IT systems. As a subsidiary of Deutsche Telekom and a market leader in Germany, T-Systems International offers secure, integrated information technology and digital solutions from a single source. Role : Sr Cloudera Developer (Data Engineer) Exp : 6 to 10 Years Location : Pune Job Description : - Proficiency in working with Spark - Understanding of Spark s architecture and fault tolerance mechanisms - Proficiency in using Spark DataFrames and Spark SQL for querying structured data - Experience in optimizing Spark execution plan is a plus - Skills in performing Extract Transform and Load ETL processes using Spark - Experience with integrating Spark Streaming with other technologies like Kafka is an advantage - Familiarity with the Hadoop ecosystem including tools such as HDFS Hive Cloudera stack can be of advantage - Experience with deploying and managing Spark applications on a Hadoop cluster or on GCP Dataproc - Strong knowledge of Python experience with Java is beneficial as well - DevOps tools and practices CI CD Docker - Hands on experience in GCP services Dataproc Cloud Function Cloud Run Pub Sub BigQuery Responsibilities and Duties : • Design, develop, and implement data solutions using Cloudera technologies such as Hadoop, Spark, and Hive • Collaborate with data engineers to optimize data pipelines and data processing workflows. • Work closely with data analysts and data scientists to ensure data quality and integrity. • Troubleshoot and resolve issues with data processing and data storage systems. • Stay up-to-date on the latest trends and best practices in Cloudera development • Participate in code reviews and provide feedback to team members. Qualifications and Skills: • Bachelor’s degree in computer science, Information Technology, or a related field • Proven experience as a Cloudera Developer or similar role • Solid understanding of Cloudera technologies such as Hadoop, Spark, and Hive • Experience with data modeling, data warehousing, and data integration. • Strong programming skills in Java, Scala, or Python • Excellent problem-solving and communication skills • Ability to work independently and as part of a team.