Saltar al contenido

Todos los empleos

Senior Data Engineer (Qlik, ETL)

Two95 International Inc. · Kuala Lumpur, MY

Sobre el empleo

We are looking for Senior Data Engineer with 10 years of experience. Data Ingestion Design & Development - Design, develop, and maintain Qlik Replicate data pipelines for near-real-time and batch data replication between heterogeneous systems (e.g., Oracle, Cloudera, DB2, etc.). - Administer Qlik Replicate servers, monitor task performance, and manage licensing, upgrades, and patches. - Implement best practices for replication task configuration, error handling, and resource optimization. - Troubleshoot data replication issues, performance bottlenecks, and connectivity errors across environments. - Oracle DB knowledge and proficient in writing complex SQL queries and PL/SQL programs - Unix basic knowledge and hands-on Unix scripting - Hadoop (Cloudera Data Platform) basic knowledge and hands-on Data Integration & Project Delivery - Collaborate with business and technical teams to understand data integration requirements and deliver end-to-end data migration/replication solutions. - Participate in data modernization, cloud migration, or analytics platform initiatives. - Develop technical documentation, architecture diagrams, and operational guides. - Support testing, validation, and deployment of data pipelines into production. - Post development, actively plan and implement automation for the Qlik tasks and associated programs before handing over to BAU - Knowledge in CI/CD is a plus The Job Data Ingestion Design & Development - Design, develop, and maintain Qlik Replicate data pipelines for near-real-time and batch data replication between heterogeneous systems (e.g., Oracle, Cloudera, DB2, etc.). - Administer Qlik Replicate servers, monitor task performance, and manage licensing, upgrades, and patches. - Implement best practices for replication task configuration, error handling, and resource optimization. - Troubleshoot data replication issues, performance bottlenecks, and connectivity errors across environments. - Oracle DB knowledge and proficient in writing complex SQL queries and PL/SQL programs - Unix basic knowledge and hands-on Unix scripting - Hadoop (Cloudera Data Platform) basic knowledge and hands-on Data Integration & Project Delivery - Collaborate with business and technical teams to understand data integration requirements and deliver end-to-end data migration/replication solutions. - Participate in data modernization, cloud migration, or analytics platform initiatives. - Develop technical documentation, architecture diagrams, and operational guides. - Support testing, validation, and deployment of data pipelines into production. - Post development, actively plan and implement automation for the Qlik tasks and associated programs before handing over to BAU - Knowledge in CI/CD is a plus BAU Support & Maintenance - Provide Level 2/3 support for production Qlik Replicate environments, ensuring minimal downtime. - Monitor replication tasks, alerts, and logs; perform root cause analysis for incidents. - Coordinate with DBAs, infrastructure, and application teams to resolve issues promptly. - Ensure compliance with data governance, audit, and security standards. - Collaboration & Stakeholder Engagement - Work with business users, data architects, and data analysts to ensure consistent and reliable data delivery. - Participate in team meetings, and cross-functional discussions. - Train or guide junior developers or support staff when required. - Takes accountability in considering business and regulatory compliance risks and takes appropriate steps to mitigate the risks. - Maintains awareness of industry trends on regulatory compliance, emerging threats and technologies in order to understand the risk and better safeguard the company. - Highlights any potential concerns /risks and proactively shares best risk management practices. Mandatory skillsets: - Over 10 years of experience in software engineering, with a strong focus on the Data and AI domain, including hands-on expertise in data engineering - 5+ years of hands-on experience in Qlik Replicate (Attunity Replicate) as both Developer and Administrator. - Strong understanding of relational databases, replication concepts (CDC, full load, incremental load), and data warehousing. - Experience with Qlik Enterprise Manager, Qlik Compose and other related Qlik tools - Proficiency in PL/SQL, SQL, database troubleshooting, and performance tuning. - Familiarity with Linux/Windows scripting, network configuration, and security setup for Qlik Replicate environments. - Hands-on experience in Big Data Hadoop systems is an added advantage - Working experience in Talend ETL tool is a plus - Strong analytical and problem-solving skills, with attention to detail. - Excellent communication and stakeholder management abilities across remote teams. - High level of integrity, takes accountability of work and good attitude over teamwork. - Takes initiative to improve current state of things and adaptable to embrace new changes.