Staff Engineer, Replication

DDN is seeking a Staff Replication Development Engineer to lead the design and development of the replication engine for the Infinia AI Data Platform. This role focuses on building enterprise-grade asynchronous replication capabilities that enable reliable and secure disaster recovery for large-scale data systems. You will work on developing high-performance replication pipelines, efficient data synchronization mechanisms, and secure data transfer systems. This role requires deep expertise in distributed systems and strong technical leadership to deliver a scalable and resilient replication foundation.   KEY RESPONSIBILITIES - Design and develop multi-threaded asynchronous replication systems with parallel streaming capabilities - Build object-level delta replication with checkpointing and resume functionality - Develop replication engines supporting bucket/share-level replication controls - Implement secure data transfer mechanisms using TLS 1.3 with mutual authentication - Ensure end-to-end data integrity through checksum validation and verification pipelines - Design and implement manual failover workflows for disaster recovery scenarios - Build and maintain REST APIs for replication configuration, control, and automation - Develop metadata tracking and change detection systems to enable efficient replication - Implement RPO visibility, alerting, and operational insights for replication status - Contribute to monitoring dashboards focused on replication health and performance - Ensure systems are designed for high availability, fault tolerance, and scalability - Partner with QA teams to drive performance, resiliency, and scale validation - Collaborate with backend, security, and platform teams to deliver end-to-end replication workflows - Participate in debugging, production issue resolution, and continuous improvement of replication reliability - Provide technical leadership, architectural guidance, and mentorship to the engineering team   REQUIRED QUALIFICATIONS - 8+ years of experience in distributed systems, storage systems, or backend software engineering - Strong programming skills in one or more languages: C++, Go, Java, or Rust - Experience designing and building data replication systems, data pipelines, or distributed data services - Deep understanding of distributed systems concepts (consistency, availability, scalability, fault tolerance) - Strong expertise in multi-threading, concurrency, and parallel processing - Knowledge of networking protocols and secure communication (TCP/IP, HTTP/HTTPS, TLS) - Experience implementing data integrity mechanisms (checksums, validation, consistency checks) - Experience designing and building REST APIs and service-based architectures - Familiarity with checkpointing, failure recovery, and retry mechanisms in distributed systems - Basic understanding of observability concepts (metrics, logging, alerting) - Strong debugging, problem-solving, and system design skills   PREFERRED QUALIFICATIONS - Experience with asynchronous replication, disaster recovery (DR), or backup systems - Familiarity with object storage or large-scale data storage systems - Knowledge of delta encoding, change data capture, or incremental data synchronization techniques - Experience building high-throughput, low-latency data movement systems - Exposure to security practices including mutual TLS, encryption, and authentication - Experience working on enterprise-scale data platforms or storage products - Familiarity with performance optimization and large-scale system tuning