FYST
Lead Data Engineer (Partner Company Role)
Poland
Role brief
What this role is asking for.
YOUR MISSION - Design the target-state data architecture: Postgres CDC → Kafka → Snowflake → client-facing data products. - Own tooling decisions across ingestion, orchestration, transformation, and quality layers. - Implement CDC-based ingestion from PostgreSQL services (RDS, Aurora, EC2, K8s operator) using Debezium or equivalent. - Build streaming and near-real-time pipelines with defined SLAs. - Build a data quality control layer: checksums, reconciliation, schema validation, anomaly detection, and alerting. - Define quality checkpoints across the full pipeline — from source capture through Snowflake to client delivery. - Define and enforce data contracts with service-owning teams for core entities: transaction, merchant, settlement, and processing status. - Build the external data delivery layer: financial settlement, transaction status, processor reconciliation, and client analytics. - Design tenant separation and implement replay/reload mechanisms for failure recovery. - Start hands-on, then gradually hire and grow a small data engineering team as the function matures. Build a pragmatic roadmap with concrete deliverables at 3, 6, and 12 months. WHAT MAKES YOU A GREAT FIT - 5+ years in data engineering with end-to-end ownership of production pipelines. - Hands-on with Snowflake, PostgreSQL CDC (Debezium preferred), and Kafka. - Solid AWS experience — S3, RDS, Aurora, and...
Company role signals