The Agency is recruiting for a Data Engineer on behalf of our client.

Large-Scale Data Engineering: Work on a high-impact enterprise data platform handling complex ingestion, transformation, and master data management across multiple business domains.

Modern Technology Stack: Build innovative data solutions using AWS, Kafka, Java, Python, and lakehouse architecture in a cloud-native environment.

Technical Ownership: Play a key role in designing scalable, reliable data pipelines while influencing data quality, governance, and platform performance.

• Design and maintain scalable batch and streaming data ingestion pipelines for multiple source systems.
• Develop and manage medallion-layer data architecture with monitoring, orchestration, and recovery capabilities.
• Implement data quality, reconciliation, and validation processes to ensure data accuracy and integrity.
• Build and enhance identity resolution, master data management, and source-to-canonical data mappings.

• 5 years of experience building large-scale production data pipelines.
• Strong expertise with Kafka, SQL, ETL processes, and Java and/or Python development.
• Experience with lakehouse architecture, CDC, batch/stream processing, and data quality frameworks.
• Knowledge of master data management, schema evolution, and governed data mapping practices.

Salary: DOE

If this sounds like a good match for you and you would like to learn more, we would welcome your application. Go ahead and apply.

We believe in inclusive workplaces and we are happy to consider any reasonable adjustments that candidates may require during the recruitment process; you will be asked if you require any during the application process. If you’d like to request additional options, please email patrick@theagency.ky.