Website Incedo.Inc
Incedo Inc. Recruitment 2026: Senior AWS Data Engineer (New York, NY)
Incedo Inc. is hiring a Senior Data Engineer specialising in AWS cloud-native architectures for its digital and data transformation practice in New York, NY.
This role requires 12+ years of total data engineering experience, with at least 5+ years designing enterprise-scale AWS data platforms. The position focuses on architecting modern Lakehouse platforms, incremental CDC pipelines, metadata-driven ETL frameworks, and optimising Apache Iceberg datasets for high-volume enterprise environments across BFSI, Wealth Management, and Life Sciences.
Job Overview
| Attribute | Details |
| Role | Senior Data Engineer (AWS & Lakehouse) |
| Company | Incedo Inc. |
| Location | New York, NY, United States |
| Experience | 12+ Years Total (5+ Years in AWS Cloud Data Engineering) |
| Industry | Information Technology / Digital & AI Transformation |
| Core Technical Stack | AWS Glue, PySpark, Apache Iceberg, AWS DMS, Athena, Redshift, Lake Formation, Terraform |
| Education | Bachelor’s or Master’s degree in Computer Science, IT, or related engineering fields |
Key Responsibilities
-
Lakehouse Architecture & Pipelines: Design and build scalable Medallion (Bronze, Silver, Gold) data lake architectures, CDC ingestion pipelines, and metadata-driven ETL/ELT frameworks.
-
Apache Iceberg Optimization: Implement partitioning, compaction, schema evolution, and catalog management strategies for Iceberg datasets to minimize query latency and storage overhead.
-
Pipeline Orchestration: Automate end-to-end data workflows using AWS Step Functions, EventBridge, Lambda, and Glue Workflows.
-
Performance Tuning & Cost Optimization: Optimize PySpark configurations, worker types, partitioning, and job bookmarks within AWS Glue and EMR environments.
-
Governance & Security: Configure role-based access control (RBAC), data encryption, masking, and auditing using AWS Lake Formation and IAM policies.
-
Real-Time & Batch Streaming: Integrate batch and stream processing architectures utilizing Kafka, Kinesis, PostgreSQL, Amazon S3, and Amazon Redshift.
-
DevOps & IaC Integration: Build CI/CD pipelines and provision cloud infrastructure using Terraform, AWS CloudFormation, CodePipeline, and GitHub Actions.
Candidate Qualifications & Skill Requirements
Required Qualifications
-
Experience: 12+ years in Data Engineering with 5+ years dedicated to building AWS enterprise data lakes.
-
Core Technical Stack: Advanced proficiency in PySpark, Python, SQL, AWS Glue, AWS DMS, Amazon S3, Redshift, and Athena.
-
Modern Lakehouse Expertise: Hands-on experience with Apache Iceberg metadata management, compaction strategies, and schema evolution.
-
Orchestration & IaC: Mastery of AWS orchestration services and Infrastructure as Code using Terraform or CloudFormation.
-
Data Security: Deep knowledge of cloud governance, data masking, RBAC, and compliance frameworks via AWS Lake Formation.
Preferred Qualifications
-
Domain knowledge in Financial Services, Wealth Management, Capital Markets, or Healthcare/Life Sciences.
-
Certification: AWS Certified Data Engineer – Associate or Solutions Architect / Analytics Speciality certifications.
-
Hands-on expertise with enterprise data observability, lineage tracking, and metadata cataloguing.
-
Master’s degree in Computer Science, Information Systems, or a related discipline.
About Incedo Inc.
Incedo Inc. is a Digital, Data, and AI Transformation Specialist firm headquartered in New Jersey with over 4,500 professionals operating across the U.S., Canada, Mexico, and India. Serving Fortune 500 enterprises across Banking & Payments, Wealth Management, Telecom, Hi-Tech, and Life Sciences, Incedo integrates deep domain expertise, AI/data engineering, and digital operations through proprietary platforms like IncedoPay and Incedo Lighthouse™.
Follow Us