{"id":5651,"date":"2026-02-11T18:28:01","date_gmt":"2026-02-11T18:28:01","guid":{"rendered":"https:\/\/cephasconsult.biz\/?post_type=job_listing&p=5651"},"modified":"2026-03-14T00:15:53","modified_gmt":"2026-03-14T00:15:53","slug":"senior-data-engineer-19492","status":"expired","type":"job_listing","link":"https:\/\/cephasconsult.biz\/?post_type=job_listing&p=5651","title":{"rendered":"Senior Data Engineer 19492"},"content":{"rendered":"

Positions:20 <\/span><\/span>Full Time<\/span><\/p>\n

\n
Experience<\/div>\n
6 – 8 Years<\/div>\n<\/div>\n
<\/div>\n
\n
\n
\n
\n
\n
\n
\n

Experience:<\/strong> 6 – 8 years<\/p>\n

Employment Type:<\/strong> Full-time<\/p>\n

Work Mode:<\/strong> Hybrid (3 days WFO and 2 days WFH)<\/p>\n

Work Timings:<\/strong> Day shift with a few hours of overlap with the US team, as the Reporting Manager is based in the US. The candidate may need to log in around 10:30\/11:00 AM and work until 10:00\/11:00 PM IST, with adequate breaks in between.<\/p>\n

Location:<\/strong> ITC office \u2013 Bagmane Techpark, Bengaluru<\/p>\n

Notice Period<\/strong>: Immediate to 30 days only.<\/p>\n

Role Overview<\/strong><\/p>\n

As a Lead Data Engineer, you will define and drive the enterprise data engineering strategy for our next-generation unified analytics foundation spanning Digital, Stores, and Marketplace channels.<\/p>\n

This role owns the end?to?end data architecture roadmap, including the complete divestiture of Snowflake and successful transition to a Databricks\/Spark Lakehouse ecosystem on AWS, while ensuring ?95% KPI alignment and metric consistency across the enterprise.<\/p>\n

You will operate as both a hands-on technical leader and a strategic architect, influencing platform design decisions, governance models, and modernization programs at global scale.<\/p>\n

Key Responsibilities:<\/strong><\/p>\n

Architecture & Technical Leadership<\/strong><\/p>\n

Define the target-state data architecture for our unified analytics platform using Databricks, Spark, and AWS-native services.<\/p>\n

Own and execute the Snowflake divestiture strategy, ensuring zero residual footprint and seamless continuity of business reporting.<\/p>\n

Lead the design of highly scalable, secure, and cost-efficient data pipelines across batch and streaming workloads.<\/p>\n

Establish architectural standards for data modeling, storage formats, and performance optimization.<\/p>\n

Data Engineering & Platform Strategy<\/strong><\/p>\n

Design and implement ETL\/ELT pipelines using Python, Spark, and SQL, enabling large-scale data transformation and advanced analytics.<\/p>\n

Build pipelines leveraging AWS S3, Lambda, EMR, and Databricks, optimized for reliability and performance.<\/p>\n

Enable real-time and near-real-time data processing using Kafka, Kinesis, and Spark Streaming.<\/p>\n

Drive containerized deployment strategies using Docker and Kubernetes.<\/p>\n

Orchestration, CI\/CD & Infrastructure<\/strong><\/p>\n

Lead global orchestration standards using Apache Airflow for complex, cross-domain workflows.<\/p>\n

Implement CI\/CD pipelines using Git, Jenkins, and enforce best practices for quality, security, and automation.<\/p>\n

Own infrastructure provisioning through Infrastructure as Code (Terraform \/ CloudFormation).<\/p>\n

Data Governance & Enterprise Metrics<\/strong><\/p>\n

Establish and govern enterprise-wide data lineage, cataloging, and access control using Unity Catalog and metadata-driven designs.<\/p>\n

Define and manage metric dictionaries and KPI frameworks, ensuring semantic consistency across domains.<\/p>\n

Partner with analytics, product, and business teams to drive ?95% KPI alignment and trusted insights<\/p>\n

Observability & Operational Excellence<\/strong><\/p>\n

Implement robust monitoring, alerting, and observability across pipelines and platforms.<\/p>\n

Define SLAs, SLOs, and operational playbooks to support mission-critical analytics workloads.<\/p>\n

Mentor and technically guide senior and mid-level engineers, raising the overall engineering bar.<\/p>\n

Must-Have Qualifications<\/strong><\/p>\n

6 to 8+ years of experience in data engineering, distributed systems, and platform architecture with clear technical ownership.<\/p>\n

Deep AWS expertise, including S3, Lambda, EMR, and Databricks in large-scale production environments.<\/p>\n

Advanced Python for data processing, automation, testing, and optimization.<\/p>\n

Advanced SQL expertise for complex querying, windowing functions, data modeling, and performance tuning.<\/p>\n

Demonstrated success in modernizing legacy platforms and migrating complex analytics logic to Databricks\/Spark Lakehouse architectures.<\/p>\n

Strong experience with data governance, lineage, cataloging, and enterprise metric management.<\/p>\n

Certifications (Mandatory):<\/strong><\/p>\n

Databricks Certified Data Engineer \u2013 Professional ( Mandatory)<\/p>\n

AWS Solutions Architect \u2013 Associate or Professional (preferred)<\/p>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n","protected":false},"author":1,"featured_media":0,"template":"","meta":{"_job_location":"Bangalore, Karnataka, India","_application":"hrm@cephasconsult.biz","_company_name":"","_company_website":"","_company_tagline":"","_company_twitter":"","_company_video":"","_filled":0,"_featured":0,"_remote_position":0,"_job_salary":"","_job_salary_currency":"","_job_salary_unit":""},"job-types":[],"class_list":["post-5651","job_listing","type-job_listing","status-expired","hentry"],"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/cephasconsult.biz\/index.php\/wp-json\/wp\/v2\/job-listings\/5651","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/cephasconsult.biz\/index.php\/wp-json\/wp\/v2\/job-listings"}],"about":[{"href":"https:\/\/cephasconsult.biz\/index.php\/wp-json\/wp\/v2\/types\/job_listing"}],"author":[{"embeddable":true,"href":"https:\/\/cephasconsult.biz\/index.php\/wp-json\/wp\/v2\/users\/1"}],"wp:attachment":[{"href":"https:\/\/cephasconsult.biz\/index.php\/wp-json\/wp\/v2\/media?parent=5651"}],"wp:term":[{"taxonomy":"job_listing_type","embeddable":true,"href":"https:\/\/cephasconsult.biz\/index.php\/wp-json\/wp\/v2\/job-types?post=5651"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}