{"id":5503,"date":"2026-01-28T16:56:01","date_gmt":"2026-01-28T16:56:01","guid":{"rendered":"https:\/\/cephasconsult.biz\/?post_type=job_listing&p=5503"},"modified":"2026-02-28T00:18:01","modified_gmt":"2026-02-28T00:18:01","slug":"data-engineer-data-bricks-85","status":"expired","type":"job_listing","link":"https:\/\/cephasconsult.biz\/?post_type=job_listing&p=5503","title":{"rendered":"Data Engineer-Data Bricks 85"},"content":{"rendered":"
\n
\n
\n

Position-1: Data Engineer \u2013 Databricks<\/strong><\/p>\n

No. of Positions: 2<\/strong><\/p>\n

Experience: 5+ years<\/strong><\/p>\n

Location: Bangalore (onsite-5days)-no relocation candidates<\/strong><\/p>\n

LPA: L<\/strong><\/p>\n

please go through the bold words<\/strong><\/p>\n

Notice period-immediate joiners\/serving notice period<\/strong><\/p>\n

Job Description<\/strong><\/p>\n

Role:<\/strong>\u00a0Databricks PySpark Developer<\/p>\n

Role Overview<\/strong><\/p>\n

We are looking for a\u00a0highly skilled Databricks PySpark Developer<\/strong>\u00a0to join our data platform implementation team. In this role, you will be responsible for designing, developing, and optimizing scalable ETL pipelines and data workflows using Databricks and Apache Spark. You will work closely with data engineers, data scientists, and BI teams to support advanced analytics and reporting requirements.<\/p>\n

Key Responsibilities<\/strong><\/p>\n

1. ETL Development & Data Engineering<\/strong><\/p>\n

    \n
  1. Design, develop, and maintain scalable ETL processes using\u00a0Databricks PySpark<\/strong>.<\/li>\n
  2. Extract, transform, and load data from heterogeneous sources into\u00a0Data Lake and Data Warehouse<\/strong>\u00a0environments.<\/li>\n
  3. Optimize ETL workflows for\u00a0performance, scalability, and cost efficiency<\/strong>\u00a0using Spark SQL and PySpark.<\/li>\n
  4. Implement\u00a0robust error handling, logging, and monitoring<\/strong>\u00a0mechanisms for ETL jobs.<\/li>\n
  5. Design and implement data solutions following\u00a0Medallion Architecture (Bronze, Silver, Gold layers)<\/strong>.<\/li>\n
  6. Ensure data is\u00a0cleansed, enriched, validated, and optimized<\/strong>\u00a0at each layer for analytics consumption.<\/li>\n<\/ol>\n

    2. Data Pipeline Management<\/strong><\/p>\n

      \n
    1. Hands-on experience in building and managing\u00a0advanced data pipelines using Databricks Workflows<\/strong>.<\/li>\n
    2. Develop and maintain reliable, reusable, and scalable pipelines ensuring\u00a0data quality and integrity<\/strong>.<\/li>\n
    3. Collaborate with cross-functional teams to translate business and analytics requirements into efficient data pipelines.<\/li>\n<\/ol>\n

      3. Data Analysis & Query Optimization<\/strong><\/p>\n

        \n
      1. Write, review, and optimize\u00a0complex SQL queries<\/strong>\u00a0for data transformation, aggregation, and analysis.<\/li>\n
      2. Perform query tuning and performance optimization on large-scale datasets within Databricks.<\/li>\n<\/ol>\n

        4. Project Coordination & Continuous Improvement<\/strong><\/p>\n

          \n
        1. Participate in\u00a0project planning, estimation, and delivery<\/strong>\u00a0activities.<\/li>\n
        2. Stay updated with the latest features in\u00a0Databricks, Spark, and cloud data platforms<\/strong>, and recommend best practices.<\/li>\n
        3. Document ETL processes, data lineage, metadata, and workflows to support\u00a0data governance and compliance<\/strong>.<\/li>\n
        4. Mentor junior developers and contribute to team knowledge sharing where required.<\/li>\n<\/ol>\n

          Required Qualifications<\/strong><\/p>\n

            \n
          1. Bachelor\u2019s degree in\u00a0Computer Science, Engineering, or a related field<\/strong>.<\/li>\n
          2. 5+ years of experience<\/strong>\u00a0in ETL\/Data Engineering roles with strong focus on\u00a0Databricks PySpark<\/strong>.<\/li>\n
          3. Strong proficiency in\u00a0Python<\/strong>, with hands-on experience in developing and debugging PySpark applications.<\/li>\n
          4. In-depth understanding of\u00a0Apache Spark architecture<\/strong>, including RDDs, DataFrames, and Spark SQL.<\/li>\n
          5. Expertise in\u00a0SQL development and optimization<\/strong>\u00a0for large-scale data processing.<\/li>\n
          6. Proven experience working with\u00a0data warehousing concepts and ETL frameworks<\/strong>.<\/li>\n
          7. Strong problem-solving and troubleshooting skills.<\/li>\n
          8. Excellent communication and collaboration skills.<\/li>\n<\/ol>\n

            Preferred Qualifications<\/strong><\/p>\n

              \n
            1. Experience working on\u00a0cloud platforms<\/strong>, preferably\u00a0AWS<\/strong>.<\/li>\n
            2. Hands-on experience with tools such as\u00a0Databricks, Snowflake, Tableau<\/strong>, or similar data platforms.<\/li>\n
            3. Strong understanding of\u00a0data governance, data quality, and best practices<\/strong>\u00a0in data engineering.<\/li>\n
            4. Relevant certifications in\u00a0Databricks, PySpark, Spark SQL<\/strong>, or cloud technologies.<\/li>\n<\/ol>\n<\/div>\n<\/div>\n<\/div>\n
              \n

              ? Company Bio<\/h3>\n
              \n
              We are a Global Professional Human Capital Management firm offering agile, innovative and cost effective services to suit our clients’ business.<\/div>\n<\/div>\n<\/div>\n
              \n
              \n

              ? Job Requirements<\/h3>\n
              \n
              Qualification:<\/span>BE<\/span><\/div>\n
              Experience:<\/span>5-10 years<\/span><\/div>\n
              Industry:<\/span>IT<\/span><\/div>\n<\/div>\n<\/div>\n
              \n

              ? Employment Details<\/h3>\n
              \n
              Positions:<\/span>2<\/span><\/div>\n
              Type:<\/span>Full Time<\/span><\/div>\n
              Work Type:<\/span>Work From Office<\/span><\/div>\n
              Gender:<\/span>Any<\/span><\/div>\n<\/div>\n<\/div>\n<\/div>\n","protected":false},"author":1,"featured_media":0,"template":"","meta":{"_job_location":"Bangalore","_application":"hrm@cephasconsult.biz","_company_name":"","_company_website":"","_company_tagline":"","_company_twitter":"","_company_video":"","_filled":0,"_featured":0,"_remote_position":0,"_job_salary":"","_job_salary_currency":"","_job_salary_unit":""},"job-types":[],"class_list":["post-5503","job_listing","type-job_listing","status-expired","hentry"],"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/cephasconsult.biz\/index.php\/wp-json\/wp\/v2\/job-listings\/5503","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/cephasconsult.biz\/index.php\/wp-json\/wp\/v2\/job-listings"}],"about":[{"href":"https:\/\/cephasconsult.biz\/index.php\/wp-json\/wp\/v2\/types\/job_listing"}],"author":[{"embeddable":true,"href":"https:\/\/cephasconsult.biz\/index.php\/wp-json\/wp\/v2\/users\/1"}],"wp:attachment":[{"href":"https:\/\/cephasconsult.biz\/index.php\/wp-json\/wp\/v2\/media?parent=5503"}],"wp:term":[{"taxonomy":"job_listing_type","embeddable":true,"href":"https:\/\/cephasconsult.biz\/index.php\/wp-json\/wp\/v2\/job-types?post=5503"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}