Azure Databricks Developer

Job Title

Azure Databricks Developer

Role Overview

The Azure Databricks Developer will work on agile development projects using Azure Databricks, Python, PySpark, and Delta Lake to build, optimize, and maintain cloud‑based data solutions. This role is ideal for fresh graduates who are passionate about data engineering, cloud technologies, and analytics, and who enjoy problem‑solving in a collaborative environment.

Key Responsibilities

• Develop and implement data integration solutions on Microsoft Azure
• Build and maintain PySpark notebooks using Azure Databricks
• Develop and manage Delta Lake tables and workflows
• Perform data analysis to troubleshoot data‑related issues and support resolution
• Write and optimize queries, including joins, duplicate record identification, and data validation
• Support cloud data migration initiatives from legacy systems
• Maintain and monitor data pipelines to ensure reliability and performance
• Optimize Spark and Databricks workloads for performance and scalability
• Work in agile development environments, contributing to sprint planning and delivery
• Act as an individual contributor with strong ownership and problem‑solving skills

Qualifications & Specialization

Educational Qualification

• Bachelor’s or Master’s degree (preferred) in Engineering, Computer Science, Data Science, AI, or a related discipline

Technical Skills & Knowledge

• Programming languages: Python, PySpark
• Strong understanding of databases and data querying
• Ability to write efficient queries (joins, duplicate identification, aggregations, etc.)
• Experience or academic exposure to agile development and sprint‑based delivery
• Familiarity with: 
  • Azure Databricks
  • Azure Data Factory (ADF)
  • Delta Lake
• Strong communication, analytical, and problem‑solving skills

Unique Experience Offered by This Role

• Hands‑on development of PySpark notebooks
• Building and managing Delta tables and end‑to‑end workflows
• Performance tuning and optimization of data pipelines
• Exposure to cloud‑based data migration projects
• Experience maintaining scalable, production‑grade data pipelines on Azure

Learning & Growth Outcomes

In this role, the Azure Databricks Developer will:

• Learn to develop Databricks notebooks and build Delta Lake tables and workflows
• Gain hands‑on experience creating data pipelines using Azure Data Factory (ADF)
• Learn to ingest data from multiple sources using Azure services
• Gain experience transforming data using Azure Databricks and Delta Lake
• Become familiar with Azure DevOps CI/CD, including story tracking, bug handling, and issue management
• Learn and apply performance optimization techniques in cloud data platforms
• Strengthen data analysis and insight generation skills
• Build foundational consulting skills such as requirement analysis, documentation, and stakeholder communication
• Gain exposure to data and application (process) migration from legacy systems to cloud environments
• Prepare for career growth into roles such as: 
  • Senior Azure Databricks Developer
  • Cloud Data Engineer
  • Advanced Analytics / AI‑enabled Data Roles