Senior Azure Data Engineer (W2 only)
Role: Azure Data Engineer Location: Remote Job Summary We are seeking a highly skilled Azure Data Engineer with strong expertise in Databricks, Azure data services, and modern data engineering practices. The ideal candidate will have hands-on experience designing, building, and optimizing scalable data pipelines and enterprise-grade lakehouse architectures in hybrid cloud environments.Key Responsibilities
- Design, build, and orchestrate scalable data pipelines using Azure-native services.
- Develop and optimize batch and near real-time data processing solutions using Spark and Databricks.
- Implement and manage enterprise-grade Lakehouse architectures (Medallion architecture).
- Perform data processing, validation, and automation using Python (PySpark, Pandas, NumPy).
- Optimize performance of large-scale data systems, including Spark tuning and query optimization.
- Work with CDC (Change Data Capture) pipelines and large-volume data ingestion.
- Collaborate with cross-functional teams to deliver secure, scalable, and high-performance data platforms.
- Implement CI/CD pipelines and DevOps best practices for data engineering workflows.
Required Skills & Experience
- Strong experience with Azure Databricks, including notebooks, clusters, and Delta Lake.
- Hands-on expertise in Azure Data Factory (ADF) and pipeline orchestration.
- Proficiency in Python (PySpark, Pandas, NumPy) and SQL.
- Experience with Spark SQL, performance tuning, and distributed data processing.
- Solid understanding of Azure ecosystem: ADLS, Synapse Analytics, Azure Functions, Event Grid, Key Vault, Purview.
- Must have Experience with Tableau and Power BI
- Knowledge of dimensional data modeling and analytics solutions.
Pay: Up to $55.00 per hour Work Location: Remote