Azure DataFactory Developer
Job Description
Roles & Responsibilities
• Design, develop, and maintain scalable data pipelines and ETL processes using Azure Databricks, Data Factory, and other Azure services
• Implement and optimize Spark jobs, data transformations, and data processing workflows in Databricks
• Develop and integrate custom machine learning models using Azure Machine Learning, MLflow, and other relevant libraries
• Leverage Azure DevOps and CI/CD best practices to automate the deployment and management of data pipelines and infrastructure
• Good to have Basic ETL understanding.
• Responsible for gathering system requirements working together with application architects & owners
• Responsible for generating scripts and templates required for the automatic provisioning of resources
Salary Range: $115,000-$130,000 a year