Azure Cloud Engineer
Your Role
As an Azure Platform Engineer with the Area Global Analytics Platform within Rabobank, you will play a pivotal role in designing, implementing, and maintaining a robust analytics platform. Your responsibilities will include setting up and managing Azure services such as Azure Databricks and Azure Machine Learning. You will collaborate closely with stakeholders to understand their requirements and translate them into technical solutions. Additionally, your role will also involve automating workflows and ensuring seamless integration with various data sources. Monitoring and troubleshooting the platform to ensure high availability and reliability will be key aspects of your job. Furthermore, you will stay updated with the latest Azure technologies and best practices to continuously improve the platform’s capabilities.
Key Responsibilities
Architecture and Design:
- Shape the strategic technology direction of our data platform.
- Architect scalable and efficient data solutions using Azure Databricks.
Integration:
- Ensure seamless data integration across various systems.
- Optimize data processing workflows for efficiency and performance.
Infrastructure Automation:
- Develop and maintain Terraform Infrastructure as Code (IaC) scripts to automate Databricks environment deployments.
Performance Monitoring and Tuning:
- Monitor and analyze the performance of databases and data pipelines.
- Fine-tune and optimize the data platform to ensure optimal performance and resource utilization.
Required Qualifications:
- 3-5 years of experience as a Platform Engineer or similar role, focusing on deploying, optimizing, and maintaining large-scale analytics platforms.
- Hands-on expertise in Azure Databricks and data architecture.
- Proficiency in writing clear and maintainable code, with Python experience being a significant plus.
- Experience with Infrastructure as Code (IaC), preferably Terraform.
- Experience with CI/CD, preferably in Azure DevOps.
- Knowledge of containerization technologies like Docker and Kubernetes, particularly for deploying and managing data services.
- Excellent problem-solving skills and the ability to work collaboratively in a team environment.
- Proactive attitude towards learning new technologies and staying updated with industry trends.
Preferred Qualifications:
- Certification in Microsoft Azure or related technologies.