Python Developer
Main Responsibilities:
- Develop Python scripts for Databricks Notebooks.
- Convert existing C# code (ETL Script) into Python (Databricks Notebook).
- Develop unit and integration tests.
- Automate processes.
- Develop execution job tracking dashboards – monitoring.
- Implement an Azure DevOps / GIT CI/CD pipeline for Python code deployment in Notebooks.
- Implement an Azure DevOps / GIT CI/CD pipeline for PowerBi report deployment.
- Create Dev/Cert/Prod environments.
- Create deployment pipelines with authorization flow.
- Document standards and norms for the aforementioned subjects.
Desired Profile:
- Minimum 3-5 years of sustained experience.
- Python language.
- Databricks, Notebook in Databricks.
- DeltaLake notion.
- Azure Synapse knowledge.
- Apache Spark knowledge.
- ETL.
- Canonical model knowledge.
- JSON.
- Azure Data Lake.
- SQL language.
- Azure DevOps / GIT.
- Azure Pipeline – CI/CD (Continuous Integration/Continuous Delivery).