Data Engineer - SQL/Python

XL Advisors

Job Description :

Qualification :

- Bachelors in Engineering (CS/IT) and above with a bent towards analytics.

- Cloud certifications (AWS/Azure) will be a plus

Skills/ Experience :

- Ability to engage with stakeholders to understand business requirements and convert the same into technical problems for solution development

- Knowledge of creating notebooks using Azure data factory/data bricks/synapse.

- Should have worked on the orchestration of data using these resources

- A working knowledge of/experience in Spark-SQL or python / pyspark is a must.

- Experience in handling large volumes of data, data cleansing & data preparation

- Candidate should have worked hands-on on automating day-to-day jobs (Data Lake/Data Warehousing jobs) either schedule-based or event-based (via Job Management Framework)

- Strong knowledge of deployment/releases via Azure DevOps (CI/CD)

- Managed GIT/Azure epositories for Branching and Merging

- Knowledge of data visualization tools (Power BI, Tableau) is an added advantage

- Candidate must be a strong team player

Skills : Spark-SQL, Python/Pyspark, Azure Data Bricks, Azure Synapse, Azure Data Lake