Actively Hiring
MU
Senior Data Engineer - Databricks & DBT
Multiverse Solutions
Noida
Skills:
Python
SQL
Job Description
Job Title: Senior Data Engineer - Databricks & DBT
Company: Multiverse Solutions
Job Category: Data Science
Roles & Responsibilities:
Key Responsibilities
1. Design, develop, and implement scalable end\-to\-end data pipelines using Databricks and DBT.
2. Lead the development of data transformation workflows using DBT, including models, macros, snapshots, tests, and incremental models.
3. Develop and optimize complex data processing solutions using Python, PySpark, and SQL.
4. Work extensively with Databricks, Delta Lake, and Lakehouse architecture.
5. Design and implement robust ETL/ELT processes for large\-scale structured and unstructured datasets.
6. Build and maintain data integration solutions across multiple data sources.
7. Optimize Databricks workloads, Spark jobs, SQL queries, and DBT models for performance and cost efficiency.
8. Implement data quality checks, validation frameworks, testing, and monitoring.
9. Work with cloud platforms such as AWS, Azure, or GCP.
10. Implement CI/CD pipelines, version control, and deployment strategies for data engineering projects.
11. Collaborate with Data Architects, Data Scientists, Business Analysts, and cross\-functional teams.
12. Provide technical leadership, mentor junior engineers, and conduct code reviews.
13. Troubleshoot production issues and ensure data pipeline reliability and availability.
* Databricks
* Strong hands\-on experience
* DBT
* Advanced experience in DBT Core / DBT Cloud
* Python
* Advanced programming skills
* PySpark
* Strong development experience
* SQL
* Advanced SQL and query optimization
* Delta Lake
* Delta tables, Lakehouse architecture
* ETL/ELT
* End\-to\-end pipeline development
* Cloud
* AWS / Azure / GCP
* Data Warehousing
* Snowflake / Azure Synapse / Redshift
* Orchestration
* Airflow / Azure Data Factory
* CI/CD
* Git, GitHub, Azure DevOps
Work Location: Noida, India
Availability: Full time
Requirements
Job Title: Senior Data Engineer \- Databricks \& DBT
Experience: 10\+ Years
Primary Skills: Databricks, DBT, Python, PySpark, SQL
Contact: Nikhil.vats@multiversetech.com
Location: Noida
Required Technical Skills
Mandatory Requirements
Key Skills: Python, SQL
Salary: INR 1.5e+06 - 2.5e+06 per yearly