Senior AWS Data Engineer

Job Title: Senior AWS Data Engineer Company: RITWIK IT SERVICES PRIVATE LIMITED Job Category: Data Science Roles & Responsibilities: Role Overview This role requires an independent technical contributor who can work directly with clients and stakeholders, provide technical consulting, mentor engineers and drive engineering excellence. Key Responsibilities * Design, develop and maintain scalable ETL/ELT pipelines on AWS\-based data platforms. * Build reusable engineering components using Python, SQL and PySpark. * Implement automated testing, monitoring, exception handling and recovery mechanisms. * Troubleshoot production issues, perform root\-cause analysis and implement preventive measures. * Apply data modelling, metadata management, security and governance practices. * Maintain technical documentation, operational runbooks and knowledge\-transfer materials. * Collaborate with platform engineering, operations, data owners and business stakeholders. * Identify and resolve performance bottlenecks across data ingestion, transformation, storage and query execution. * Optimise complex SQL queries and Spark/PySpark workloads. * Analyse execution plans, resource utilisation, data skew, shuffle operations and memory behaviour. * Improve partitioning, file sizing, compression, join strategies and incremental processing. * Tune AWS Glue, Amazon Redshift, Amazon Athena and other relevant processing environments. * Conduct workload benchmarking, concurrency testing and capacity analysis. * Establish performance baselines and validate improvements through repeatable testing. * Document measurable improvements in runtime, throughput, resource consumption and cloud costs without compromising data quality. * Excellent communication, comprehension and articulation skills. * Strong persuasion, negotiation and stakeholder\-management abilities. * Ability to inspire and mentor technical teams. * Capable of working independently as a technical consultant for clients and engagements. * Strong individual contributor mindset with ownership and accountability. * Ability to mentor engineers on coding best practices and problem\-solving techniques. * Opportunities to participate in organisation\-wide innovation and continuous improvement initiatives. * Exposure to multiple products and projects across various ISVs. * Fortnightly organisational sessions to understand business and functional directions. * Opportunities to interact with leadership and colleagues across the organisation. * Employee engagement activities, celebrations and team\-building initiatives. * Chimera Talks – a platform to share opinions and ideas beyond day\-to\-day work. * Annual year\-end bonuses. * Hybrid working flexibility. Candidates must be comfortable with the 2:00 PM – 11:00 PM IST shift and working from the Chimera Office 2–3 days per week. Work Location: Bengaluru, India Availability: Full time

We are looking for experienced AWS Data Engineers with strong expertise in data engineering, distributed processing and performance optimisation. The ideal candidate should have hands\-on experience building scalable ETL/ELT pipelines, optimising large\-scale data workloads and delivering reliable data solutions on AWS. Mandatory Technical Skills * Advanced SQL skills and strong proficiency in Python and PySpark. * Experience with Apache Spark and distributed data processing. * Experience with orchestration tools such as Apache Airflow. * Strong understanding of data lakes, lakehouse architectures, data warehouses and dimensional modelling. * Experience with Git, CI/CD pipelines, automated testing and production support. * Ability to translate business requirements into scalable and maintainable technical solutions. Specialist Requirements – Performance Optimisation * Deep expertise in SQL query tuning and distributed processing optimisation. * Strong understanding of Spark execution, partitioning, caching, joins and resource configuration. * Experience troubleshooting large\-scale AWS data workloads. * Knowledge of storage layouts, columnar file formats and efficient data\-access patterns. * Ability to balance performance, reliability, scalability and cloud expenditure. * Real\-time and streaming data experience with Apache Kafka and/or Amazon Kinesis. * Exposure to Generative AI concepts and tools, including: + Amazon Bedrock + LLM concepts + Embeddings + Vector databases * Experience with Excel/CSV ingestion, template\-driven ingestion and schema evolution handling. Soft Skills The final interview round will be conducted face\-to\-face at the Chimera Office. Key Skills: Python, SQL Salary: INR 800000 - 1.8e+06 per yearly