Actively Hiring
BA
Senior Data Engineer
Basis
Auckland
Skills:
Data Science
Job Description
Job Title: Senior Data Engineer
Company: Basis
Job Category: Data Science
Roles & Responsibilities:
##### The Role
* Data infrastructure: architect and maintain data infrastructure for analytics, modelling and reporting across cloud and edge platforms.
* Pipelines: build, maintain and improve batch and streaming data pipelines.
* Automated data quality control: establish pipelines that compare required performance to measured results, evidencing regulatory compliance for our metering business.
* Metering data products: own the reporting and data products that our commercial and regulatory obligations depend on.
* Heterogeneous data: link our products' high\-rate, high\-resolution data with national and global climate, energy and financial data streams.
* Models: own the energy \& savings models, their validation and the fleet reporting behind them.
* Data best practices: enforce the quality, security, governance, availability and lineage of data across the platform.
* Testing and standards: set up and maintain test frameworks, including continuous integration and data QC; supply data for systems integration testing; and review peers' code to lift data engineering standards across the team.
* 5\+ years in a data engineering role building end\-to\-end ETL pipelines and datasets, and working with data warehouses, data lakes and the associated infrastructure, ideally with high\-rate time\-series or sensor data
* Experience building, maintaining and improving batch and streaming data pipelines
* Experience with SQL and NoSQL databases, and storage optimised for high\-speed time series data
* Experience implementing DevOps practices within the data platform, including CI/CD, data observability, monitoring and lineage
* The ability to write software in at least two of: C, C\+\+, C\#, Rust, Go, Python, JavaScript
* An understanding of the wider system beyond software, and the ability to articulate the impact of systems decisions on software and vice versa
* A track record of working with a high degree of autonomy and owning systems end to end
* Comfort with uncertainty and a team\-first attitude: you work well in a cross\-disciplinary team and contribute to the overall product
If you have any questions about the role, fire them over to talent@wearebasis.com.
Work Location: Auckland, Auckland, New Zealand
Availability: Full time
Requirements
* Experience with Go
* Streaming protocols such as MQTT or ZMQ
* Log processing, especially with Fluentd
* Query engines over data lakes (e.g. Athena/Trino, BigQuery)
* Experience with custom electronics or real\-time sensor data
* A background in signal processing or data science
* Experience in regulated or metering data environments
##### Benefits
Key Skills: Data Science
Salary: NZD 88500 - 150000 per yearly