Qualifications
• 6+ years of professional experience in developing data pipelines for large-scale, complex datasets from varieties of data sources.
• Data Engineering expertise with strong experience working with Python, Beautiful Soup, Selenium, Regular Expression, Web Scraping.
• Best practices with Python Development, Doc String, Type Hints, Unit Testing, etc.
• Experience working with Cloud-based data technologies such as Azure Data lake, Azure Data Factory, Azure Data Bricks is optionally desirable.
• Moderate coding skills. SQL or similar required. C# or other languages strongly preferred.
• Outstanding communication and collaboration skills. You can learn from and teach others.
• Strong drive for results. You have a proven record of shepherding experiments to create successful shipping products/services
• A Bachelor or Masters degree in Computer Science or Engineering with coursework in Python, Big Data, Data Engineering is highly desirable.
Skills:- Python, Web Scraping, Regular expression, Big Data, Beautiful Soup, Selenium and SQL