Senior Data Engineer

About Us
  
Our client is a data intelligence company that uses real-time data and machine learning to disrupt how antiquated industries find new business and market opportunities.
  
Our beachhead audience is the construction industry, where we are developing a platform for relationship-based business development teams. Our goal is to improve the effectiveness of business developers by connecting them with the right person, about the right project, at the right time and disrupting the need for bidding platforms.
  
What we’re looking for:   

• A data engineer with experience designing, building and implementing scalable data pipelines
• An individual with experience in data/statistical analysis, user behaviour tracking, and site tagging
• A critical thinker who’s able to brainstorm with a team of diverse skillsets.
• A self-starting individual hungry to run and lead within a fast-growing startup

  
Skills:   

• Strong programming skills in Python and SQL
• Extensive experience with modern ETL and data pipeline tools (e.g. EMR, AWS Glue, AWS Data Pipeline, Airflow, DBT)
• Data governance concepts and security (PII, Data Quality, Data Management)
• Experience contributing to the architecture and design (architecture, design patterns, reliability and scaling) of new and current systems
• Deep understanding of best practices and AWS infrastructure
• Proven experience working across with diverse data sets and discovering how they can link within a data ecosystem
• Exceptional problem-solving and decision-making skills, and fast learning capability.
• Proven knowledge of continuous delivery and approaches to continuous integration
• Experience in the construction industry a bonus

  
Day-to-day activities:   

• Data exploration, requirements gathering, and interpreting data
• Design, develop, and deploy data quality validations written in Python to drive quality improvements and standards across the team, improving areas such as accuracy, completeness, consistency and reliability.
• Write clean, functional code for large-scale distributed applications
• Design, execute, and record experiments to track, test, and validate the proposed solutions
• Work closely with Architecture, Software Engineering, and Cloud Operations teams to implement, deploy and maintain market data acquisition pipelines
• Owning the delivery of analytics and data roadmaps

What we’re offering:   

• A ground-level experience working for a fast-growing startup in a role with unlimited potential for growth
• The opportunity to collaborate with passionate, innovative and humble people in a highly dynamic environment
• The freedom to explore, create, learn, fail and succeed together