What you'll do:

• Support our data modelling efforts to ensure we are capturing the data needed to improve our modelling and analytic capabilities.
• Develop and maintain data applications in Python and / or Scala across various data formats and architectures, including:
• SQL, Clickhouse, MongoDB, AWS S3, Azure App Insights, csv, JSON, parquet, Protobuf
• Airflow, Docker, Bash, SFTP, AWS Lambda, ECS
• Evaluate and ensure data integrity across various formats through mature, high quality, well organized application code with fully developed unit and integration testing and telemetry

What makes you a great fit:

• 6+ years’ experience developing, maintaining, and testing big data pipelines
• A strong technical advocate with a background in Python or Scala + SQL. Preferably familiar with both on-prem and cloud data systems, for example, AWS or Azure; SQL and NoSQL
• Experience with shell scripting and Unix command line, as well as virtual environments.
• Strong understanding of data modeling and ETL / ELT best practices
• Preferred Qualifications
• Experience with CI/CD infrastructure and a strong supporter of unit / integration testing
• Experience with Docker, VMs and container technologies (ie Kubernetes)