Job Details

Data Engineer

Houston, TX | Contract

Job ID:

117-001DE

Duration:

Long Term

Experience:

3-5 years

Career Level:

Senior Level

Compensation:

DOE

Industry:

Information Technology and Services

Job Description

The Data Engineer provides business analysts, data scientists and reporting and analysis tools with timely and accurate data.

RESPONSIBILITIES

  • Develop data pipelines to extract, transform, and load data using SQL and Python
  • Design, deploy, and maintain services in our growing Azure-based data infrastructure
  • Partner with our data analysts to research and develop requirements for new features
  • Research systems and APIs to find the best way to connect to third-party datasets
  • Design database schemas and queries to ensure performance
  • Write automated tests to monitor and ensure end to end data quality
  • Work with data scientists to experiment with and deploy machine learning models
  • Consult with teams across to provide expertise, guidance, and support using data
  • Other duties as assigned

REQUIREMENTS

  • 2+ years experience writing performant, maintainable, and scalable Python services
  • Experienced deploying and maintaining high-availability services in production
  • Experience with one or more data pipeline platforms like Airflow, Stitch, or others
  • Proficiency with automated testing using tools like pytest
  • Familiarity with one or more cloud platforms such as Azure, AWS, GCP, etc.
  • Interest or practical experience with data analysis and visualization an asset
  • Practical experience with software development processes and tools such as Scrum, code reviews, GitHub, Jira, etc.