Job Description:
Location: Cincinnati, OH
Salary: $50.00 USD Hourly - $55.00 USD Hourly
Description: Our client is currently seeking a Data Tester for a W2 contract
Job Description:
- We are looking for an ETL Tester with skills in Python, Databricks, and Google Cloud Platform (GCP) to join our data engineering team.
- Your main job will be to check and ensure the quality of our ETL processes and support data integration.
- You will work with data engineers, analysts, and other stakeholders to make sure our data pipelines are accurate and reliable.
Key Responsibilities:
ETL Process Validation:
- Check ETL processes in GCP to ensure data integrity.
- Create and run test cases to ensure data transformations meet business needs.
Data Quality Assurance:
- Perform data profiling and quality checks to find and fix data issues.
- Monitor and report on data quality metrics.
Test Case Development:
- Develop and maintain test plans and test cases based on ETL specifications.
- Ensure all ETL processes are fully tested.
Collaboration:
- Work with data engineers, data scientists, and stakeholders to understand ETL workflows.
- Participate in design reviews to provide testing input.
Automation:
- Use Python to create automated testing scripts for ETL validation.
- Use Databricks notebooks for efficient ETL testing.
Workflow Management:
- Use Apache Airflow to schedule, monitor, and manage ETL workflows.
- Troubleshoot and optimize Airflow DAGs with the team.
Issue Tracking and Resolution:
- Identify, document, and track defects and data quality issues.
- Work with engineering teams to quickly resolve data problems.
Documentation:
- Keep clear documentation of testing processes, test cases, and results.
- Document data mappings, transformation rules, and data flow diagrams.
Continuous Improvement:
- Help improve ETL testing methods and data management practices.
- Stay updated on GCP, Databricks, and industry trends to enhance testing strategies.
If available and interested, apply now! W2 only.
Contact: mshadab@judge.com
This job and many more are available through The Judge Group. Find us on the web at www.judge.com
