Description: Our client is currently seeking a Azure Data Engineer on W2
Job Description:
Our client is looking for a Senior Data Engineer to join our dynamic and fast-paced team. The ideal candidate will excel in developing data pipelines, orchestrating data, resolving connection issues, solving production problems, and guiding team members. You will play a critical role in leading the development and design of Supply Chain Data Engineering solutions, maintaining high standards of code quality, and reducing technical debt and vulnerabilities across the project. You should be comfortable working in a shared service team and handling multiple initiatives simultaneously.
Required Skills:
Technical Skills: Python, PySpark, Azure Data Factory (ADF), SQL, Azure Data Lake Storage (ADLS), Microsoft Azure, Azure Databricks, Azure Synapse.
GitHub Actions: Experience with setting up and managing CI/CD pipelines using GitHub Actions for smooth and automated deployment processes.
Agile Methodology: Experience working in an Agile/Scrum environment, focusing on iterative development, continuous feedback, and delivery.
Qualifications:
Experience: Proven experience in a similar role with a strong track record as a Senior Data Engineer. Minimum of 7+ years of experience in delivering high-quality data orchestration solutions and leading development teams.
Key Responsibilities:
Development: Work with various data file formats (Avro, JSON, CSV) using PySpark for data ingestion and transformation. Utilize Terraform scripting and DevOps processes.
Lead Development Initiatives: Develop high-quality code and take ownership of different development initiatives, ensuring timely delivery while meeting or exceeding quality standards.
Code Quality and Maintenance: Oversee code quality maintenance and enforce best practices, including code reviews, unit testing, CI/CD, and adherence to coding standards.
Reduce Technical Debt: Identify, prioritize, and implement strategies to reduce technical debt and address codebase vulnerabilities.
Team Leadership: Provide mentorship and guidance to team members, fostering a collaborative, innovative, and high-performance environment.
Collaboration: Work closely with cross-functional teams, including product management, cloud security, line of business (LOB), network security, and DevOps, to integrate features into broader solutions.
Problem Solving: Address and troubleshoot complex technical issues, providing solutions that enhance system performance and user experience.
Documentation: Ensure comprehensive documentation of systems, processes, and code to facilitate knowledge sharing and maintenance.
Stakeholder Communication: Communicate progress, challenges, and solutions to stakeholders, ensuring transparency and alignment with business objectives.
If available and interested, apply now! W2 only.
Contact: mshadab@judge.com
This job and many more are available through The Judge Group. Find us on the web at www.judge.com
