Equifax is searching for a Data Engineering Lead to join our world-class Entity Resolution (Keying & Linking) team within the Global Data & Analytics CoE. The successful candidate will lead our transformation of Entity Resolution capabilities to the Google Cloud and establish processes and practices for linking Equifax, partner and customer data to facilitate insights about businesses and the relationships between them. They may lead a small team of data scientists and data engineers who will explore a wide range of data assets using cutting edge analytics and statistics.
This role requires understanding large, diverse data sources and extensive experience developing data matching and entity resolution rules. Experience linking data about consumers and/or businesses will be critical as well.
Equifax has a hybrid work schedule that allows for 2 days of remote work (Monday and Friday), with 3 days onsite (Tuesday, Wednesday, Thursday) every week.
This role will work the required onsite days at our Equifax office in Alpharetta, GA or Reston, VA.
Sponsorship is not available for this position. This is a direct-hire role and is not open to C2C or vendors.
What you will do
Design, architect, and implement scalable and secure data pipelines on GCP, utilizing services like Dataflow, Pub/Sub, and Cloud Storage.
Develop and maintain data models, ensuring data quality, consistency, and accessibility for various internal stakeholders.
Automate data processes and workflows using scripting languages like Python, leveraging technologies like Spark.
Monitor and troubleshoot data pipelines, identifying and resolving performance issues proactively.
Stay up-to-date with the latest trends and advancements in GCP and related technologies, actively proposing and evaluating new solutions.
Implement data governance best practices, including data security, access control, and lineage tracking.
Lead security initiatives, design and implement security architecture.
Lead data quality initiatives, design and implement monitoring dashboards.
Mentor and guide junior data engineers, sharing knowledge and best practices to foster a high-performing team.
Role requires a solid educational foundation and the ability to develop a strategic vision and roadmap for D&A's transition to the cloud while balancing delivery of near-term results that are aligned with execution.
What experience you will need
BS degree in a STEM major or equivalent discipline; Master's Degree strongly preferred
7+ years of experience as a data engineer or related role, with experience demonstrating leadership capabilities.
A Cloud certification is strongly preferred.
Expert level skills using programming languages such as Python or SQL, NoSQL (or related technologies), and advanced level experience with other scripting languages.
Demonstrated proficiency in all Google Cloud Services.
Experience building and maintaining complex data pipelines, troubleshooting complex issues, transforming and entering data into a data pipeline in order for the content to be digested and usable for future projects.
Experience designing and implementing advanced to complex data models and experience enabling advanced optimization to improve performance.
Experience leading a team with Git expertise strongly preferred.
What could set you apart
Masters Degree or PhD in Data/Computer Science, Statistics, Mathematics, Economics or other related disciplines.
Knowledge of credit bureau data, and familiarity with the laws like FCRA, GLBA, and GDPR.
Experience or advanced degree with focus on Entity Resolution concepts, prototype or hands-on projects related to graph, vector DB, embeddings
Experience in Data Visualization and storytelling.
Experience leading international engagements and collaborating with international teams.
Hands-on code development experience with strong coding ethics.
Working knowledge of MLOps, performance tracking, and state-of-the-art tools & frameworks a plus.
