Job Description:

Facility: VIRTUAL-GA



Job Summary:



The Senior Data Engineer is responsible for overseeing junior data engineering activities and aiding in building the business' data collection systems and processing pipelines. This includes ensuring that data services securely and seamlessly integrate with other data platform technologies or application services for example: Azure Cognitive Services, Microsoft Customer Insights, or Dynamics365.
The role of the Senior Data Engineer is responsible for building and maintaining optimized and highly available data pipelines across on-premises and in the cloud that facilitate deeper analysis and reporting by the Data and Analytics teams.
The Senior Data Engineer builds data processing frameworks that handle the business's growing database. Senior Data Engineer works with senior data science leadership as well as other Data and Analytics teams in leveraging data with reporting and scientific tools, for example, Tableau and PowerBI. The Senior Data Engineer strives to continuously develop new and improved data engineering capabilities.




Core Responsibilities and Essential Functions:



Lead technical efforts to drive Datalake evolution, data pipeline buildout
* Coordinate with data science members and deliver use case specific datasets.
* Developing new data validation methods
* Writing accurate queries, ETL logic, and ELT logic
* Sorting and stitching data
* Determining and evaluating new data sources
* Developing data pipelines based on requirements
* Collecting requirements for data models
* Managing real-time data and making sure its secure
Design and propose enhancements and optimizations of data transformation process
* Continuously design and deliver effective data sets and propose possible improvements and optimizations
* Ensure Data wrangling efforts are streamlined and raw data is converted into trusted data
* Aid data scientists in refining their models by delivering trustworthy datasets on a timely manner
* Stay up-to-date on best-practices and drive adoption
Day-to-day management of open issues
* Interface with Product Managers, Data Scientists, Business Analysts, QA, Development team members to test, identify, and correct issues in new and pre-existing solutions
* Coordinate with data configuration, cloud platform and systems teams to ensure seamless(real-time/batch) flow of data from source systems to Data Lakes and Warehouses
Performs other duties as assigned
Complies with all WellStar Health System policies, standards of work, and code of conduct.




Required Minimum Education:



Bachelor's Degree Computer Science or related field. Required and
An additional 4+ years of professional work experience is acceptable in lieu of formal degree. Required




Required Minimum License(s) and Certification(s):



All certifications are required upon hire unless otherwise stated.

Additional License(s) and Certification(s):





Required Minimum Experience:



Minimum 6 years Database systems (SQL and NoSQL), Data warehousing solutions, ELT and ETL tools Required and
Proficiency with at least one modern programming language (e.g. Python, Java, Scala, or C#) Required and
Experience with Machine learning Preferred and
Experience with Data APIs Preferred and
Proficiency in software engineering Preferred and
Experience in clinical data and CRM systems Preferred and
Experience with DataWarehouse and DataLake concepts Preferred and
Experience with cloud computing Preferred and
Experience building real-time and batch data pipelines Preferred




Required Minimum Skills:



Proficiency with multiple programming languages (e.g. SQL, .NET, Python, JavaScript)
Understanding of distributed systems
Understanding of algorithms and data structures. Working knowledge of software development practices and processes
Working knowledge of one or more Cloud platforms (Azure preferred)
Excellent communication and collaboration skills Apply Now