Description: Job Title: Software Engineer/Big Data Production Support
Location: Iselin, NJ
Job Description:
We are seeking a highly skilled Software Engineer with expertise in Big Data Production Support to join our Data Engineering team. This role involves providing production support, coordinating with various teams, and ensuring the availability and performance of our applications.
Responsibilities:
Provide production support for the Data Engineering team.
Coordinate with Infrastructure, Network Security, and Support teams across Market Surveillance technology.
Support, deploy, automate, and migrate to strategic platforms like cloud.
Adhere to ITIL standards including Incident, Change, and Problem Management.
Ensure compliance with company policies regarding third-party solutions, Information Security, and the Software Development Lifecycle.
Required Qualifications:
5+ years of experience in Software Development Life Cycle, data ingestion, storage, querying, processing, and analysis.
Advanced expertise in SQL, Autosys, Big Data technologies (Spark, Hadoop, Hive, Python, Scala).
Strong Unix/Linux skills and experience in writing shell scripts.
Expertise in Oracle & SQL DB, writing complex queries, and data load management.
Experience with ETL and Cloud Platforms.
Experience in strategy, planning, and execution of new infrastructure setup and Data Center/Cloud Migration.
Experience in configuring CI/CD pipelines and managing Kubernetes.
Involved in converting Hive/SQL queries into Spark transformations using Spark RDDs/Data frames, Scala.
Experience developing, installing, and configuring Hadoop ecosystem components.
Good knowledge of ETL procedures to transform data according to business rules and functionality requirements.
Preferred Qualifications:
Strong interpersonal communication skills.
Experience with Jira and Agile/Scrum methodologies.
Knowledge/experience with Azure and GCP.
ITIL Certification and understanding of RTB & Support Functions.
Required Experience:
4+ years of Software Engineering experience, or equivalent demonstrated through work or consulting experience, training, military experience, or education.
Contact: rwest@judge.com
This job and many more are available through The Judge Group. Find us on the web at www.judge.com
