The Senior Big Data Platform Engineer is responsible for architecting, engineering, configuring, and deploying advanced big data platforms including technologies such as Hadoop, Spark, Kafka, HUE, R, Solr, and many others. The GM Global Data and Analytics Platform (GDAP) is comprised of an integrated set of platform technologies that provide industry leading data persistence and analysis capabilities. The senior big data platform engineer will be assigned to projects requiring deployment of new big data related technologies, upgrade or enhancement of existing platforms, and to various POC activities designed to test and evaluate new technologies for suitability at GM. This role requires the incumbent to develop technology standards, to provide platform engineering subject matter expertise to the organization, to perform hands on engineering and configuration in complex interdependent environments, and to lead triage, diagnosis and remediation of platform related issues. Additionally, the senior big data platform engineer will be expected to work with our key supplier partners and industry peers to understand and influence industry technical direction in order that GM’s big data requirements are accommodated.

Skill, Experience and Education Requirements

* 10 years of demonstrated expertise in technology selection, architecture design, engineering & configuration, deployment and operational support/issue resolution.
* Full stack technical expertise from OS and configuration management through to Big Data ecosystem components such as Spark, Kafka, Hive, Cassandra, R and Solr.
* Experience as a contributor to open source communities and projects, with a bias toward data and analytics related projects.
* Experience with integration of Hadoop and other big data open source technologies with various commercial platforms including RDBS solutions and off the shelf analytics tools.
* Experience with software defined infrastructure and private cloud environments.
* Experience with development of analytics and data science based solutions using open source tools and libraries is required.
* Expertise and experience with software development and related techniques and methodologies such Agile, Scrum, Extreme Programming, Test Driven Development, Etc.
* Expertise in the area of security assurance engineering in a big data platform environment including application of Kerberos, LDAP based authentication, various encryption technologies, security vulnerability detection and remediation.
* Strong development experience with Python, Ruby, Go, Java, Scala, and related Linux-based scripting tools, including the ability to interpret and contribute improvements to various open source projects.
* Expert in large scale deployment automation and configuration management using Chef or similar tools.
* Experience with Atlassian tools such as Bitbucket and Confluence.
* Demonstrated ability to develop sizing & capacity planning for large scale big data platforms and to periodically evaluate and optimize performance and platform throughput.
* The ability to comprehend business strategy and requirements and to develop corresponding technology roadmaps that integrate supplier technology plans with GM IT standards and requirements.
* Demonstrated ability to work across multiple organizations, including both IT and GMIT’s business partners and suppliers, to ensure that their big data platform related needs are supported, forecasted, incorporated into technology roadmaps and ultimately implemented in a platform as a service model.
* Excellent communications skills including both the ability to address detailed technical communications as well as the ability to distill complex technical status to executive level oral and written communications.

The responsibilities of the Information Security Cloud Engineers are:

• the support and maintenance of Cloud Security Tooling and Platforms including:
  • implementing policy changes
  • performing daily, weekly and monthly checks
  • monitoring the availability of systems and responding to alerts
  • monitor the capacity of systems & supporting infrastructure and project future capacity
  • identifying and resolving issues
  • preparing status reviews and reports
  • managing support cases to ensure issues are recorded, tracked, resolved, and follow-ups are done in a timely manner
• to maintain a good working knowledge of current infrastructure and future trends
• to deliver excellent customer service
• to work with the third-party suppliers of the Security Products
• to maximise security value from existing investments
• to assist the wider Information Security Engineering team with the development of the security tooling
• to work collaboratively with wider Information Security team.  This would include working with: The Incident Response team, assisting with incidents; and with the Security Consultants to provide additional technical knowledge
• to take part in post incident reviews and propose engineering resolution to improve results in any future recurrence
• to recognise that telemetry for security products will increasingly be curated in the cloud and be prepared to develop API endpoints and connections to collect and collate this knowledge
• to participate in the Information Security On-Call rota.

Essential Experience & Skills

• Proven experience of supporting IT/Security Infrastructure
• Strong technical background
• Hands of experience with a least 1 of the main cloud vendors (Amazon Web Services, Azure, Google Cloud Platform)
• Experience of Cloud Security Tools (e.g. AWS Security Hub, Azure Security Centre)
• The ability to pick up and learn new technology approaches and make rapid decisions on the best way to use these technology advancements for the betterment of the overall security posture.
• Excellent communication skills as the ability to communicate effectively, constructively, confidently and professionally is key to the success in the role as is the ability to work with IT and Information Security teams and the wider business.
• An excellent knowledge of Information Security principles and an understanding of the Cyber Kill Chain, MITRE ATT&CK and other information security defence and intelligence frameworks.
• Keen attention to detail and excellent analytical skills.
• Ability to actively manage workloads to meet business and department requirements.

• Meeting with development managers to discuss software projects.
• Conducting feasibility studies for upgraded software systems.
• Designing new software programs, websites, and applications.
• Assigning tasks to junior developers such as coding, testing, debugging, and analytics.
• Writing advanced programming code.
• Reviewing updated software systems.
• Managing project timelines and tasks.
• Writing development reports.
• Creating technical documents for new software programs.
• Training staff on software use.

Senior Software Developer Requirements:

• Bachelor’s degree in computer engineering or computer science.
• Previous experience as a software programmer.
• Managerial experience preferred.
• Advanced knowledge of programming languages including JavaScript, HTML5, C++, Java, SQL, and PHP.
• Knowledge of system frameworks including .NET, Git, AngluarJS, and GitHub.
• Experience creating and maintaining databases.
• Experience working with Agile development technologies.
• Advanced project management skills.
• Good interpersonal skills.

Critical Requirements:

• Extremely Strong Node.js Engineer
• 10+ years of experience in a skills in the software engineering space, mostly backend.
• Experience with backend technologies, best practices, awareness of industry tools.
• Strong communication skills both via writing and in person
• Experience in node.js, express, postgres DB , graphQL
• Strong Core Java Skills
• Experience with Java, Spring/Spring Boot/Microservices
• Exposure to automated testing, modern CI/CD pipelines, Docker, and Kubernetes.

Key Skills: Node.js, express, Postgres DB , GraphQL