Data Engineering

Job description

Role Title: Data Engineering

Business: Information Technology

New or Existing Role? Existing

Grade: GCB5

Role Purpose

· FCTM is responsible for running a unified and global capability to identify, analyse, and investigate financial crime risk. This supports informed financial crime risk management by HSBC and effective information sharing with internal and external stakeholders (including government). The system is grounded in advanced analytics and technology.

· FCTM IT is 300+ people across 3 continents.

· The FCR Hadoop Team currently supports 5 HWX ecosystems, with a total of 160 nodes.

· This role will include the following responsibilities:

· Implement and upgrade Hadoop ecosystem

· Provide L2/3 Support to business users

· Provide L3 Support to development pods

· Assist in implementation of the migration of Hadoop from on-premises to the cloud

Major Challenges

· Working for a very large, diverse and geographically spread organisation
· Working and partnering with business, development and infrastructure teams
· Weekend, sometimes evening work is required

Desired profile

Qualifications :

·  Experience (1 = essential, 2 = very useful, 3 = nice to have):
·  Hortonworks Certified Administrator
·  In depth knowledge of HIVE
·  Knox / Solr Cloud
·  SPARK
·  AWS / GCP
·  RHEL / shell scripting / REGEX
·  2. Knowledge of Python and PySpark
·  2. DevOps / Agile practices (Scrum / KANBAN)
·  MLlib
·  Shark

Essential Skills/Competencies

·  Methodical and measured approach with a keen eye for attention to detail
·  Ability to work under pressure and remain calm in the face of adversity
·  Ability to collaborate, interact and engage with different business, technical and subject matter experts
·  Good, concise written and verbal communication
·  Pro-active, a can do mind-set and attitude
·  Good documentation skills

For more information about the relevant additional checks for this role please contact the hiring manager.

We are an equal opportunity employer and are committed to creating a diverse environment.