Big Data Engineer (.Net/ Python/ Java) # 087363

Job description

As a Big Data engineer, you will be pushing the boundary on innovation in a dynamic and exciting domain with impact across the firm. The CTO Data Lake is one of the largest and most utilized Big Data platforms in the bank, transforming our landscape through data-driven insights. In this role you will apply your architectural understanding and deep technical implementation knowledge across the plethora of technologies that typically make up big data ecosystems, the vast majority of which are open source, new and even experimental.

Responsibilities:

· Develop additional capabilities for the CTO Data Lake and Big Data Analytics platform.
· Design and implementation of the next generation data transport and transform engine for the Group CTO Data Lake.
· Implement and support the CTO Relationship Store, a graph data store representing all the data in the CTO Data Lake for the goal of advance graph analytics.
· Design the next generation log management platform on Big Data technologies, example Solr on Hadoop.
· In-house logging, monitoring, and alerting solution for the CTO Data Lake.
· Engage directly with stakeholders, develop relationships, clarify requirements, drive Big Data platform standards and data quality improvements.
· Influence sound technical decisions in this young and dynamic technology landscape.

Desired profile

The following are highly appreciated:

·  Solid Software Engineering background
·  Apache Hadoop – HDFS, MapReduce, Spark, Cloudera Impala, Pig/Hive, Parquet, Flume
·  Proficient in one or more of: .NET (C#), Python
·  Java, Scala, Bash is a plus
·  Familiarity with both Linux and Windows
·  SQL (MS SQL Server, PostgreSQL, Oracle)
·  Messaging platforms – RabbitMQ, Kafka
·  Passionate about Big Data technologies
·  Fast learner

If you apply for this role this means you agree with the following statement:

“Through my application for a role with Credit Suisse (Poland) sp. z.o.o. (the Company) I hereby authorize the Company to process my personal data for the purposes of job recruitment. Furthermore I declare that I am aware of the voluntary submission of data and I am informed about the right to access the data and the right to correct it, pursuant to the Personal Data Protection Act of 29 August 1997 (Journal of Laws [Dz.U] No. 133, item 883)”. I authorize Company to process my personal data for future recruitment processes.

Furthermore, I authorize Credit Suisse Group AG and its' affiliates, Taleo (UK) Limited, cut-e AG Kleiner Burstah 12 and milch & zucker The Marketing & Software Company AG to process my personal data.

Credit Suisse and affiliates registration details.-

Credit Suisse (Poland) sp. z.o.o Registered office - Rondo ONZ street, 00-124 Warsaw
Credit Suisse Group AG Registered office - Paradeplatz 8, 8001 Zurich, Switzerland and its' affiliates
Taleo (UK) Limited Registered office - 78-586 Chiswick High Road, London W4 5RP, United Kingdom,
Cut-e AG Kleiner Burstah 12 Registered office - 20457 Hamburg, Germany and
Milch & Zucker The Marketing & Software Company AG Registered office - Küchlerstraße 1, 61231 Bad Nauheim “