Kafka Spark Developer

Job description

About IBM:

IBM is a global technology and innovation company present in India since 1992. It is the largest technology and consulting employer in the world, with approximately 380,000 employees serving clients in 170 countries. In this new era of Cognitive Business, IBM is helping to reshape industries as diverse as healthcare, retail, banking, travel, manufacturing, and many more, by bringing together our expertise in Cloud, Analytics, Security, Mobile, AI and the Internet of Things. We are changing how we create. How we collaborate. How we analyze. How we engage. IBM is a leader in this global transformation.

Our Culture:

IBM is committed to crafting a diverse environment and is proud to be an equal opportunity employer. You will receive consideration for employment without regard to your race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status. We are committed to compliance with all fair employment practices regarding citizenship and immigration status

Business Unit Introduction:

IBM Chief Information Office (CIO) Network Engineering team is working to transform their network services which can deliver to the demands of changing IT landscape. We are working in the areas of Hybrid Cloud connectivity, Network visibility (Monitoring, Analytics), Network service automation and network security and compliance. Our work is all about enabling IBM strategy by giving IBMers the modern network they need to do their work, be responsive to our clients, and to act with speed and agility. Our organization plays a key role in IBM's ability to turn vision into reality by making our network services simpler, more intuitive and more effective for our developers.

Who you are:

As a Kafka/Spark Developer, you will be working closely with business owners and infrastructure/application architects to develop data processing platform, automation for building data pipelines. As a full-stack developer you should be well versed in agile development. Should have the ability to work collaboratively with distributed multi-geography, ad-hoc teams.

What you'll do:

As a Kafka/Spark Developer, you will have to

·  Support engagements focused on Data and Advanced Business Analytics in diverse domains such as solution development
·  Help the team with various projects pertaining to migration, automation, and development, implementing improvement and adding new functionality
·  Implementing and supporting new execution venues
·  Validating data changes and updating the platform
·  Performing code reviews
·  Working very closely with Architecture group and driving technical solutions.
·  Develop spark applications/ map reduce jobs.
·  Develop streaming / real-time based complex event processing on Hadoop framework. Interface with different databases (SQL, NoSQL).
·  Manage data quality, by reviewing data for errors or mistakes from data input, data transfer, or storage limitations.
·  Perform data management to ensure data definitions, lineage and source are suitable for analysis. Work in a multidisciplinary team to understand available data sources, needs, and downstream uses.

How we'll help you grow:

·  You'll have access to all the technical training courses you need to become the expert you want to be
·  You'll learn directly from expert developers in the field
·  You'll have the opportunity to work in many different areas to figure out what really excites you
Auto req ID

185246BR
Required Education

Bachelor's Degree
Role ( Job Role )

Software Developer
State / Province

KARNATAKA
Primary job category

Software Development & Support
Company

(0063) IBM India Private Limited
Contract type

Regular
Employment Type

Full-Time
ERBP

Yes
Is this role a commissionable/sales incentive based position?

No
Travel Required

No Travel
IBM Business Group

F&O
Preferred Education

Master's Degree
City / Township / Village

BANGALORE
EO Statement

IBM is committed to creating a diverse environment and is proud to be an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.
Required Technical and Professional Expertise

·  7 – 10+ years of experience in development and 3+ years relevant experience in Kafka/Spark Hadoop, Pig/Hive on any Hadoop distribution (HDP / CDH / MapR).
·  Experience in building streaming/real time framework using Kafka & Spark.
·  Proficient in SQL, in addition to one or more of modern programming language such as Java, Scala, Python etc.
·  Working with databases (SQL, NoSQL) and data validation, cleaning, and munging
·  Expertise in automated build, test & deploy
·  Self-starter, willing to learn
Country/Region

India
Preferred Technical and Professional Experience

None
Secondary Job Category

Other Software Development & Support
Eligibility Requirements

None
Position Type

Professional
Early Professional Track

Not Applicable - Professional Hire