Data Engineer II

Job description

DESCRIPTION

Amazon Photos is helping customers enjoy and share their most cherished digital assets. We are building products that make it easy for customers to protect what matters to them, no matter the device or platform that content lives on. We are delivering new products and features that will change how people view the cloud.

Who you are:
You are an engineer experienced in designing, implementing, and supporting platforms providing large datasets. You have a deep understanding of how services work and what metrics are most likely to be important to the business. You are not satisfied with good enough, you go the extra step to assure scalability and quality. You love working through complex systems and make them better. You will not settle for "it works" and instead look for ways to improve the durability and resilience of the systems we create.

What you will do here:
You will architect and build highly fault tolerant systems and pipelines designed to scale to meet the demands of metrics tracking hundreds of millions of customers worldwide. You will provide technical leadership to business and services teams. You will ensure the best data engineering practices are followed and that our systems are designed to be responsive, reliable and maintainable. You will be a role model and mentor for other data engineers on the team.

What you will get from us:
A great team to work with and the chance to build a top tier pipeline and system at a proven top tier company. You will be part of a startup like culture with the stability of an established industry leader. You will get support and resources from some of the smartest people in the industry to continue your personal growth. You will build software that will improve people’s lives.

Core Responsibilities
· Design, implement, and support a platform providing ad hoc access to large datasets
· Interface with other technology teams to extract, transform, and load data from a wide variety of data sources using SQL
· Implement data structures using best practices in data modeling, ETL/ELT processes, and SQL, Oracle, Redshift, and OLAP technologies
· Model data and metadata for ad hoc and pre-built reporting
· Interface with business customers, gathering requirements and delivering complete reporting solutions
· Build robust and scalable data integration (ETL) pipelines using SQL, Python and Spark.
· Build and deliver high quality datasets to support business analyst and customer reporting needs.
· Continually improve ongoing reporting and analysis processes, automating or simplifying self-service support for customers
· Participate in strategic & tactical planning discussions, including annual budget processes

Desired profile

BASIC QUALIFICATIONS

· Bachelor's degree or higher in a quantitative/technical field (e.g. Computer Science, Statistics, Engineering).
· 2+ years of relevant experience in one of the following areas: Data engineering, business intelligence or business analytics.
· 2+ years of hands-on experience in writing complex, highly-optimized SQL queries across large datasets.
· 1+ years of experience in scripting languages like Python etc.
· Experience in data modeling, ETL development, and Data warehousing.
· Data Warehousing Experience with Oracle, Redshift, Presto, Athena etc.
· Experience with AWS services including S3, Redshift, EMR and RDS.
· Experience with Big Data Technologies (Hadoop, Hive, Hbase, Pig, Spark, etc.)
· Experience in working and delivering end-to-end projects independently.