Data Engineer, Amazon Video

Job description

DESCRIPTION

Amazon Video is changing the way millions of customers interact with video content. Our team delivers high-quality video to Amazon customers through subscriptions (Amazon Prime) as well as purchases and rentals. Amazon believes so deeply in the mission of Video that we've launched our own studio to create original and exclusive content. Every day we face the challenges of a fast paced market and expanding technology set. You will have the freedom and encouragement to explore your own ideas and the reward of seeing your contributions benefit millions of Amazon.com customers worldwide.

Amazon delivers video to customers via the web, mobile phones, tablets, smart TVs, game consoles, and set top boxes. We help our customers discover the best movies and TV shows by using advanced machine learning and data mining techniques. We obsess over big picture problems like "How do we deliver video that's more reliable than the internet it's delivered over?" to low level details like "How do we squeeze maximum picture quality out of every bit delivered?" We strive to be on the forefront of new consumer technologies like UHD TV and High Dynamic Range video. We build huge scale distributed systems on the AWS cloud to make sure our service is always reliable for our customers. We use computer vision and machine learning techniques to build rich metadata about videos, and partner closely with teams like IMDb to let customers explore deeper into the TV and movies they love. In short, we have exciting challenges in an industry that's doubling in size every year, and you can be a part of it.

Amazon is looking for a Data Engineer to join the Amazon Video Business Intelligence team. Amazon sells millions of digital items through its websites and connected devices program. In order to evaluate the performance of the business and make the best forward looking decisions, we need to store and analyze huge sets of data related to purchase and consumption of digital content. The Amazon Video BI team presents exciting opportunities to work on very large data sets in one of the world's largest and most complex data warehouse environments. Our data warehouse is built on AWS cloud technology like EC2, S3, and Redshift, performing ETL processing on over 15 TB of relational data in a matter of hours. Our team is serious about great design and redefining best practices with a cloud-based approach to scalability and automation. On a daily basis, we are solving hard problems like DW source control, automated DW deployment and testing, backfill automation, and designing our DW to be massively parallel and highly performant. We are also designing and building new data models and developing the SQL code to populate the data from various sources.

As a data engineer in this team, you will take a leadership role in the data platform and you will solve big data warehousing problems on a massive scale. You will apply cloud-based AWS services to solve challenging problems around: big data processing, data warehouse design, and BI self-service. You will be part of a data engineering team that focuses on automation and optimization for all areas of DW/ETL maintenance and deployment. You will work closely with the business and technical teams in analysis on many non-standard and unique business problems and use creative problem solving to deliver actionable output. The role of data engineer in Amazon requires excellent technical skills in order to develop systems and tools to process data as well as, but not limited to, the ability to analyse data and develop reports. Your work will have a direct impact on the day-to-day decision making in the Amazon Video team.

Desired profile

BASIC QUALIFICATIONS

We're looking for Data Engineers who have a passion for data and a passion for providing their customers with that data. You love working with ETL workflows, providing a comprehensive platform for customers to access their data; understanding your customers' challenges, you can partner with customers to invent great solutions, and you are an advocate for your customers. You are analytical and creative, and you don't quit. You should also have the following skills or experiences:
· Bachelor's Degree in Computer Science or a related technical discipline
· Strong analytical and problem solving skills
· Expertise in the design, creation and management of large datasets/data models
· Ability to write high quality, maintainable, and robust code, often in SQL.
· Ability to write code in atleast one programming language. Python preffered.
· Expertise on optimization and performance tuning of ETL workloads, and understanding of DB internals.
· Ability to work with business owners to define key business requirements and convert to technical specifications