Senior Data Engineer, Data Products Engineering
INTRODUCTION:At NBCUniversal, we believe in the talent of our people. It's our passion and commitment to excellence that drives NBCU's vast portfolio of brands to succeed. From broadcast and cable networks, news and sports platforms, to film, world-renowned theme parks and a diverse suite of digital properties, we take pride in all that we do and all that we represent. It's what makes us uniquely NBCU. Here you can create the extraordinary. Join us.ABOUT THE ROLE:Data Engineer for the Data Products Engineering Team. Our team builds data pipelines to land, profile and store multiple internal & external datasets and build applications that surface this data to support our business partners' strategic decision making. We are an AWS shop that uses open source technologies including Scala, Python, Pandas, Spark, Hive, Postgres, Redis, Flask, as well as BI tools such as Tableau and MicroStrategy. We work in a very agile environment, where product specifications are flexible and often change rapidly over time. We are seeking people who are comfortable with ambiguity, can drive towards clarity and define execution plans. While the key focus for this role is on backend engineering, engineers who have full stack expertise will be especially considered.• Contributor to the overall Data Product roadmap by working closely with our business partners to understand their challenges and develop analytical tools to help drive business decisions• Leverage prototyping methodologies to propose and design creative business solutions that exploit our broad toolset of technologies (Big Data, MicroStrategy, Tableau, Python, Spark etc)• 4+ years experience with AWS technologies. Strong experience using Python and Pandas in an AWS Lambda framework is highly desired. Experience using EMR and/or DataBricks or the ability to read EMR code and translate it into Lambdas.• Must understand the basics of relational data modeling and be able to clearly articulate the reasons to use non-relational systems in our architecture. Experience in SingleStore (formerly MemSQL) is desired but relevant experience in any of the following is acceptable: SnowFlake, MySQL, Redshift, Athena, MSSQL Server, Oracle. Experience in non-relational systems such as Redis, Cassandra, and MongDB is useful for supporting legacy applications.• Decent understanding for the digital media ad sales business and ad serving technologies with experience working with ad serving transactional data logs or Nielsen demographic data.• Educate and inform business partners on architecture, capabilities, best practices and solutions to build out future enhancements• Assist in analyzing business requirements, source systems, understand underlying data sources, transformation requirements, data mapping, data model and metadata for reporting solutions• Writing easily understood documentation and architecture diagrams and keeping them up to date as code and frameworks change over time.