Principal Data Engineer
The Data & Analytics (D&A) team at NBCUniversal is looking for a passionate problem solver who will be an outstanding addition to our team. As the Principal Engineer, you'll be driving the overall delivery and support of data and AI applications including designing and building net new while also enhancing the existing tech stack. You will be responsible for multiple systems that support the analytics needs of various stakeholders. This will include developing and maintaining the applications, identifying resource constraints, project risks and mitigations, and development timelines. You'll also have the opportunity to partner with internal stakeholders, data engineers, and product teams to design and build the next generation of data applications. If you're an individual who is capable of managing large-scale software engineering initiatives, coaching junior engineers, interfacing with product and business stakeholders and a passion for solving challenging problems, then this role is for you! Join us! Core Responsibilities: Design, build, and scale data pipelines across a variety of source systems and streams (internal, third-party, and cloud-based), distributed/elastic environments, and downstream applications and self-service solutions. Deep understanding of Machine Learning best practices (e.g., training/serving, feature engineering, feature/model selection, imbalance data, RAG patterns) and algorithms (e.g., deep learnings, optimization) Solid understanding of data modeling, warehousing, and architecture principles. Implement appropriate design patterns while optimizing performance, cost, security, and scale and end-user experience. Collaborate with cross-functional teams to understand data requirements and develop efficient data acquisition and integration strategies. Interface with other technology teams to extract, load, and transform data from a wide variety of data sources using cloud-native data engineering principles. Become a subject matter expert for data engineering-related technologies and designs. Coach and guide others within the organization to build scalable pipelines based on foundational data engineering principles. Participate in development sprints, demos, and retrospectives alongside releases and deployment. Build and manage relationships with supporting engineering teams to deliver work products to production effectively. Have worked well with data scientists, business analysts, and machine learning infrastructure to connect the dots between business and technology partners. Develop automated tests for your code, ensuring every function, service, and object is compatible with your team's work and with the many systems within the NBCUniversal system portfolio and cross-device and browser compatibility. Create documentation for developers and business users to help them understand our products. Work collaboratively with a multidisciplinary team within a matrixed organization, leveraging strong interpersonal skills to navigate system complexities and deploy solutions efficiently. Deploy to cloud-based platforms and troubleshoot application, cloud, and configuration issues when necessary. Utilize tools for code & test generation to dramatically accelerate the delivery of features and components you create.