Skip to main content
BE YOU. BE HERE. BE PART OF THE STORY.

Senior Data Engineer

Job ID 10089743 Location New York, New York, United States / Santa Monica, California, United States / San Francisco, California, United States / Seattle, Washington, United States Business Disney Entertainment & ESPN Technology Date posted Jun. 20, 2024
Apply Now

ENJOY THE MAGIC

Because our employees and cast members are at the heart of everything we do, Disney offers a competitive total rewards package that includes pay, health and savings benefits, time-off programs, educational opportunities and more.

  • HEALTH INSURANCE & WELLBEING
  • CHILDCARE OPTIONS
  • PAID TIME OFF
  • RETIREMENT PROGRAMS
  • TUITION ASSISTANCE
  • WEEKLY PAY
View All Benefits
"I didn't think it was possible that something I did for fun - telling sports stories through stats - could become my job until I came here."

Ana, Sr. Researcher, ESPN

Job Summary:

Disney Entertainment & ESPN Technology

On any given day at Disney Entertainment & ESPN Technology, we’re reimagining ways to create magical viewing experiences for the world’s most beloved stories while also transforming Disney’s media business for the future. Whether that’s evolving our streaming and digital products in new and immersive ways, powering worldwide advertising and distribution to maximize flexibility and efficiency, or delivering Disney’s unmatched entertainment and sports content, every day is a moment to make a difference to partners and to hundreds of millions of people around the world.

A few reasons why we think you’d love working for Disney Entertainment & ESPN Technology

  • Building the future of Disney’s media business: DE&E Technologists are designing and building the infrastructure that will power Disney’s media, advertising, and distribution businesses for years to come.
  • Reach & Scale: The products and platforms this group builds and operates delight millions of consumers every minute of every day – from Disney+ and Hulu, to ABC News and Entertainment, to ESPN and ESPN+, and much more.
  • Innovation: We develop and execute groundbreaking products and techniques that shape industry norms and enhance how audiences experience sports, entertainment & news.

Engineering Services designs, builds, and sustains technology that powers DE&E Technology’s worldwide content production and distribution platforms. In doing so, they contribute to a series of cross-functional services and technologies, including Quality Assurance, Data Analytics, Software Development, Broadcast Infrastructure, and Networking & Security.

The Core Data & Services for the Data organization within the DEET organization is in search of a Senior Data Engineer.  As a member of the Core Data team you will establish the foundational set of data pipelines and datasets which are a vital key to success – enabling dozens of engineering and analytical teams to unlock the power of data to drive key business decisions and provide engineering, analytics, and operational teams the critical information necessary to scale the largest streaming service.  Expanding, scaling, and standardizing the core foundational principles through consistent observability, lineage, data quality, logging, and alerting across all engineering teams in the Data organization is imperative to the creation of a single pane of glass.  The Core Data team is seeking to grow their team of world class Data Engineers that share their charisma and enthusiasm for making a positive impact!

What You'll Do

  • Contribute to maintaining, updating, and expanding existing Core Data platform data pipelines in Scala and Python / Spark while maintaining strict uptime SLAs
  • Extend functionality of current Core Data platform offerings, including metadata parsing, extending the Metastore API, and building new integrations with APIs both internal and external to the Data organization
  • Implement Ingestion of new batch and streaming data pipelines using Scala, Databricks, and Airflow
  • Implement the Lakehouse architecture, working with customers, partners, and stakeholders to shift towards a Lakehouse centric data platform
  • Implementation shared libraries in Scala and Python that abstract complex business logic to allow consistent functionality across all data pipelines across the Data organization
  • Tech stack includes Airflow, Spark, Databricks, Delta Lake, Snowflake, Scala, Python
  • Collaborate with product managers, architects, and other engineers to drive the success of the Core Data platform
  • Contribute to developing and documenting both internal and external standards and best practices for pipeline configurations, naming conventions, partitioning strategies, and more
  • Ensure high operational efficiency and quality of the Core Data platform datasets to ensure our solutions meet SLAs and project reliability and accuracy to all our stakeholders (Engineering, Data Science, Operations, and Analytics teams)
  • Be an active participant and advocate of agile/scrum ceremonies to collaborate and improve processes for our team
  • Engage with and understand our customers, forming relationships that allow us to understand and prioritize both innovative new offerings and incremental platform improvements
  • Maintain detailed documentation of your work and changes to support data quality and data governance requirements

Basic Qualifications

  • At least 5 years of data engineering experience developing large data pipelines
  • Strong algorithmic problem-solving expertise
  • Strong fundamental Scala and Python programming skills
  • Basic understanding of AWS or other cloud provider resources (S3)
  • Strong SQL skills and ability to create queries to analyze complex datasets
  • Hands-on production environment experience with distributed processing systems such as Spark
  • Hands-on production experience with data pipeline orchestration systems such as Airflow for creating and maintaining data pipelines
  • Some scripting language experience
  • Willingness and ability to learn and pick up new skillsets
  • Self-starting problem solver with an eye for detail and excellent analytical and communication skills

Preferred Qualifications

  • Experience with at least one major Massively Parallel Processing (MPP) or cloud database technology (Snowflake, Redshift, Big Query)
  • Experience in developing APIs with GraphQL
  • Deep Understanding of AWS or other cloud providers as well as infrastructure as code
  • Familiarity with Data Modeling techniques and Data Warehousing standard methodologies and practices
  • Familiar with Scrum and Agile methodologies

Required Education

  • Bachelor’s degree in Computer Science, Information Systems, Software, Electrical or Electronics Engineering, or comparable field of study, and/or equivalent work experience

Additional Information

#DISNEYTECH


he hiring range for this position in Santa Monica, CA is $136,038.00 to $182,490.00 per year, in San Francisco, CA is $148,994.00 to $199,870.00 per year, in Seattle, WA is $142,516.00 to $191,180.00 per year, and in New York, NY is $142,516.00 to $191,180.00 per year. The base pay actually offered will take into account internal equity and also may vary depending on the candidate’s geographic region, job-related knowledge, skills, and experience among other factors. A bonus and/or long-term incentive units may be provided as part of the compensation package, in addition to the full range of medical, financial, and/or other benefits, dependent on the level and position offered.

Apply Now

About Disney Entertainment & ESPN Technology:

Disney Entertainment and ESPN Technology (DE&E Technology) provides the technological backbone and product development for Disney’s two media business units, while helping to keep the company at the vanguard of innovation – enabling the Company to continuously leverage technology to enhance storytelling and creativity, while delivering scalability, flexibility, and efficiency for its businesses.

About The Walt Disney Company:

The Walt Disney Company, together with its subsidiaries and affiliates, is a leading diversified international family entertainment and media enterprise that includes three core business segments: Disney Entertainment, ESPN, and Disney Experiences. From humble beginnings as a cartoon studio in the 1920s to its preeminent name in the entertainment industry today, Disney proudly continues its legacy of creating world-class stories and experiences for every member of the family. Disney’s stories, characters and experiences reach consumers and guests from every corner of the globe. With operations in more than 40 countries, our employees and cast members work together to create entertainment experiences that are both universally and locally cherished.

This position is with Disney Streaming Technology LLC, which is part of a business we call Disney Entertainment & ESPN Technology.

Disney Streaming Technology LLC is an equal opportunity employer. Applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Disney champions a business environment where ideas and decisions from all people help us grow, innovate, create the best stories and be relevant in a constantly evolving world.

DISABILITY ACCOMMODATION FOR EMPLOYMENT APPLICATIONS

The Walt Disney Company and its Affiliated Companies are Equal Employment Opportunity employers and welcome all job seekers including individuals with disabilities and veterans with disabilities. If you have a disability and believe you need a reasonable accommodation in order to search for a job opening or apply for a position, email Candidate.Accommodations@Disney.com with your request. This email address is not for general employment inquiries or correspondence. We will only respond to those requests that are related to the accessibility of the online application system due to a disability.

Having technical issues? View the FAQs for help.

Hiring Process

  • Where Does Your Story Begin?

    Explore Disney Careers and the Life at Disney blog to learn about all the amazing opportunities waiting to be discovered at The Walt Disney Company.

  • Be Part of the Story

    There are many different brands and businesses to explore. Once you've found the opportunity that is right for you, take the next step by completing your application.

  • The Next Chapter

    Once you've applied, you will receive an email allowing you to access your candidate dashboard. Create your login and make sure to check your dashboard often to see your application progress.

Explore this Location New York, NY

With a globally recognizable skyline and 8.4 million people who call it home, New York City is bursting with diversity and excitement – from iconic attractions to hidden gems waiting to be uncovered.

OUR CULTURE

Related Content

  • Executive Leadership Learn more
  • Social Responsibility Learn more
  • Diversity, Equity, and Inclusion Learn more
  • Heroes Work Here Learn more

Sign Up for Job Alerts

Get the latest job opportunities as they become available.

Watch Our Jobs

Sign up to receive the latest news and company information based on your preferences. An asterisk indicates a required field.

Interested InSelect a job category from the list of options. Select a location from the list of options. Finally, click “Add” to create your job alert.

By clicking "Submit", you agree to our Terms of Use (opens in new window) and acknowledge that you have read our Privacy Policy (opens in new window).

By clicking "Submit", you agree to our Terms of Use (opens in new window) and acknowledge that you have read our Privacy Policy (opens in new window). If I have elected to receive marketing messages or newsletters, I may withdraw my consent for these marketing messages at any time.

By clicking "Submit", you agree to our Terms of Use (opens in new window) and acknowledge that you have read our Privacy Policy (opens in new window), Cookies Policy (opens in new window) and EU Privacy Rights (opens in new window).

How we use your personal information and your rights:

  1. Your personal information is controlled by The Walt Disney Company Limited of 3 Queen Caroline Street, London, W6 9PE, United Kingdom.
  2. When you visit or shop with Disney or use any Disney product, service or mobile application, other members of The Walt Disney Company Family of Companies may also use your information to provide you these services, personalise your experience and send you service related updates and communications.
  3. You have a number of rights including the right to request access to, change, or remove your personal information, or to change your marketing preferences (including withdrawing your consent at any time.) Please see our Privacy Policy (opens in new window) to learn more about managing your marketing preferences or deleting your account.
  4. Our Data Protection Officer can be contacted by emailing: dataprotection@disney.co.uk.
  5. You have a right to lodge a complaint with the UK Information Commissioner's Office: https://ico.org.uk/ (opens in new window).
  6. For more information about Disney's data collection and use practices please read Disney's Privacy Policy (opens in new window).

By clicking "Submit", you agree to our Terms of Use (opens in new window) and acknowledge that you have read our Privacy Policy (opens in new window) and Collection Statement (opens in new window).

For more information about our general data collection, use, and practices, including how to manage your preferences, please read our Privacy Policy (opens in new window). I have read and agree to the Terms of Use (opens in new window).

Privacy Policy Agreement

Privacy Policy Agreement

Privacy Policy Agreement

Privacy Policy Agreement

Privacy Policy Agreement