Big Data Software Engineer - Manufacturing Systems & Infrastructure

Summary

Posted: 23 Sep 2024

Role Number:200569343

Apple is where individual imaginations gather together, committing to the values that lead to great work. Every new product we build, service we create, or Apple Store experience we deliver is the result of us making each other’s ideas stronger. That happens because every one of us shares a belief that we can make something wonderful and share it with the world, changing lives for the better. It’s the diversity of our people and their thinking that inspires the innovation that runs through everything we do. When we bring everybody in, we can do the best work of our lives. Here, you’ll do more than join something - you’ll add something. As a BigData Software Engineer, you are an integral part of a small data-centric team driving large-scale data infrastructure and processes development, implementation, and improvement. Our organization thrives on collaborative partnerships. Join and play a key role in developing and driving the adoption of Data Mesh and data-centric micro-services. Apple's Manufacturing Systems and Infrastructure (MSI) team is responsible for capturing, consolidating and tracking all manufacturing data for Apple’s products and modules worldwide. Our tools enable teams to confidently use data to shape the next generation of product manufacturing at Apple. We seek a practitioner with experience building large-scale data platforms, analytic tools, and solutions. If you are passionate about making data easily accessible, trusted, and available across the entire business at scale, we'd love to hear from you.

Description

As a BigData Engineer, you will lead the development and implementation of our cloud-based data infrastructure. You will work closely with cross-functional teams to understand data requirements, design scalable solutions, and ensure the integrity and availability of our data. The ideal candidate will have a deep understanding of cloud technologies, data engineering best practices, and a proven track record of successfully delivering complex data projects. - Lead the design and implementation of cloud-based data architectures. - Collaborate with data scientists, analysts, and business stakeholders to understand data requirements. - Implement data security and privacy best practices. - Optimize data storage, retrieval, and processing for performance and cost efficiency. - Lead efforts to ensure data quality, consistency, and accuracy. - Mentor and provide technical guidance to junior data engineers. - Stay current with industry trends and emerging technologies in cloud data engineering.

Minimum Qualifications

• Bachelor’s or Master's degree in Computer Science or a related field
• Proven experience as a Big Data developer, with a focus on cloud platforms
• Strong proficiency in cloud services such as AWS, Azure, or Google Cloud
• Expertise in data modelling and data integration
• Experience with big data technologies (Hadoop, Spark, etc.)
• Proficient in programming languages such as Python, Java, Scala, GoLang
• Knowledge of data warehouse solutions (Redshift, BigQuery, Snowflake, Druid)
• Experience with streaming data technologies (Kafka, Kinesis)

Preferred Qualifications

• Certification in cloud platforms (AWS Certified Big Data - Specialty, Microsoft Certified: Azure Data Engineer, etc.)
• Experience building data streaming solutions using Apache Spark, Storm, Link, Flume
• Experience using ETL tools and technologies like Reltio, Stibo, Informatics, Apache Atlas
• Knowledge of machine learning and data science concepts
• Contributions to the open source community
• Familiarity with data governance and compliance
• Strong problem-solving and analytical skills
• Excellent communication and leadership skills