Pune, Maharashtra, India
Information Technology
Full-Time
Ford Motor Company
Overview
Job Description
As our Senior Data Engineer, you will be a key driver of our data engineering strategy, focusing on the design, implementation, and maintenance of our data infrastructure on Google Cloud Platform (GCP). You will leverage your expertise in GCP services (BigQuery, DataFlow, Pub/Sub, etc.) and related technologies to build and enhance our data pipelines and platforms, ensuring they are scalable, reliable, and adaptable to our evolving needs.
Responsibilities
Your responsibilities will include:
Must Have Skills
Mandatory
As our Senior Data Engineer, you will be a key driver of our data engineering strategy, focusing on the design, implementation, and maintenance of our data infrastructure on Google Cloud Platform (GCP). You will leverage your expertise in GCP services (BigQuery, DataFlow, Pub/Sub, etc.) and related technologies to build and enhance our data pipelines and platforms, ensuring they are scalable, reliable, and adaptable to our evolving needs.
Responsibilities
Your responsibilities will include:
- Platform Migration and Modernization: Lead setting up of data in GCP, ensuring data integrity and designing for scalability and performance.
- Pipeline Development and Enhancement: Design, develop, and maintain robust and scalable data pipelines using GCP services (BigQuery, DataFlow, Pub/Sub, etc.). This includes creating reusable components, implementing best practices, and ensuring the pipelines' maintainability and extensibility. Experience with automated data lineage is essential.
- Data Governance and Security: Implement and maintain data governance and security best practices within the GCP environment, ensuring compliance with relevant regulations.
- CI/CD Integration: Integrate data pipelines into our continuous integration and continuous delivery (CI/CD) pipeline.
- Performance Optimization: Continuously monitor and optimize the performance of data pipelines and platforms to ensure fast and reliable data processing.
- Troubleshooting and Debugging: Identify, troubleshoot, and resolve issues related to data pipelines and platforms, providing timely solutions to ensure continuous data flow.
- Reporting and Analysis: Generate reports on data pipeline performance and data quality, analyzing results to identify trends and areas for improvement.
- Mentorship and Collaboration:** Mentor junior team members, sharing your expertise and guiding them in best practices for data engineering. Collaborate closely with developers, data scientists, business analysts, and other stakeholders to ensure alignment on data strategy and execution.
Must Have Skills
- Deep Technical Proficiency: Extensive hands-on experience with GCP services (BigQuery, DataFlow, Pub/Sub, etc.), SQL, and at least one programming language (Python, Java, or similar). Experience with Terraform, Airflow, and other related tools is highly desirable.
- Architectural Design and Scalability: You have a proven ability to design and implement scalable and maintainable data solutions. You understand the challenges of handling large datasets and can design solutions that can meet future growth demands while adhering to strict performance and availability requirements.
- Data Modelling and ETL: You possess strong data modelling skills and experience with ETL processes, including designing and implementing efficient and robust data transformations.
- Collaboration and Communication: You can effectively communicate technical concepts to both technical and non-technical audiences, including senior management. You understand the importance of clear and concise documentation.
Mandatory
- 5+ years of experience in data engineering, with a focus on data warehousing and ETL development.
- 5+ years of SQL development experience.
- 3+ years of GCP experience with solutions designed and implemented at production scale.
- Bachelor's degree in Computer Science, Engineering, or a related field (or equivalent experience).
- Proven experience in designing and implementing enterprise-level data solutions in a regulated environment.
- Strong understanding of data security, governance, and compliance best practices.
- Excellent analytical and problem-solving skills.
- Excellent communication and collaboration skills.
- Understanding of relevant data privacy and security regulations (e.g., GDPR, CCPA).
- Experience in Testing – manual or automated
- Experience in FinTech domain
Similar Jobs
View All
13 Hours ago
Senior Data Engineer(Product Companies Only)
Internet
- 4 - 8 Yrs
- Anywhere in India/Multiple Locations
My Client is an AI powered, all-in-one white-label sales & marketing platform that empowers agencies, entrepreneurs, and businesses to elevate their digital presence and drive growth.
Role : Senior Data Engineer
Location : Remote
They are se...
16 Hours ago
SDE III FullStack(Backend Heavy)
Information Technology
- 3 - 8 Yrs
- Anywhere in India/Multiple Locations
As an SDE3, you’ll work on backend-heavy (70% Backend Node.Js & 30% Frontend React.Js)full stack features that bring real-world booking experiences to life — such as workflows, payments, lead generation, form submissions, notifications, and search....
1 Day ago
Project Manager SAP
Information Technology
- 30 - 35 INR - Annual
- 10 - 15 Yrs
- Pune
🚀 We’re Hiring – SAP Project Manager | Pune 🚀
Exciting opportunity with my client in Pune for an experienced SAP Project Manager to lead end-to-end S/4HANA implementations (Rise & GROW) and AMS projects in a dynamic, global environment.
We’re l...
2 Days ago
Android Developer - Mobile App Integration
Information Technology
- Pune, Maharashtra, India
Responsibilities Design and develop advanced applications for the Android platform Collaborate with cross-functional teams to define, design, and ship new features Identify and fix bugs and performance bottlenecks Continuously discover, evaluate...
2 Days ago
Full Stack Developer in Delhi
Information Technology
- Pune, Maharashtra, India
Key Responsibilities Architect, develop, and maintain high-performance, scalable web applications capable of handling rapid user growth. Design and implement distributed, fault-tolerant systems with load balancing, caching, and database sharding a...
2 Days ago
Lead Data Scientist
Information Technology
- Pune, Maharashtra, India
Our PurposeMastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we’re helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments ch...
2 Days ago
Software Engineer (Wireless & Smart Spaces) - C/C++, Python, TCP/IP, Wireless Networking, 4+ years of experience
Information Technology
- Pune, Maharashtra, India
Join Cisco Wireless and help transform the network experience with our innovative wireless solutions. Enhance speed and security, and apply AI/ML for real-time insights, continuous monitoring and seamless Wi-Fi connectivity including the latest Wi-F...
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in