Free cookie consent management tool by TermsFeed Staff GCP Data Engineer | Antal Tech Jobs
Back to Jobs
3 Days ago

Staff GCP Data Engineer

decor
Bangalore, Karnataka, India
Information Technology
Full-Time
Equinix

Overview

Who are we?

Equinix is the world’s digital infrastructure company®, operating over 260 data centers across the globe. Digital leaders harness Equinix's trusted platform to bring together and interconnect foundational infrastructure at software speed. Equinix enables organizations to access all the right places, partners and possibilities to scale with agility, speed the launch of digital services, deliver world-class experiences and multiply their value, while supporting their sustainability goals.

Our culture is based on collaboration and the growth and development of our teams.  We hire hardworking people who thrive on solving challenging problems and give them opportunities to hone new skills and try new approaches, as we grow our product portfolio with new software and network architecture solutions. We embrace diversity in thought and contribution and are committed to providing an equitable work environment that is foundational to our core values as a company and is vital to our success.

Job Summary

As a key member of the Data Team at Equinix, we are seeking an experienced GCP Data Engineer who will lead end-to-end development of complex Data Engineering use cases and drive the evolution of Equinix's Data Lake platform. You will design and build enterprise-scale data infrastructure and analytics solutions on Google Cloud Platform while providing technical mentorship to the data engineering team. The ideal candidate combines deep technical expertise in cloud-native data technologies with proven leadership skills and a passion for building robust, scalable data platforms that drive strategic business insights.

Responsibilities

  • Participate in design and implementation of enterprise-scale data pipelines and platform architecture for End-to-End data products
  • Develop fault-tolerant, petabyte-scale data processing systems using advanced GCP services
  • Evaluate and recommend new technologies, tools, and architectural approaches
  • Build complex ETL/ELT workflows using Cloud Dataflow, Composer, Dataform/dbt, BigQuery and custom solutions
  • Implement sophisticated real-time streaming architectures with Cloud Pub/Sub, Kafka and Apache Beam
  • Design and optimize data processing workflows for performance, cost, and reliability
  • Develop advanced data transformation logic and custom processing functions
  • Implement data architectures and microservices-based data platforms
  • Design multi-environment deployment strategies and automated scaling solutions
  • Establish monitoring, alerting, and observability frameworks across the data platform
  • Lead code reviews and establish quality assurance processes
  • Provide technical guidance on complex problem-solving and optimization techniques
  • Facilitate knowledge sharing sessions and technical training programs
  • Collaborate with hiring managers on technical interviews and team expansion
  • Implement comprehensive data governance frameworks and compliance controls
  • Design fine-grained access controls and data classification systems
  • Establish automated data quality monitoring and lineage tracking
  • Ensure GDPR, SOX, and other regulatory compliance across data workflows
  • Implement privacy-preserving techniques and data anonymization strategies
  • Translate complex business requirements into scalable technical solutions
  • Coordinate cross-functional initiatives involving multiple engineering teams

Qualifications

Technical Expertise

  • GCP Services: 5+ years hands-on experience with BigQuery (advanced SQL, scripting, ML integration), Cloud Dataflow, Cloud Composer, Cloud Storage, Pub/Sub, and Vertex AI
  • Programming: Expert-level Python/Java programming, proficiency in Python/Scala for Spark development
  • Advanced Technologies: Deep experience with Apache Beam, Airflow, Kubernetes, Docker, and distributed computing
  • Infrastructure: Extensive experience with Terraform, CI/CD pipelines, and cloud infrastructure management
  • Database Systems: Advanced knowledge of both relational and NoSQL databases, data modeling, and performance optimization

Professional Experience

  • Bachelor’s or master’s degree in computer science, Engineering, or related field
  • 5+ years of data engineering experience with 4+ years specifically on Google Cloud Platform
  • Proven track record of delivering complex, enterprise-scale data solutions
  • Experience with data governance, compliance, and security frameworks
  • Excellent written and verbal communication skills with ability to present to executives
  • Experience working with cross-functional projects and managing stakeholder relationships
  • Proven ability to translate business requirements into technical solutions

Preferred Qualifications

  • Google Cloud Professional Data Engineer certification
  • Experience with MLOps, feature stores, and machine learning pipeline development
  • Knowledge of data science workflows and statistical analysis
  • Experience with BI tools (Looker, Tableau) and advanced analytics platforms

Equinix is committed to ensuring that our employment process is open to all individuals, including those with a disability. If you are a qualified candidate and need assistance or an accommodation, please let us know by completing this form.

Equinix is an Equal Employment Opportunity and, in the U.S., an Affirmative Action employer. All qualified applicants will receive consideration for employment without regard to unlawful consideration of race, color, religion, creed, national or ethnic origin, ancestry, place of birth, citizenship, sex, pregnancy / childbirth or related medical conditions, sexual orientation, gender identity or expression, marital or domestic partnership status, age, veteran or military status, physical or mental disability, medical condition, genetic information, political / organizational affiliation, status as a victim or family member of a victim of crime or abuse, or any other status protected by applicable law.
Share job
Similar Jobs
View All
1 Day ago
Test Engineer
Information Technology
  • Hyderabad, Telangana, India
You'll be part of global teams across Bupa markets You'll get to work on building innovative digital health solutions About Our ClientBupa is a leading international healthcare company, established in 1947. You may know us as Niva Bupa in India, ...
decor
1 Day ago
Risk Consulting - Digital Risk - Senior - AI Engineer
Information Technology
  • Aurangabad, Maharashtra, India
Job DescriptionAt EY, we’re all in to shape your future with confidence.We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go.Join EY and help to build a better working world.Job T...
decor
1 Day ago
Java Fullstack Developer
Information Technology
  • Hyderabad, Telangana, India
Experience: 7-13Essential Functions 10+ years of professional experience in full stack software development. Knowledge of version control systems like Git and development workflows (CI/CD). Strong understanding of cloud security, scalability, and pe...
decor
1 Day ago
Business Analyst, Application Support - WBITVP
Information Technology
  • Hyderabad, Telangana, India
Welcome to Warner Bros. Discovery… the stuff dreams are made of.Who We Are…When we say, “the stuff dreams are made of,” we’re not just referring to the world of wizards, dragons and superheroes, or even to the wonders of Planet Earth. Behind WBD’s v...
decor
1 Day ago
Software Engineer - PHP/WordPress Developer
Information Technology
  • Bangalore, Karnataka, India
Current Openings Software Engineer - PHP/WordPress Developer Software Engineer - PHP/WordPress DeveloperExperience : 0 - 2 yearsBhubaneswar, Delhi - NCR, Remote WorkingApplyAbout The JobFeaturedWe are seeking a passionate and motivated Junior PHP ...
decor
1 Day ago
Software Engineer III- Splunk, Linux
Information Technology
  • Hyderabad, Telangana, India
Job DescriptionWe have an exciting and rewarding opportunity for you to take your software engineering career to the next level.As a Software Engineer III at JPMorgan Chase within the Employee Platforms team, you serve as a seasoned member of an agi...
decor
2 Days ago
Senior Machine Learning Engineer
Information Technology
  • 4500000 - 4500000 INR - Yearly
  • Aurangabad, Maharashtra, India
Experience: 5.00 + yearsSalary: INR 4500000.00 / year (based on experience)Expected Notice Period: 15 DaysShift: (GMT+05:30) Asia/Kolkata (IST)Opportunity Type: RemotePlacement Type: Full Time Indefinite Contract(40 hrs a week/160 hrs a month)(*Note...
decor
2 Days ago
Python Developer
Information Technology
  • 888888 - 977772 INR - Yearly
  • Bangalore, Karnataka, India
Experience: 2.00 + yearsSalary: INR 74074-81481 / month (based on experience)Expected Notice Period: 30 DaysShift: (GMT+05:30) Asia/Kolkata (IST)Opportunity Type: RemotePlacement Type: Part Time Contract for 12 Months (20 hrs a week/80 hrs a month)(...
decor

Talk to us

Feel free to call, email, or hit us up on our social media accounts.
Social media