Free cookie consent management tool by TermsFeed Data Engineer | Antal Tech Jobs
Back to Jobs
2 Days ago

Data Engineer

decor
Chennai, Tamil Nadu, India
Information Technology
Full-Time
Orion Innovation

Overview

Orion Innovation is a premier, award-winning, global business and technology services firm. Orion delivers game-changing business transformation and product development rooted in digital strategy, experience design, and engineering, with a unique combination of agility, scale, and maturity. We work with a wide range of clients across many industries including financial services, professional services, telecommunications and media, consumer products, automotive, industrial automation, professional sports and entertainment, life sciences, ecommerce, and education.

What You'll Be Doing

  • Design, build, and deploy robust ETL and data management processes specifically for ingesting, transforming, and loading high-volume digital analytics data from Google Analytics 4 (GA4) into BigQuery/Snowflake.
  • Develop and optimize BigQuery/Snowflake datasets, tables, and views to support various analytical needs, ensuring efficient querying and data integrity.
  • Design, build, and deploy ETL job workflows with reliable error/exception handling and rollback frameworks. This includes designing and implementing data pipelines to feed data models for subsequent consumption.
  • Monitoring and optimizing data processing and storage resources, with a focus on performance and cost efficiency.
  • Troubleshooting and resolving data pipeline issues and performance bottlenecks, particularly those related to large-scale digital data processing.
  • Write complex, customized SQL queries to manipulate data, generate automatic periodic reports, and support ad-hoc analytical requests.
  • Build applications and scripts using Python to automate data processes, integrate systems, and enhance data quality.
  • Develop strategies for data ingestion (from multiple sources) into data platforms, using various extract and load techniques through scripting and/or tooling, streaming, API consumption, and replication.
  • Document data engineering processes, best practices, and technical specifications, especially for GA4 data models and BigQuery/Snowflake schemas.
  • Work collaboratively with Business Partner Teams and Business Stakeholders during project scoping and feasibility phases as a Subject Matter Expert (SME) for concept investigation/viability and technical impact; identify and communicate technical risks and mitigations.
  • Conform to agile development practices – Evolutionary design, refactoring, continuous integration/delivery, test-driven development.
  • Provide production support for data load jobs, ensuring the continuous flow of critical digital data. Actively monitor and resolve user support issues, working closely with your functional squad and other squads.
  • Maintain or upgrade existing data applications and pipelines.
  • Clearly communicate technical terms to non-technical people and help them understand why change might be required to achieve a specific goal or to complete a project.
  • Attend key design meetings and provide support.
  • Perform research of viable technical and/or non-technical solutions.
  • Other ad hoc duties as required.


What You’ll Need

  • Education: Minimum of a Bachelor's degree in Computer Science, Engineering, Mathematics, or a related technical field preferred.
  • Experience: 8+ years of relevant experience in data warehousing, data modeling, and building data integration pipelines, including ingestion, integration, and ETL.


Engineer's Core Skills

  • Proven experience in working with GA4 data, including understanding its data model, event-based tracking, and integration with BigQuery.
  • 6+ years of hands-on experience with Google BigQuery or Snowflake including advanced SQL techniques (CTEs, window functions, aggregate functions), schema design, and performance optimization.
  • 6+ years of hands-on experience with advanced SQL techniques (CTEs, window functions, aggregate functions).
  • 5+ years of strong experience in Python programming (object-oriented/functional programming, Pandas, PySpark).
  • 5+ years working with cloud platforms.
  • Experience designing star schemas, analyzing data warehouses, and applying data warehouse methodologies, particularly in the context of digital analytics data.
  • Essential experience in loading data into warehouse/ODS environments from diverse sources and formats. Design strategies for new data ingestion requests, including logical and physical data modeling.
  • Hands-on experience with version control and CI/CD pipelines for data engineering workflows.
  • Proven ability to perform unit testing (SQL scripts, ETL modules), integration testing, and performance/load/stress testing.


Tools & Technologies

  • Cloud Platforms: GCP (BigQuery, DataProc, DataFlow, CloudRun, Cloud Functions, Pub/Sub, etc.) or equivalent cloud platforms like AWS or Azure.
  • Data Platforms: Snowflake.
  • ETL/Integration Tools: AWS Glue, Fivetran.
  • Orchestration/Transformation Tools: Alteryx or DBT (data build tool).
  • Version Control: GitHub or similar repositories.
  • BI Tools (Bonus): Looker or Power BI tools for data consumption.
  • Other Web Analytics (Bonus): Experience with other web analytics platforms or marketing data sources.
  • Infrastructure as Code (Bonus): Terraform.


Orion is an equal opportunity employer, and all qualified applicants will receive consideration for employment without regard to race, color, creed, religion, sex, sexual orientation, gender identity or expression, pregnancy, age, national origin, citizenship status, disability status, genetic information, protected veteran status, or any other characteristic protected by law.

Candidate Privacy Policy

Orion Systems Integrators, LLC And Its Subsidiaries And Its Affiliates (collectively, “Orion,” “we” Or “us”) Are Committed To Protecting Your Privacy. This Candidate Privacy Policy (orioninc.com) (“Notice”) Explains

  • What information we collect during our application and recruitment process and why we collect it;
  • How we handle that information; and
  • How to access and update that information.


Your use of Orion services is governed by any applicable terms in this notice and our general Privacy Policy.
Share job
Similar Jobs
View All
19 Hours ago
Senior Analyst
Information Technology
  • 2 - 8 Yrs
  • Anywhere in India/Multiple Locations
Notice Period - Immediate Joiner / 30 days Max Key Responsibilities: 1. Monitor production systems and respond to incidents, alerts, and escalations in a timely manner 2. Perform root cause analysis and provide fixes for recurring issues ...
decor
20 Hours ago
Senior Quality Engineer
Information Technology
  • 2 - 6 Yrs
  • Anywhere in India/Multiple Locations
Job Requirements: Quality Assurance Automation Tester responsible for designing, developing, and executing automated tests to ensure software quality and performance. The ideal candidate combines strong technical skills in automation frameworks...
decor
1 Day ago
Senior Data Engineer
Information Technology
  • Mumbai, Maharashtra, India
This job is with Amazon, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. DescriptionWorldwide Fulfillment by Amazon (WW FBA) empowers milli...
decor
1 Day ago
Datacultr - Senior Software Engineer - Python/Django
Information Technology
  • Mumbai, Maharashtra, India
We are seeking a highly skilled and experienced Software Engineer with 4- 8 years of professional experience in Python and Django, specifically in building REST APIs using frameworks like FASTAPI and Django Rest Framework (DRF). The ideal candidate ...
decor
1 Day ago
Quality Test Engineer II
Information Technology
  • Mumbai, Maharashtra, India
This job is with LexisNexis Legal & Professional®, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. Would you like to be part of a team that...
decor
1 Day ago
Data Engineer I
Information Technology
  • Mumbai, Maharashtra, India
This job is with Amazon, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. DescriptionFulfillment by Amazon (FBA) enables sellers to scale th...
decor
1 Day ago
Quality Engineering Lead (Test Lead)
Information Technology
  • Mumbai, Maharashtra, India
Project Role : Quality Engineering Lead (Test Lead)Project Role Description : Leads a team of quality engineers through multi-disciplinary team planning and ecosystem integration to accelerate delivery and drive quality across the application lifecy...
decor
1 Day ago
Technical Lead - C++/Java/Python
Information Technology
  • Mumbai, Maharashtra, India
Job Title : Technical Lead Software DevelopmentLocation : Hyderabad (On-site)Experience : 3 - 5 YearsAbout The CompanyWe specialize in delivering cutting-edge software solutions and services tailored to the banking and financial sector across Asia-P...
decor

Talk to us

Feel free to call, email, or hit us up on our social media accounts.
Social media