Free cookie consent management tool by TermsFeed GCP + DBT Staff Data Engineer | Antal Tech Jobs
Back to Jobs
4 Days ago

GCP + DBT Staff Data Engineer

decor
Hyderabad, Telangana, India
Information Technology
Full-Time
Tredence Inc.

Overview


Role description

As a GCP DBT Manager you will work with team to help designing, building, and maintaining data pipelines and transformations using Google Cloud Platform (GCP) and the Data Build Tool (dbt). This often includes using tools like BigQuery, Cloud Composer, and Python, and requires strong SQL skills and knowledge of data warehousing concepts. The role also involves ensuring data quality, performance optimization, and collaborating with cross-functional teams.


 


Role & responsibilities


Data Pipeline Development:


Designing, building, and maintaining ETL/ELT pipelines using dbt and GCP services like BigQuery and Cloud Composer.


Data Modeling:


Creating and managing data models and transformations using dbt to ensure efficient and accurate data consumption for analytics and reporting.


Data Quality:


Developing and maintaining a data quality framework, including automated testing and cross-dataset validation.


Performance Optimization:


Writing and optimizing SQL queries for efficient data processing within BigQuery.


Collaboration:


Working with data engineers, analysts, scientists, and business stakeholders to deliver data solutions.


Incident Resolution:


Supporting day-to-day incident and ticket resolution related to data pipelines.


Documentation:


Creating and maintaining comprehensive documentation for data pipelines, configurations, and procedures.


Cloud Platform Expertise:


Utilizing GCP services like BigQuery, Cloud Composer, Cloud Functions, etc.


Scripting:


Developing and maintaining SQL/Python scripts for data ingestion, transformation, and automation tasks.


 


Preferred candidate profile


Requirements:


Experience:


Typically requires 7~12 years of experience in data engineering or a related field.


GCP Proficiency:


Strong hands-on experience with Google Cloud Platform (GCP) services, particularly BigQuery.


dbt Expertise:


Proficiency in using dbt for data transformation, testing, and documentation.


SQL Proficiency:


Advanced SQL skills for data modeling, performance optimization, and querying large datasets.


Data Warehousing:


Understanding of data warehousing concepts, dimensional modeling, and star schema design.


ETL/ELT:


Experience with ETL/ELT tools and frameworks, including Apache Beam, Cloud Dataflow, Data Fusion, or Airflow/Composer.
Share job
Similar Jobs
View All
1 Day ago
PHP Developer
Information Technology
  • 3 - 7 Yrs
  • Anywhere in India/Multiple Locations
We are looking for Senior PHP Developer, capable of developing high-end web applications using PHP ,MY SQL & CodeIgniter. Working knowledge in API Integrations for E-commerce portals preferred.   Required Candidate profile 3+ years Exp. with P...
decor
1 Day ago
Java Developer
Information Technology
  • 2 - 5 Yrs
  • Anywhere in India/Multiple Locations
Role - Software Engineer (Java Developer) Years of Experience - 2 to 5 Work Mode - Remote Bachelors degree in computer science, Engineering, or a related field. 2 to 5 years of experience in Java development. Proficiency in Java, with...
decor
1 Day ago
Sr Engineer II (C++ Developer)
Information Technology
  • Pune, Maharashtra, India
Seeking a highly motivated and self-driven Software Developer who will be responsible for developing slot content for Digital applications (Heart of Vegas, Cashman Casinos & Lightning Link) across various platforms (iOS, Android and Web).Quick Learn...
decor
1 Day ago
Freelance UI Developer (Client Hire)
Information Technology
  • Pune, Maharashtra, India
Flexing It is a freelance consulting marketplace that connects freelancers and independent consultants with organisations seeking independent talent. Flexing It has partnered with ur client, a leading Procurement intelligence company which deals in...
decor
1 Day ago
Network Engineer
Information Technology
  • Pune, Maharashtra, India
OverviewRapiscan Systems is an industry leader in detection technology, providing cargo and vehicle inspection systems and services for ports, borders, military, high-threat facilities, and checkpoints to help customers combat terrorism, drug smuggl...
decor
1 Day ago
Senior Software Engineer
Information Technology
  • Pune, Maharashtra, India
OverviewWorking at AtlassianAtlassians can choose where they work – whether in an office, from home, or a combination of the two. That way, Atlassians have more control over supporting their family, personal goals, and other priorities. We can hire ...
decor
1 Day ago
Cloud Platform Engineer
Information Technology
  • Pune, Maharashtra, India
Project Role : Cloud Platform EngineerProject Role Description : Designs, builds, tests, and deploys cloud application solutions that integrate cloud and non-cloud infrastructure. Can deploy infrastructure and platform environments, creates a proof ...
decor
1 Day ago
Application Developer
Information Technology
Project Role : Application DeveloperProject Role Description : Design, build and configure applications to meet business process and application requirements.Must have skills : React.jsGood to have skills : NAMinimum 7.5 Year(s) Of Experience Is Req...
decor

Talk to us

Feel free to call, email, or hit us up on our social media accounts.
Social media