Jaipur, Rajasthan, India
Information Technology
Full-Time
News Corp
Overview
Equal Opportunity Employer
All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, protected veteran status, or disability status. EEO/AA/M/F/Disabled/Vets
Job Description :
About The Role
We are looking for a Senior Data Engineer with experience in excellent analytical abilities in GCP BigQuery, ETL/BI, Python, Composer/Airflow, SQL, GCP Services - with the ability to operate in an agile environment and keen to detail while understanding the larger data warehouse.
Skills & Competencies
➔ A minimum of 4.5+ years of working experience as a hands-on data engineering is a must
➔ Advanced Degree in the field of Computer Science, Data Engineering, Data Analytics or equivalent discipline
➔ Strong programming experience with Python, SQL, ETL and efficiently querying big datasets using SQL
➔ Prior experience with CircleCI CI/CD, Terraform and Github version control is a must
➔ Solid understanding of Data Collection, Data Ingestion, Data Integration, and Data Operations & Maintenance
➔ Implement data governance practices, including data quality, security, and compliance, in line with organizational standards.
➔ Domain knowledge on News, Media & Communications is an added advantage.
R E S P O N S I B I L I T I E S
➔ Design, build, and maintain scalable ETL/ELT pipelines in Google Cloud, using tools like Cloud Composer (Airflow), and BigQuery.
➔ Collaborate with cross-functional teams to define data architecture and data warehouse requirements
➔ Automate data pipelines, ETL/ELT processes, and data integration workflows using infrastructure-as-code (IaC) and configuration management tools
➔ Deep understanding of BigQuery, including SQL, optimization techniques, partitioning, clustering, and performance tuning.
➔ Deliver production quality, modular, reproducible code in Python, SQL
➔ Implement continuous integration and continuous deployment (CI/CD) pipelines for data pipelines and data-related applications
➔ Keep abreast of the latest developments in the field through continuous learning and proactively champion promising new methods relevant to the problems at hand.
Our Tech Stack
Job Category:
All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, protected veteran status, or disability status. EEO/AA/M/F/Disabled/Vets
Job Description :
About The Role
We are looking for a Senior Data Engineer with experience in excellent analytical abilities in GCP BigQuery, ETL/BI, Python, Composer/Airflow, SQL, GCP Services - with the ability to operate in an agile environment and keen to detail while understanding the larger data warehouse.
Skills & Competencies
➔ A minimum of 4.5+ years of working experience as a hands-on data engineering is a must
➔ Advanced Degree in the field of Computer Science, Data Engineering, Data Analytics or equivalent discipline
➔ Strong programming experience with Python, SQL, ETL and efficiently querying big datasets using SQL
➔ Prior experience with CircleCI CI/CD, Terraform and Github version control is a must
➔ Solid understanding of Data Collection, Data Ingestion, Data Integration, and Data Operations & Maintenance
➔ Implement data governance practices, including data quality, security, and compliance, in line with organizational standards.
➔ Domain knowledge on News, Media & Communications is an added advantage.
R E S P O N S I B I L I T I E S
➔ Design, build, and maintain scalable ETL/ELT pipelines in Google Cloud, using tools like Cloud Composer (Airflow), and BigQuery.
➔ Collaborate with cross-functional teams to define data architecture and data warehouse requirements
➔ Automate data pipelines, ETL/ELT processes, and data integration workflows using infrastructure-as-code (IaC) and configuration management tools
➔ Deep understanding of BigQuery, including SQL, optimization techniques, partitioning, clustering, and performance tuning.
➔ Deliver production quality, modular, reproducible code in Python, SQL
➔ Implement continuous integration and continuous deployment (CI/CD) pipelines for data pipelines and data-related applications
➔ Keep abreast of the latest developments in the field through continuous learning and proactively champion promising new methods relevant to the problems at hand.
Our Tech Stack
- Google Cloud Platform is IaaS
- BigQuery, GCS, Python, SQL
- Composer / Airflow - orchestration tools
- Terraform, CircleCI, CI/CD, GIthub, Jira, Confluence
Job Category:
Similar Jobs
View All
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in