Gurugram, Haryana, India
Information Technology
Full-Time
UST
Overview
Role Description
ocation: Any UST Location
Experience: 6 to 9 years
Mandatory Skills: PySpark, GCP, Hadoop, Hive, AWS, GCP
Good to Have: CI/CD and DevOps experience
Job Description
We are seeking a highly skilled Senior Big Data Engineer to join our team at UST. The ideal candidate will have solid experience in Big Data technologies, cloud platforms, and data processing frameworks with a strong focus on PySpark and Google Cloud Platform (GCP).
Key Responsibilities
Spark,Hadoop,Hive,Gcp
ocation: Any UST Location
Experience: 6 to 9 years
Mandatory Skills: PySpark, GCP, Hadoop, Hive, AWS, GCP
Good to Have: CI/CD and DevOps experience
Job Description
We are seeking a highly skilled Senior Big Data Engineer to join our team at UST. The ideal candidate will have solid experience in Big Data technologies, cloud platforms, and data processing frameworks with a strong focus on PySpark and Google Cloud Platform (GCP).
Key Responsibilities
- Design, develop, and maintain scalable data pipelines and ETL workflows using PySpark, Hadoop, and Hive.
- Deploy and manage big data workloads on cloud platforms like GCP and AWS.
- Work closely with cross-functional teams to understand data requirements and deliver high-quality solutions.
- Optimize data processing jobs for performance and cost-efficiency on cloud infrastructure.
- Implement automation and CI/CD pipelines to streamline deployment and monitoring of data workflows.
- Ensure data security, governance, and compliance in cloud environments.
- Troubleshoot and resolve data issues, monitoring job executions and system health.
- PySpark: Strong experience in developing data processing jobs and ETL pipelines.
- Google Cloud Platform (GCP): Hands-on experience with BigQuery, Dataflow, Dataproc, or similar services.
- Hadoop Ecosystem: Expertise with Hadoop, Hive, and related big data tools.
- AWS: Familiarity with AWS data services like S3, EMR, Glue, or Redshift.
- Strong SQL and data modeling skills.
- Experience with CI/CD tools and DevOps practices (Jenkins, GitLab, Terraform, etc.).
- Containerization and orchestration knowledge (Docker, Kubernetes).
- Experience with Infrastructure as Code (IaC).
- Knowledge of data governance and data security best practices.
Spark,Hadoop,Hive,Gcp
Similar Jobs
View All
1 Day ago
Senior Azure Data Engineer - ETL/Power BI
Social Good & Community Development
We are seeking an experienced and hands-on Senior Azure Data Engineer with Power BI expertise to take on a dual role that combines technical leadership and active development.You will lead BI and data engineering efforts for enterprise-grade analyti...
1 Day ago
Cyber Security Analyst - SOC
Social Good & Community Development
Experience : 3+years.Location : Nagpur.Notice period : 30days.Mandatory skills : SOC, Qradar , Endpoint corwdstrike.Job Description Responsible for conducting information security investigations as a result of security incidents identified by t...
1 Day ago
QA Automation Tester - Selenium/Cypress
Social Good & Community Development
We are seeking a skilled and detail-oriented QA Automation Tester to join our Quality Assurance team.The ideal candidate will be responsible for designing and executing automated test cases, building test frameworks, and ensuring the delivery of hig...
1 Day ago
AWS Cloud Security Consultant
Social Good & Community Development
Experience: 7+ YearsLocation: Pune or HyderabadNotice Period: Immediate to 30 Days🛡️ Role OverviewWe are looking for an experienced AWS Cloud Security Consultant (Specialist level) with a deep understanding of AWS native security capabilities. You w...
1 Day ago
Big Data Engineer
Social Good & Community Development
This job is with Amazon, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. DescriptionProfit Intelligence team in Amazon Retail is seeking a ...
1 Day ago
Software Engineer II – Python, PySpark, AWS
Social Good & Community Development
hackajob is collaborating with J.P. Morgan to connect them with exceptional tech professionals for this role.You’re ready to gain the skills and experience needed to grow within your role and advance your career — and we have the perfect software en...
1 Day ago
Credence Global Solutions - Software Developer - Javascript/.Net Core/MVC
Social Good & Community Development
We are looking for a skilled and enthusiastic Software Developer (.Net MVC / .Net Core) to join our growing technology team. The ideal candidate will have a strong background in Microsoft technologies and experience building scalable web application...
1 Day ago
Senior Data Engineer
Social Good & Community Development
Job SummaryWe are looking for a skilled and motivated Software Engineer with strong experience in data engineering and ETL processes.The ideal candidate should be comfortable working with any object-oriented programming language, possess strong SQL ...
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in