Free cookie consent management tool by TermsFeed Data Engineer | Antal Tech Jobs
Back to Jobs
4 Days ago

Data Engineer

decor
Gurugram, Haryana, India
Information Technology
Full-Time
Agivant Technologies

Overview

About the Role

We are looking for a skilled Data Engineer to join our team and play a key role in building and maintaining robust data pipelines that power AI-driven solutions. The ideal candidate will have strong expertise in data processing, ETL workflows, and real-time streaming, ensuring high-quality, reliable data for AI agents.

Key Responsibilities
  • Clean, organize, and prepare data for AI agents to consume.

  • Design, develop, and maintain ETL processes to ensure smooth data flow.

  • Generate reports on data quality and implement continuous improvements.

  • Identify and integrate structured, unstructured, and streaming data sources relevant to AI tasks.

  • Apply data cleaning, labeling, and normalization techniques.

  • Implement validation, deduplication, and error-handling mechanisms for data integrity.

  • Collaborate with cross-functional teams to ensure data availability and reliability.




Requirements

Required Skills & Qualifications
  • Programming: Proficiency in Python and SQL.

  • Big Data Frameworks: Strong knowledge of Apache Spark and Apache Flink.

  • Streaming Platforms: Experience with Apache Kafka for real-time data processing.

  • Workflow Orchestration: Hands-on experience with Apache Airflow.

  • Data Handling: Familiarity with both structured and unstructured data.

  • Data Quality: Experience implementing data quality checks for AI-driven systems.

  • Cloud Platforms: Working experience with AWS, GCP, or Azure.

Preferred Qualifications
  • Experience with containerization tools like Docker and Kubernetes.

  • Knowledge of data lake and data warehouse architectures.

  • Exposure to AI/ML data pipelines.

Share job
Similar Jobs
View All
16 Hours ago
Principal Engineer - UI/UX
Information Technology
  • 6 - 11 Yrs
  • Mumbai (All Areas)
looking for a technically savvy and experienced Principal Engineer to take up front-end development efforts. You will design and develop elegant interfaces that exceed client expectations in terms of value and benefit. You will collaborate on scalabi...
decor
16 Hours ago
Principal Engineer - Beckend
Information Technology
  • 7 - 11 Yrs
  • Mumbai (All Areas)
Principal Engineer - Backend Mumbai, Maharashtra, India | Product Engineering | Full-time We are looking for a technically savvy and experienced senior developer to lead development efforts. You will help the team grow in size and skills, optim...
decor
16 Hours ago
Principal Engineer - DevOps/DBA
Information Technology
  • 7 - 11 Yrs
  • Mumbai (All Areas)
we are looking for a technically savvy and passionate Principal DevOps Engineer or Senior Database Administrator to cater to the development and operations efforts in product. You will choose and deploy tools and technologies to build and support a r...
decor
18 Hours ago
C++ Developer | 5 - 8 Years
Information Technology
  • 30 - 45 INR - Yearly
  • 5 - 12 Yrs
  • Pune
About the Client: The company has been a global leader in delivering cutting-edge in-flight entertainment and connectivity (IFEC) solutions for over 40 years. About the Role: Title: SDE 3 C++ - 5 to 8 Years SDE 4 C++ - 8 to 13 Years ...
decor
2 Days ago
Business Analyst(GRC Domain) Internship in Hyderabad
Information Technology
  • Gurugram, Haryana, India
Selected Intern's Day-to-day Responsibilities Include Gather, analyze, and document business requirements. Translate business needs into functional specifications and user stories. Support in preparing business requirement documents (BRD), functi...
decor
2 Days ago
Creditsafe - Data Test Engineer
Information Technology
  • Gurugram, Haryana, India
We are looking for a Test Engineer who will become part of our team building and testing the Creditsafe data.You will be working closely with the database teams and data engineering to build specific systems facilitating the extraction and transform...
decor
2 Days ago
Business Advisory Analyst
Information Technology
  • Gurugram, Haryana, India
Skill required: Finance & Accounting - Budgeting and ForecastingDesignation: Business Advisory AnalystQualifications:Any GraduationYears of Experience:3 to 5 yearsAbout AccentureAccenture is a global professional services company with leading capabi...
decor
2 Days ago
IN_Senior Associate_.Net Developer_Emerging Businesses_Advisory_Gurugram
Information Technology
  • Gurugram, Haryana, India
Line of ServiceAdvisory Industry/SectorNot Applicable SpecialismEmerging Technologies Management LevelSenior Associate Job Description & SummaryAt PwC, our people in software and product innovation focus on developing cutting-edge software solutions...
decor

Talk to us

Feel free to call, email, or hit us up on our social media accounts.
Social media