Panchkula, Haryana, India
Information Technology
Full-Time
iamneo An NIIT Venture
Overview
We are looking for a highly skilled Big Data Engineer with expertise in cloud technologies to join our team. The ideal candidate will be responsible for designing, developing, and maintaining scalable big data solutions, ensuring efficient data processing, storage, and analytics. This role involves working with distributed systems, cloud platforms, and modern data frameworks to support real-time and batch data pipelines. The above-mentioned skillsets or roles are used for creating content and labs.
Responsibilities
Responsibilities
- Design, implement, and manage scalable big data architectures on AWS, Azure, or GCP.
- Develop ETL pipelines for ingesting, processing, and transforming large datasets.
- Work with Python, Apache Spark, Hadoop, and Kafka to build efficient data processing solutions.
- Implement data lakes, data warehouses, and streaming architectures.
- Optimize database and query performance for large-scale datasets.
- Collaborate with SMEs, Clients, and software engineers to deliver content.
- Ensure data security, governance, and compliance with industry standards.
- Automate workflows using Apache Airflow or other orchestration tools.
- Monitor and troubleshoot data pipelines to ensure reliability and scalability.
- Minimum educational qualifications: B. E., B. Sc, M. Sc, MCA
- Proficiency in Python, Java, or Scala for data processing.
- Hands-on experience with Apache Spark, Hadoop, Kafka, Flink, Storm.
- Hands-on experience working with SQL and NoSQL databases.
- Strong expertise in cloud-based data solutions (AWS / Google / Azure).
- Hands-on experience in building and managing ETL/ELT pipelines.
- Knowledge of containerization and orchestration, Docker or K8S.
- Hands-on with real-time data streaming and serverless data processing.
- Familiarity with machine learning pipelines and AI-driven analytics.
- Strong understanding of CI/CD & ETL pipelines for data workflows.
- Big Data Technologies: Apache Spark, Hadoop, Kafka, Flink, Storm.
- Cloud Platforms: AWS / Google / Azure.
- Programming Languages: Python, Java, Scala, SQL, PySpark.
- Data Storage and Processing: Data Lakes, Warehouses, ETL/ELT Pipelines.
- Orchestration: Apache Airflow, Prefect, Dagster.
- Databases: SQL (PostgreSQL, MySQL), NoSQL (MongoDB, Cassandra).
- Security and Compliance: IAM, Data Governance, Encryption.
- DevOps Tools: Docker, Kubernetes, Terraform, CI/CD Pipelines.
- Strong problem-solving and analytical skills.
- Excellent communication and collaboration abilities.
- Ability to work in an agile, fast-paced environment.
- Attention to detail and data accuracy.
- Self-motivated and proactive.
- Any Cloud or Data-related certifications.
Similar Jobs
View All
17 Hours ago
Data Analyst (Odia Speakers)
AI & Machine Learning Advancement
- 1 - 20 Yrs
- Jharkhand, Andhra Pradesh, Odisha
For thousands of years, maps have provided humans with the knowledge they need to make decisions. As a Maps Evaluator, you will have the opportunity to provide ground truth for your town, city or country.
At Peroptyx, we are looking for Data Ana...
17 Hours ago
Data Analyst (Kannada Speakers)
AI & Machine Learning Advancement
- 1 - 20 Yrs
- Karnataka, India
For thousands of years, maps have provided humans with the knowledge they need to make decisions. As a Maps Evaluator, you will have the opportunity to provide ground truth for your town, city or country.
At Peroptyx, we are looking for Data Ana...
19 Hours ago
Technical Lead - Backend Development - Node.Js
Finance & Banking
- 50,00,000 - 55,00,000 INR - Annual
- 6 - 8 Yrs
- Bangalore
What youʼll be doing
We are much more than our job descriptions, but here is where you will begin:
● Collaborate with stakeholders, including product owners, project managers, and scrum masters, to define and clarify project requirements.
● Transl...
19 Hours ago
Engineering Manager
Finance & Banking
- 55,00,000 - 60,00,000 INR - Annual
- 8 - 12 Yrs
- Bangalore
What youʼll be doing
Weʼre much more than our job descriptions, but hereʼs where youʼll begin:
● Lead and deliver large-scale platform and product initiatives that impact millions of users.
● Collaborate with product, design, and business teams to...
1 Day ago
Technical Project Manager (WordPress)
Information Technology
- 6 - 10 Yrs
- Ahmedabad
Location: Ahmedabad / Remote
Experience: 6+ Years
About Us:
E2M Solutions is home to a growing remote team of WordPress experts building innovative digital solutions. We pride ourselves on delivering consistent value and excellence to our client...
1 Day ago
Senior WordPress Frontend Developer
Information Technology
- 5 - 10 Yrs
- Ahmedabad
At E2M Solutions, we're building a powerhouse remote team to deliver high-performing, user-centric WordPress solutions. If you live and breathe frontend development and are looking to work on cutting-edge WordPress projects with a passionate global t...
1 Day ago
Python Developer - C++/EDA
Information Technology
- Chennai, Tamil Nadu, India
Job DescriptionWe are seeking a highly skilled C++ Python Developer with a strong background in software development, scripting, and EDA tool integration. This role focuses on creating, enhancing, and maintaining tools used in silicon design and ver...
1 Day ago
Business Analyst
Information Technology
- Chennai, Tamil Nadu, India
Project Role : Business AnalystProject Role Description : Analyze an organization and design its processes and systems, assessing the business model and its integration with technology. Assess current state, identify customer requirements, and defin...
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in