Free cookie consent management tool by TermsFeed Data Engineer | Antal Tech Jobs
Back to Jobs
14 Weeks ago

Data Engineer

decor
Mumbai, Maharashtra, India
Information Technology
Full-Time
Lexmark International, Inc.

Overview

Responsibilities :
Job Description/Responsibilities:

The candidate will work in Global IT as a Data Engineer who will be responsible for the creation, management, and optimization of data pipelines, data architectures, and systems that store and process large volumes of data. They will work collaboratively with data scientists and analysts to ensure that data is clean, well-organized, and available for decision-making processes. The ideal candidate will have a strong background in programming, database management, cloud technologies, and data systems.
Qualification: BE/B.Tech/ME/MCA with 2+ Years in IT Experience.
Key Responsibilities:-

1. Data Pipeline Development:

  • Design, implement, and optimize scalable data pipelines for batch and real-time processing.
  • Ensure seamless integration of data from various sources (APIs, databases, flat files, etc.) into data warehouses or data lakes.
  • Automate repetitive tasks for data collection, transformation, and loading.

2. Database Design and Management:

  • Design and manage relational and NoSQL databases (e.g., SQL, PostgreSQL, MongoDB, Cassandra, etc.).
  • Maintain the integrity and security of the data within databases and data warehouses.
  • Optimize queries and data storage techniques for performance and scalability.

3. ETL (Extract, Transform, Load) Processes:

  • Develop and manage ETL processes that extract data from various sources, transform it into useful formats, and load it into a storage solution.
  • Ensure data quality, consistency, and reliability during the ETL process.

4. Collaboration with Data Science/Analytics Teams:

  • Work closely with Data Scientists and Analysts to understand their data needs and deliver appropriate solutions.
  • Assist in preparing data for machine learning and predictive analytics.

5. Cloud Infrastructure & Big Data Technologies:

  • Work with cloud platforms such as Azure and AWS for data storage, processing, and analytics.
  • Utilize big data technologies (e.g., Hadoop, Spark, Kafka) to handle large datasets efficiently.

6. Data Quality Assurance:

  • Monitor data quality, consistency, and accuracy throughout the data lifecycle.
  • Implement data validation techniques to ensure the integrity of data used for reporting and analysis.

7. Performance Tuning and Optimization:

  • Analyze system performance and optimize queries, data pipelines, and storage to improve speed and efficiency.
  • Proactively address performance bottlenecks.

8. Documentation and Reporting:

  • Document the design, architecture, and processes of data systems.
  • Generate reports and metrics on data pipeline performance, issues, and optimization progress.
Must Have Skills/Skill Requirement:
Technical Skills:

  • Programming Languages: Proficiency in Python, Java, Scala, or similar programming languages.
  • SQL and NoSQL: Strong experience with SQL (MySQL, PostgreSQL, etc.) and NoSQL databases (MongoDB, Cassandra, etc.).
  • Data Pipeline Tools: Experience with tools like Apache Kafka, Apache Airflow, Apache NiFi, and other ETL frameworks.
  • Big Data Technologies: Familiarity with Hadoop, Spark, Hive, and related tools.
  • Cloud Platforms: Knowledge of Azure (Data Lake, Databricks) and AWS (Redshift, S3, Lambda).
  • Data Warehousing & Data Lakes: Experience with data warehousing technologies (e.g., Lakehouse, Snowflake, Redshift).

Soft Skills:

  • Problem-Solving: Strong analytical and problem-solving skills.
  • Collaboration: Ability to work cross-functionally with Data Scientists, Analysts, and other stakeholders.
  • Attention to Detail: High level of precision in handling and manipulating data.
  • Time Management: Ability to prioritize tasks and work in a fast-paced environment.

How to Apply ?
Are you an innovator? Here is your chance to make your mark with a global technology leader. Apply now!
Share job
Similar Jobs
View All
1 Day ago
Python Developer - Bangalore/ Pune
Space Exploration & Research, Information Technology
  • Pune, Maharashtra, India
Job Title: Python Developer with React.js - Bangalore/ Pune About Us “Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the British Bank Award and has been ranked Top 100 Best Com...
decor
1 Day ago
Azure Devops Engineer(5+ Yrs Exp)
Space Exploration & Research, Information Technology
  • Pune, Maharashtra, India
Required Qualifications & Skills: 5+ years in DevOps, SRE, or Infrastructure Engineering. Strong expertise in Cloud (AWS/GCP/Azure) & Infrastructure-as-Code (Terraform, CloudFormation). Proficient in Docker & Kubernetes. Hands-on with CI/CD tools ...
decor
1 Day ago
Practo Technologies - Lead Frontend Software Engineer - React.js/Next.js
Information Technology
Lead Software Engineer - UI Job DescriptionAbout Practo : www.practo.comPracto is the world's leading healthcare platform that connects millions of patients with hundreds of thousands of healthcare providers around the world and helps people make be...
decor
1 Day ago
Software Engineer 2
Space Exploration & Research, Information Technology
  • Pune, Maharashtra, India
As industries race to embrace AI, traditional database solutions fall short of rising demands for versatility, performance, and affordability. Couchbase is leading the way with Capella, the developer data platform for critical applications in our AI...
decor
1 Day ago
.Net Developer - Full Stack Technologies
Information Technology
Job Title : Senior .NET Full Stack DeveloperCompany : XevyteLocation : Bangalore (Hybrid)Experience Required : 6+ YearsAbout XevyteXevyte is a global technology and services company committed to driving digital transformation and sustainable growth....
decor
1 Day ago
SAP-Data Analyst
Space Exploration & Research, Information Technology
  • Pune, Maharashtra, India
Job Role:- SAP-Data Analyst  Job Location: -Noida/Gurgaon/Hyderabad/Bangalore/Pune Experience: -5 Years Job Roles & Responsibilities: - Collaborate with Finance & FBT Teams: Drive all data-related activities for the finance SAP deployment, ensur...
decor
1 Day ago
Senior Data Analyst Engineer
Space Exploration & Research, Information Technology
  • Pune, Maharashtra, India
Mirra Healthcare India Immedidate Joiners Only Job Description: We are seeking a highly skilled and experienced Senior Data Analyst/Engineer with a strong background in Python programming and Power BI development. The ideal candidate will have at ...
decor
1 Day ago
Senior Manager, Data Stewardship Engineer
Information Technology
  • Pune, Maharashtra, India
This site is for Residents of Europe, Middle East, Africa, Latin America & Asia Pacific.Residents of the United States, Canada & Puerto Rico, please click here. ...
decor

Talk to us

Feel free to call, email, or hit us up on our social media accounts.
Social media