Overview
Description
The Data Engineer supports, develops, and maintains a data and analytics platform to efficiently process, store, and make data available to analysts and other consumers. This role collaborates with Business and IT teams to understand requirements and best leverage technologies for agile data delivery at scale.
Note:- Even though the role is categorized as Remote, it will follow a hybrid work model.
Key Responsibilities
Qualifications, Skills, and Experience:
Must-Have
Education, Licenses, and Certifications:
Organization Cummins Inc.
Role Category Remote
Job Type Exempt - Experienced
ReqID 2411641
Relocation Package No
The Data Engineer supports, develops, and maintains a data and analytics platform to efficiently process, store, and make data available to analysts and other consumers. This role collaborates with Business and IT teams to understand requirements and best leverage technologies for agile data delivery at scale.
Note:- Even though the role is categorized as Remote, it will follow a hybrid work model.
Key Responsibilities
- Implement and automate deployment of distributed systems for ingesting and transforming data from various sources (relational, event-based, unstructured).
- Develop and operate large-scale data storage and processing solutions using cloud-based platforms (e.g., Data Lakes, Hadoop, HBase, Cassandra, MongoDB, DynamoDB).
- Ensure data quality and integrity through continuous monitoring and troubleshooting.
- Implement data governance processes, managing metadata, access, and data retention.
- Develop scalable, efficient, and quality data pipelines with monitoring and alert mechanisms.
- Design and implement physical data models and storage architectures based on best practices.
- Analyze complex data elements and systems, data flow, dependencies, and relationships to contribute to conceptual, physical, and logical data models.
- Participate in testing and troubleshooting of data pipelines.
- Utilize agile development technologies such as DevOps, Scrum, and Kanban for continuous improvement in data-driven applications.
Qualifications, Skills, and Experience:
Must-Have
- 2-3 years of experience in data engineering with expertise in Azure Databricks and Scala/Python.
- Hands-on experience with Spark (Scala/PySpark) and SQL.
- Strong understanding of SPARK Streaming, SPARK Internals, and Query Optimization.
- Proficiency in Azure Cloud Services.
- Agile Development experience.
- Experience in Unit Testing of ETL pipelines.
- Expertise in creating ETL pipelines integrating ML models.
- Knowledge of Big Data storage strategies (optimization and performance).
- Strong problem-solving skills.
- Basic understanding of Data Models (SQL/NoSQL) including Delta Lake or Lakehouse.
- Exposure to Agile software development methodologies.
- Quick learner with adaptability to new technologies.
- Understanding of the ML lifecycle.
- Exposure to Big Data open-source technologies.
- Experience with clustered compute cloud-based implementations.
- Familiarity with developing applications requiring large file movement in cloud environments.
- Experience in building analytical solutions.
- Exposure to IoT technology.
- System Requirements Engineering: Translates stakeholder needs into verifiable requirements.
- Collaborates: Builds partnerships and works collaboratively with others.
- Communicates Effectively: Develops and delivers clear communications for various audiences.
- Customer Focus: Builds strong customer relationships and delivers customer-centric solutions.
- Decision Quality: Makes timely and informed decisions to drive progress.
- Data Extraction: Performs ETL activities from various sources using appropriate tools and technologies.
- Programming: Writes and tests computer code using industry standards, tools, and automation.
- Quality Assurance Metrics: Applies measurement science to assess solution effectiveness.
- Solution Documentation: Documents and communicates solutions to enable knowledge transfer.
- Solution Validation Testing: Ensures configuration changes meet design and customer requirements.
- Data Quality: Identifies and corrects data flaws to support governance and decision-making.
- Problem Solving: Uses systematic analysis to identify and resolve issues effectively.
- Values Differences: Recognizes and values diverse perspectives and cultures.
Education, Licenses, and Certifications:
- College, university, or equivalent degree in a relevant technical discipline, or equivalent experience required.
- This position may require licensing for compliance with export controls or sanctions regulations.
- Work primarily with stakeholders in the US, requiring a 2-3 hour overlap during EST hours as needed.
Organization Cummins Inc.
Role Category Remote
Job Type Exempt - Experienced
ReqID 2411641
Relocation Package No
Similar Jobs
View All
4 Minutes ago
Data Analyst (Odia Speakers)
AI & Machine Learning Advancement
- 1 - 20 Yrs
- Jharkhand, Andhra Pradesh, Odisha
For thousands of years, maps have provided humans with the knowledge they need to make decisions. As a Maps Evaluator, you will have the opportunity to provide ground truth for your town, city or country.
At Peroptyx, we are looking for Data Ana...
5 Minutes ago
Data Analyst (Kannada Speakers)
AI & Machine Learning Advancement
- 1 - 20 Yrs
- Karnataka, India
For thousands of years, maps have provided humans with the knowledge they need to make decisions. As a Maps Evaluator, you will have the opportunity to provide ground truth for your town, city or country.
At Peroptyx, we are looking for Data Ana...
2 Hours ago
Technical Lead - Backend Development - Node.Js
Finance & Banking
- 50,00,000 - 55,00,000 INR - Annual
- 6 - 8 Yrs
- Bangalore
What youʼll be doing
We are much more than our job descriptions, but here is where you will begin:
● Collaborate with stakeholders, including product owners, project managers, and scrum masters, to define and clarify project requirements.
● Transl...
2 Hours ago
Engineering Manager
Finance & Banking
- 55,00,000 - 60,00,000 INR - Annual
- 8 - 12 Yrs
- Bangalore
What youʼll be doing
Weʼre much more than our job descriptions, but hereʼs where youʼll begin:
● Lead and deliver large-scale platform and product initiatives that impact millions of users.
● Collaborate with product, design, and business teams to...
7 Hours ago
Technical Project Manager (WordPress)
Information Technology
- 6 - 10 Yrs
- Ahmedabad
Location: Ahmedabad / Remote
Experience: 6+ Years
About Us:
E2M Solutions is home to a growing remote team of WordPress experts building innovative digital solutions. We pride ourselves on delivering consistent value and excellence to our client...
7 Hours ago
Senior WordPress Frontend Developer
Information Technology
- 5 - 10 Yrs
- Ahmedabad
At E2M Solutions, we're building a powerhouse remote team to deliver high-performing, user-centric WordPress solutions. If you live and breathe frontend development and are looking to work on cutting-edge WordPress projects with a passionate global t...
14 Hours ago
UI/UX Designer
Healthcare & Life Sciences
- 2 - 5 Yrs
- Anywhere in India/Multiple Locations
We’re Hiring: UI/UX Designer (Full-time / Part-time / Freelance / Remote) 🌟
We are looking for a highly creative and passionate UI/UX Designer to join us in designing our website.
🔹 What We’re Looking For:
Strong proficiency in Figma and/or Photos...
1 Day ago
Senior Data Engineer
Information Technology
- 4 - 8 Yrs
- Bangalore
We are looking for a skilled and driven Data Engineer to join our dynamic technology team. As a Data Engineer, you will be responsible for building and maintaining robust, scalable, and high-performance data pipelines and platforms. This role involve...
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in