Hyderabad, Telangana, India
Information Technology
Full-Time
Ford Motor Company
Overview
Job Description
Data Engineer - GSR5/GSR6
This role requires a combination of software engineer, data enginner and an ML developer where you're expected to build solutions integrating data pipelines & ML models. It also requires you to have basic knowledge and (preferably) hands-on experience on building back-end services(APIs) which integrate data & applications.
Responsibilities
Key Responsibilities:
Required Skills and Qualifications:
Data Engineer - GSR5/GSR6
This role requires a combination of software engineer, data enginner and an ML developer where you're expected to build solutions integrating data pipelines & ML models. It also requires you to have basic knowledge and (preferably) hands-on experience on building back-end services(APIs) which integrate data & applications.
Responsibilities
Key Responsibilities:
- Data Pipeline Development: Design, develop, and maintain scalable and reliable batch data pipelines using Python and Java, leveraging industry standard frameworks like Data proc and Dataflow.
- ELT Implementation: Implement efficient data extraction, transformation, and loading processes to move data from various sources into data warehouses, data lakes, or other storage systems.
- Backend Development: Develop and maintain backend services (potentially in Python or Java) that interact with data stores, trigger pipelines, and/or serve data via APIs.
- Data Storage Interaction: Work with various data storage technologies, including relational databases (SQL), data lakes (GCS, Big Query), and data warehouses (BigQuery).
- Performance Optimization: Analyze and optimize the performance of data pipelines and related services to ensure efficiency and cost-effectiveness when dealing with large datasets.
- Monitoring and Reliability: Implement monitoring, logging, and alerting for data pipelines and services to ensure their health, reliability, and data quality. Troubleshoot and resolve production issues.
- Collaboration: Collaborate effectively with Product Owners, Data Scientists, Data Engineers, MLOps Engineers, and other engineering teams to understand requirements and deliver integrated solutions.
- Code Quality & Testing: Write clean, well-tested, and maintainable code. Participate in code reviews.
- Technical Contribution: Contribute to architectural discussions and help define technical approaches for data and AI-related projects.
- AI/ML Integration (Additional responsibility): Work closely with Data Scientists to operationalize machine learning models. This includes building the infrastructure and code (incl. chatbots) to integrate models into data pipelines or backend services for training data preparation, inference, or prediction serving.
- Operational support: Handle tickets (incidents/requests) for data pipelines/chatbot applications & work with product owners/business customers to track the tickets to closure within pre-defined SLAs.
Required Skills and Qualifications:
- 4+ years of professional experience in software development.
- Strong proficiency and hands-on experience in both Python(Must-have) and Java(Nice to have).
- Experience building and maintaining data pipelines (batch or streaming) preferably on Cloud platforms(especially GCP).
- Experience with at least one major distributed data processing framework (e.g., DBT, DataForm, Apache Spark, Apache Flink, or similar).
- Experience with workflow orchestration tools (e.g., Apache Airflow, Qlik replicate etc).
- Experience working with relational databases (SQL) and understanding of data modeling principles.
- Experience with cloud platforms (Preferably GCP. AWS or Azure will also do) and relevant data services (e.g., BigQuery, GCS, Data Factory, Dataproc, Dataflow, S3, EMR, Glue etc.).
- Experience with data warehousing concepts and platforms (BigQuery, Snowflake, Redshift etc.).
- Understanding of concepts related to integrating or deploying machine learning models into production systems.
- Experience working in an Agile development environment & hands-on in any Agile work management tool(Rally, JIRA etc.).
- Experience with version control systems, particularly Git.
- Solid problem-solving, debugging, and analytical skills.
- Excellent communication and collaboration skills.
- Experience working in a production support team (L2/L3) for operational support.
- Familiarity with data quality and data governance concepts.
- Experience building and consuming APIs (REST, gRPC) related to data or model serving.
- Bachelor's or Master's degree in Computer Science, Engineering, Data Science, or a related field.
Similar Jobs
View All
1 Day ago
Technical Lead
Information Technology
- 7 - 14 Yrs
- Bengaluru
Experience: 7 + Years
Job Type: Full Time Hybrid
Job Location: Bangalore/ Mangalore
Job Description: We are seeking a highly skilled Senior Full Stack Engineer with hands-on experience in building, deploying, and maintaining modern serverles...
1 Day ago
Senior Software Engineer
Information Technology
- 5 - 12 Yrs
- Bengaluru
In this role, you will:
Lead complex technology initiatives including those that are companywide with broad impact
Act as a key participant in developing standards and companywide best practices for engineering complex and large scale technol...
1 Day ago
Software Engineer
Information Technology
- 2 - 10 Yrs
- Bengaluru
JOB DESCRIPTION:
As a software engineer, you will collaborate with a team of talented individuals to create products
that change the way restaurant operators manage their enterprise. We’re looking for ideas from
every facet of computer scien...
1 Day ago
Software Developer in Gurgaon
Information Technology
- Chennai, Tamil Nadu, India
Are you a skilled Software Developer with expertise in Natural Language Processing (NLP), LLM Ops, LLM evaluation, Model fine-tuning, Artificial intelligence, Generative AI Tools, Machine Learning, Machine Learning Operations (MLOps), and Cursor (Ge...
1 Day ago
Software Engineer - Test
Information Technology
- Chennai, Tamil Nadu, India
Job Description Preferred 2+ Years of experience in Manual testing. (preferred in Energy domain) Automation testing- Selenium knowledge added advantage. Strong experience in Web applications. (Mobile Applications will be added advantage) Strong ...
1 Day ago
SAP ABAP Technical Lead
Information Technology
- Chennai, Tamil Nadu, India
Job Description Strong SAP technology experience in multiple business and technical processes Profound ABAP development experience and expert in Performance Tuning ABAP Workbench, Report Programming, Module Programming, Authorizations, ABAP OOPS,...
1 Day ago
Java Software Developer, Trilogy (Remote) - $60,000/year USD
Information Technology
- Chennai, Tamil Nadu, India
Are you the kind of engineer who cringes at sloppy code, gets frustrated by deployment delays, and refuses to settle for yesterday's development methods? Do you see beyond mere programming to envision AI-powered systems that make conventional engine...
1 Day ago
Interesting Job Opportunity: iOS Developer - Objective C/SWIFT
Information Technology
- Chennai, Tamil Nadu, India
Job DescriptionWe are looking for a skilled and enthusiastic iOS Developer to join our team. The candidate will have experience developing and maintaining mobile applications on the iOS platform and possess a passion for creating user-friendly and h...
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in