Thiruvananthapuram, Kerala, India
Information Technology
Full-Time
OSI Digital
Overview
Job Title: Lead Data Engineer
Experience: 7 - 9 years
Location: Hyderabad, INDIA.
OSI Digital is looking for a Lead Data Engineer to work on enterprise scale implementations, upgrade and support ongoing projects. At OSI good performers will be rewarded with our well-designed recognition programs.
Responsibilities
Experience: 7 - 9 years
Location: Hyderabad, INDIA.
OSI Digital is looking for a Lead Data Engineer to work on enterprise scale implementations, upgrade and support ongoing projects. At OSI good performers will be rewarded with our well-designed recognition programs.
Responsibilities
- Hands-on technical person with rich experience on the above mentioned skills & managing a small team of 5-10 members and providing oversight on the project.
- Communicating with senior management and customers verbally and in writing.
- Architect, Build & Monitor data systems and pipelines.
- Provide Solutions as need arises.
- Develop Data Frames using PySpark
- Conduct complex data analysis and report on results.
- Combine raw information from different sources.
- Explore ways to enhance data quality and reliability.
- 7-9 years of data engineering experience loading, analyzing and interpreting complex datasets.
- Min 5+ years of rich experience with AWS Glue, Lambda, Step Functions, Python, PySpark, Redshift, S3,
- Kinesis, IAM, VPC, EC2, Security Roles/Policies, Cloud Watch, Load Balancers.
- Experience with Airflow / any other orchestration frameworks.
- Experience with distributed systems such as Cloudera/Horton Works.
- Experience with data modeling, warehousing and building ETL pipelines on Cloud Platforms.
- Experience working on and delivering end to end projects independently & managing a small team of 5-10 members and providing oversight on the project.
- Experience with non-relational databases / data stores (object storage, document or key-value stores, graph databases, column-family databases).
- 5+ years of developing and operating large-scale data structures for business intelligence analytics (using ETL/ELT processes) experience, such as ETL Glue etc.,
- Experience in at least one modern scripting or programming language, such as Python, Java, Scala, or NodeJS and reasonable knowledge/experience writing Cloud Formation Templates (CFT) / Terraform.
- Not interested in working from the office
Similar Jobs
View All
1 Day ago
Software Developer 4
Information Technology
- Bangalore, Karnataka, India
Job DescriptionDesign, develop, troubleshoot and debug software programs for databases, applications, tools, networks etc.ResponsibilitiesAs a member of the software engineering division, you will take an active role in the definition and evolution ...
1 Day ago
Software Developer (ReactJS & DotNet) in Faridabad, Noida, Palwal, Ballabgarh
Information Technology
- Bangalore, Karnataka, India
As a Software Developer at Digital Shahi Pvt. Ltd., you will have the opportunity to work on cutting-edge technologies such as ReactJS, DotNet, MongoDB, MERN stack, and Node.js. Join our dynamic team and be a part of revolutionizing the digital land...
1 Day ago
iOS Developer - Objective C/SWIFT
Information Technology
- Bangalore, Karnataka, India
Job DescriptionWe are looking for a skilled and enthusiastic iOS Developer to join our team. The candidate will have experience developing and maintaining mobile applications on the iOS platform and possess a passion for creating user-friendly and h...
1 Day ago
Manual/Automation Tester
Information Technology
- Thiruvananthapuram, Kerala, India
Job DescriptionThis is a full-time on-site role located in Hyderabad. As a Testing professional with 0-2 year of experience, you will be responsible for conducting testing activities, including developing and executing test plans, test cases, and te...
1 Day ago
Sr. Software Engineer - iOS Development
Information Technology
- Thiruvananthapuram, Kerala, India
Position Description: As a Senior Software Engineer, iOS Developer, you will contribute to the development of intuitive, high-performance iOS applications for enterprise use. This role focuses on implementing features and improving the product exper...
1 Day ago
Sr. Software Engineer
Information Technology
- Thiruvananthapuram, Kerala, India
What you will do: Design, develop, enhance, and test software / embedded software for medical and connectivity products for R&D department. Closely work with peers in software engineering, software quality assurance and project & product management ...
1 Day ago
PHP Developer - Laravel Frameworks
Information Technology
- Thiruvananthapuram, Kerala, India
Location: Pune, Bengaluru, Chennai, Hyderabad, GurugramWork Model: Hybrid (3 days from office)Experience Required: 10+ yearsRole Type: Individual ContributorClient: US-based multinational banking institutionNotice Period: Immediate to 21 daysRole Su...
1 Day ago
Data Engineer - Generative AI
Information Technology
- Thiruvananthapuram, Kerala, India
About The RoleWe are seeking a skilled and passionate Data Engineer to join our team and drive the development of scalable data pipelines for Generative AI (GenAI) and Large Language Model (LLM)-powered applications. This role demands hands-on exper...
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in