Hyderabad, Telangana, India
Information Technology
Full-Time
MyCareernet
Overview
Company: Global Banking Organization
Key Skills: SCALA, Big Data, Python, ETL, Spark, AWS Lambda, Athena
Roles and Responsibilities:
- Design and build end-to-end scalable ETL pipelines using Scala, Spark, and Python
- Develop solutions for data staging, ingestion, transformation, and integration across various platforms
- Work with big data ecosystems, especially on AWS Cloud, to build data-driven solutions
- Design and optimize technical data architectures for performance and cost efficiency
- Collaborate with stakeholders to understand business goals and convert them into technical requirements
- Participate in agile development lifecycle - including planning, design, development, testing, and deployment
- Ensure compliance with data governance, security, and privacy standards
- Contribute to the evolution and standardization of data engineering practices
- Uplift team capabilities by mentoring and sharing best practices
- Troubleshoot complex production issues and support continuous improvement initiatives
- Drive high-quality documentation and promote coding excellence
Skills Required:
- 7-10 years of experience in Data Engineering, Analytics, or Data Warehousing
- Strong expertise in ETL pipeline development using Scala, Spark, and UNIX Shell Scripting
- Advanced proficiency in Python frameworks for data processing
- Hands-on experience with AWS services, including but not limited to:
- Lambda, Athena, S3, Glue, EMR, Redshift, Kinesis, DynamoDB, Step Functions, CloudWatch, IAM
- Solid understanding of Oracle SQL, PL/SQL, and performance tuning
- Exposure to Teradata, Cloudera Hadoop, and tools like Tableau, OBIEE, SAS, Hive
- Familiarity with ETL tools such as Ab Initio is a strong plus
- Experience with Agile methodologies and Data Delivery Life Cycle frameworks
- Strong analytical, problem-solving, and stakeholder management skills
- Ability to work autonomously and take ownership of deliverables
- Excellent communication and collaboration abilities
Education: Bachelor's degree in Computer Science, Information Technology, or a related engineering field
Similar Jobs
View All
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in