Hyderabad, Telangana, India
Information Technology
Full-Time
State Street
Overview
As a data engineer, you will play a crucial role in our data infrastructure and analytics initiatives. You will contribute to the design, development, enhancement & maintenance of data pipelines, ensuring data integrity, scalability and security. This is an opportunity to work within a very strong development team and help to develop new challenging features in the Collateral management using cutting edge technologies.
Hiring for a skilled data architect with 5 - 12 years of experience with deep understanding of data processing frameworks and solid experience with ETL development using distributed computing frameworks as Apache Spark, Databricks, Python, PySpark. Additionally, cloud experience particularly with AWS platform is highly desirable.
- Collaborate with stakeholders to design and build and maintain robust and scalable data pipelines to efficiently collect, transform and load high volume of data from various sources using data ingestion tools
- Develop and optimize data models & schema for analytical and operational use cases
- Establish data quality standards & best practices, implement data governance process and ensure data integrity, security and compliance
- Create visual representations of data to help business and organization understand complex information
- Work closely with infrastructure and DevOps teams to ensure the reliability, performance and scalability of our data infrastructure
- Build data integrations between on-prem/cloud-based systems
- Monitor and troubleshoot issues in production environment
- Drive continuous improvement initiatives to optimize performance, reliability and scalability of applications
- Mentor and coach team member on design, architecture, best practices and development methodologies
- Evaluate new technologies, frameworks and tools in the data engineering space to drive innovation and improve data processing capabilities
Core/Must have skills:
- Good hands-on experience in Python/PySpark with strong experience in Spark scala/PySpark and Spark SQL for data processing and Databricks, AWS services
- Hands-on experience in SQL, PL/SQL, Unix Shell Scripting, Autosys/Airflow
- Experience with relational databases such as Oracle, PostgreSQL as well as NoSQL databases
- Data integration techniques and tools including APIs and data streaming
- Strong analytical and problem solving skills, with the ability to identify and resolve issues in data pipelines and systems
- Experience with Agile software development methodology and version control systems like GitHub
- Expertise in Data Modeling and DB design with the skills in performance tuning
- Support existing data platforms and products in production for any critical issues and provide resolution fixes
- Have good communication skill, and collaborate well with different teams/stakeholders and vendors
Good to have skills:
- Knowledge of AWS based data storage & processing services, DevOps would be a Plus
- Knowledge in Spark based data engineering solutions using Databricks and Unity Catalog
- Experience with containerization and orchestration technologies such as Docker and Kubernetes is a Plus
- Excellent work ethics with ability to work independently
- Experience in Banking Domain preferred
Work Schedule: Hybrid
Why this role is important to us:
Our technology function, Global Technology Services (GTS), is vital to State Street and is the key enabler for our business to deliver data and insights to our clients. We’re driving the company’s digital transformation and expanding business capabilities using industry best practices and advanced technologies such as cloud, artificial intelligence and robotics process automation.
We offer a collaborative environment where technology skills and innovation are valued in a global organization. We’re looking for top technical talent to join our team and deliver creative technology solutions that help us become an end-to-end, next-generation financial services company.
Join us if you want to grow your technical skills, solve real problems and make your mark on our industry.
About State Street:
What we do. State Street is one of the largest custodian banks, asset managers and asset intelligence companies in the world. From technology to product innovation, we’re making our mark on the financial services industry. For more than two centuries, we’ve been helping our clients safeguard and steward the investments of millions of people. We provide investment servicing, data & analytics, investment research & trading and investment management to institutional clients.
Work, Live and Grow. We make all efforts to create a great work environment. Our benefits packages are competitive and comprehensive. Details vary by location, but you may expect generous medical care, insurance and savings plans, among other perks. You’ll have access to flexible Work Programs to help you match your needs. And our wealth of development programs and educational support will help you reach your full potential.
Inclusion, Diversity and Social Responsibility. We truly believe our employees’ diverse backgrounds, experiences and perspectives are a powerful contributor to creating an inclusive environment where everyone can thrive and reach their maximum potential while adding value to both our organization and our clients. We warmly welcome candidates of diverse origin, background, ability, age, sexual orientation, gender identity and personality. Another fundamental value at State Street is active engagement with our communities around the world, both as a partner and a leader. You will have tools to help balance your professional and personal life, paid volunteer days, matching gift programs and access to employee networks that help you stay connected to what matters to you.
State Street is an equal opportunity and affirmative action employer.
State Street's Speak Up Line
Similar Jobs
View All
1 Day ago
TrueFan - Senior Machine Learning Engineer
Information Technology
- Thiruvananthapuram, Kerala, India
About UsTrueFan is at the forefront of AI-driven content generation, leveraging cutting-edge generative models to build next-generation products. Our mission is to redefine content generation space through advanced AI technologies, including deep ge...
1 Day ago
Salesforce commerce cloud consultant
Information Technology
- Thiruvananthapuram, Kerala, India
Salesforce Commerce Cloud consultant 5+ Years of Experience 6 to 12 months Mode - Remote 1.1LPM - 1.2LPM Max Key Responsibilities Translate business requirements into scalable Salesforce Service Cloud solutions, in collaboration with CAE's technic...
1 Day ago
Cloud Infrastructure Engineer
Information Technology
- Thiruvananthapuram, Kerala, India
DescriptionInvent the future with us. Recognized by Fast Company’s 2023 100 Best Workplaces for Innovators List, Ampere is a semiconductor design company for a new era, leading the future of computing with an innovative approach to CPU design focuse...
1 Day ago
Devops Engineer- Intermetiate
Information Technology
- Thiruvananthapuram, Kerala, India
BackJD: Dev ops Engineer:As a DevOps Specialist- should be able to take ownership of the entire DevOps process, including Automated CI/CD pipelines and deployment to production.They should also be comfortable with risk analysis and prioritization.Le...
1 Day ago
Sr Data Scientist (London)
Information Technology
- Thiruvananthapuram, Kerala, India
AryaXAI stands at the forefront of AI innovation, revolutionizing AI for mission-critical, highly regulated industries by building explainable, safe, and aligned systems that scale responsibly. Our mission is to create AI tools that empower research...
1 Day ago
Software Test Engineer
Information Technology
- Thiruvananthapuram, Kerala, India
By clicking the “Apply” button, I understand that my employment application process with Takeda will commence and that the information I provide in my application will be processed in line with Takeda’s Privacy Notice and Terms of Use. I further att...
1 Day ago
Software Developer 5 (Java Fullstack)
Information Technology
- Thiruvananthapuram, Kerala, India
Job DescriptionBuilding off our Cloud momentum, Oracle has formed a new organization - Oracle Health Applications & Infrastructure. This team focuses on product development and product strategy for Oracle Health, while building out a complete platfo...
1 Day ago
Java Developer - Spring Frameworks
Information Technology
- Thiruvananthapuram, Kerala, India
Java DescriptionWe are looking for a passionate and talented Java Developer with 2-3 years of hands-on experience to join our growing development team.The ideal candidate should have a strong foundation in Java technologies and the ability to develo...
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in