Free cookie consent management tool by TermsFeed Data Engineer - Manager | Antal Tech Jobs
Back to Jobs
3 Days ago

Data Engineer - Manager

decor
Dehra dun, Uttarakhand, India
Information Technology
Full-Time
State Street

Overview

  • Technical Lead (overall 10+ years good development experience) with good hands-on experience in Python/PySpark with strong experience in Spark scala/PySpark and Spark SQL for big data processing and Databricks, AWS services,Kafka, Airflow.
  • Hands-on experience in SQL, PL/SQL, Unix Shell Scripting, Autosys.
  • Experience with relational databases such as Oracle, PostgreSQL as well as NoSQL databases
  • Data integration techniques and tools including APIs and data streaming
  • Strong analytical and problem solving skills, with the ability to identify and resolve issues in data pipelines and systems
  • Experience with Agile software development methodology and version control systems like GitHub
  • Expertise in Data Modeling and DB design with the skills in performance tuning
  • Support existing data platforms and products in production for any critical issues and provide resolution fixes
  • Have good communication skill, and collaborate well with different teams/stakeholders and vendors
  • Expected to spend 90% of the time on hands-on development, design and architecture and remaining 10% on guiding the team on technology and removing other impediments Capital Markets Projects experience preferred Provides advanced technical expertise in analyzing, designing, estimating, and developing software applications to project schedule. Oversees systems design and implementation of most complex design components. Creates project plans and deliverables and monitors task deadlines. Oversees, maintains and supports existing software applications. Provides subject matter expertise in reviewing, analyzing, and resolving complex issues. Designs and executes end to end system tests of new installations and/or software prior to release to minimize failures and impact to business and end users. Responsible for resolution, communication, and escalation of critical technical issues. Prepares user and systems documentation as needed. Identifies and recommends Industry best practices. Serves as a mentor to junior staff.
  • Ability to lead a team of agile developers.
  • Worked in a complex deadline driven projects with minimal supervision. Ability to architect/design/develop with minimum requirements by effectively.
  • 2+ experience on Apache Kafka streaming processing and Python scripting.
  • End to end understanding of software architecture, design, development and implementation.
  • Min 8+ years of good experience on AWS clouds and Data bricks,Airflow.
  • Excellent work ethics with ability to work independently.
  • Experience in Banking Domain preferred.
Share job
Similar Jobs
View All
11 Hours ago
Program Manager
Information Technology
  • 15 - 18 Yrs
  • Gurgaon / Gurugram
We’re Hiring | Program Manager Location: Gurugram, India Domain: Program Management | Digital Systems | Java/.NET | Agile | Fintech/Supply Chain Are you a strategic thinker with deep experience in program management of digital products? We’re lo...
decor
11 Hours ago
Technical Fullstack Architect - Node.js
Information Technology
  • 50,00,000 - 60,00,000 INR - Annual
  • 12 - 18 Yrs
  • Hyderabad
About the Role: We are seeking a Fullstack Technical Architect with deep expertise in backend development using Node.js and proficiency in frontend technologies like React or any modern JavaScript framework. You will play a key role in building an...
decor
12 Hours ago
Principal Engineer - Fullstack
Information Technology
  • 30,00,000 - 40,00,000 INR - Annual
  • 8 - 12 Yrs
  • Mumbai
Looking for candidate who is enthusiastic to work in a Startup environment and build things from Scratch individually Candidate has past experience in scalable consumer facing applications managing latency and traffic FullStack Individual Contribu...
decor
12 Hours ago
Asst. Manager / Dy. Manager – Talent Acquisition
Automotive
  • 4,00,000 - 8,00,000 INR - Yearly
  • 4 - 8 Yrs
  • West Bengal
We are looking for dynamic and experienced professionals for the Talent Acquisition team at our Kharagpur Plant location. The incumbent will be responsible for managing the full-cycle recruitment process for both technical and functional roles across...
decor
1 Day ago
Data Analyst (Kannada Speakers)
AI & Machine Learning Advancement
  • 1 - 1 Yrs
  • Karnataka, India
For thousands of years, maps have provided humans with the knowledge they need to make decisions. As a Maps Evaluator, you will have the opportunity to provide ground truth for your town, city or country. At Peroptyx, we are looking for Data Ana...
decor
1 Day ago
Data Analyst (Telugu Speakers)
AI & Machine Learning Advancement
  • 1 - 1 Yrs
  • Andhra Pradesh, Telangana, India
For thousands of years, maps have provided humans with the knowledge they need to make decisions. As a Maps Evaluator, you will have the opportunity to provide ground truth for your town, city or country. At Peroptyx, we are looking for Data Ana...
decor
1 Day ago
Solution Architect – Databricks
Information Technology
  • 40,00,000 - 50,00,000 INR - Annual
  • 9 - 15 Yrs
  • Mumbai
Summary role description: Hiring for a Solution Architect – Databricks for global technology consulting and system integration firm specializing in data engineering, AI and ML. Company description: Our client is a US-headquarte...
decor
1 Day ago
Interesting Job Opportunity: Utilli - Full Stack Developer - Node.js/React.js
Information Technology
  • Bangalore, Karnataka, India
Job SummaryWe are seeking a highly skilled Full Stack Engineer to lead a team of developers in building and maintaining scalable web applications. This role requires a hands-on leader with deep expertise in JavaScript frameworks and modern developme...
decor

Talk to us

Feel free to call, email, or hit us up on our social media accounts.
Social media