Free cookie consent management tool by TermsFeed Senior Data Engineer | Antal Tech Jobs
Back to Jobs
9 Weeks ago

Senior Data Engineer

decor
Indore, Madhya Pradesh, India
Information Technology
Full-Time
Quantiphi

Overview

While technology is the heart of our business, a global and diverse culture is the heart of our success. We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth.

If working in an environment that encourages you to innovate and excel, not just in professional but personal life, interests you- you would enjoy your career with Quantiphi!
Experience : 3 to 7 Years
Location : Mumbai/Bangalore/Trivandrum (Hybrid)
Key Responsibilities:
  • Design & Architecture: Collaborate with cross-functional teams to design CI/CD target architecture to automate and integrate Apache Flink with existing data systems.
  • Data Streaming Integration: Implement Apache Flink for real-time data processing and ensure seamless integration with the Amazon Managed Service for Apache Flink.
  • Migration Projects: Lead efforts to migrate existing Dataflow (Apache Beam) jobs to Apache Flink, ensuring minimal disruption and optimal performance.
  • Data Publishing: Develop solutions to publish streaming data from Amazon MSK into the bank's Data Platform using Apache Flink.
  • Fault Tolerance Implementation: Implement fault tolerance mechanisms and automated retries in Apache Flink applications as per platform requirements.
  • Performance Optimization: Monitor the health and performance of Flink applications, optimizing them for scalability and reliability.
Required Skills & Qualifications:
  • Bachelor’s or Master’s degree in Computer Science, Data Engineering, or a related field.
  • Proven experience as a Data Engineer with a strong focus on stream processing using Apache Flink.
  • Proficiency in programming languages such as Java, Scala, or Python (PyFlink).
  • Deep understanding of distributed data processing concepts and frameworks.
  • Experience with AWS services, particularly Amazon Managed Service for Apache Flink and Amazon MSK.
  • Familiarity with CI/CD practices and tools for automation.
  • Strong problem-solving skills and ability to work collaboratively in a team environment.
  • Excellent communication skills to effectively collaborate with technical and non-technical stakeholders.

Preferred Qualifications:
  • Experience with other stream processing technologies such as Apache Kafka, Apache Beam, or Spark Streaming.
  • Knowledge of containerization technologies like Docker and Kubernetes.
  • Familiarity with data modeling principles and SQL databases.
If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us!
Share job
Similar Jobs
View All
2 Days ago
TrueFan - Senior Machine Learning Engineer
Information Technology
  • Thiruvananthapuram, Kerala, India
About UsTrueFan is at the forefront of AI-driven content generation, leveraging cutting-edge generative models to build next-generation products. Our mission is to redefine content generation space through advanced AI technologies, including deep ge...
decor
2 Days ago
Salesforce commerce cloud consultant
Information Technology
  • Thiruvananthapuram, Kerala, India
Salesforce Commerce Cloud consultant  5+ Years of Experience 6 to 12 months Mode - Remote 1.1LPM - 1.2LPM Max Key Responsibilities Translate business requirements into scalable Salesforce Service Cloud solutions, in collaboration with CAE's technic...
decor
2 Days ago
Cloud Infrastructure Engineer
Information Technology
  • Thiruvananthapuram, Kerala, India
DescriptionInvent the future with us. Recognized by Fast Company’s 2023 100 Best Workplaces for Innovators List, Ampere is a semiconductor design company for a new era, leading the future of computing with an innovative approach to CPU design focuse...
decor
2 Days ago
Devops Engineer- Intermetiate
Information Technology
  • Thiruvananthapuram, Kerala, India
BackJD: Dev ops Engineer:As a DevOps Specialist- should be able to take ownership of the entire DevOps process, including Automated CI/CD pipelines and deployment to production.They should also be comfortable with risk analysis and prioritization.Le...
decor
2 Days ago
Sr Data Scientist (London)
Information Technology
  • Thiruvananthapuram, Kerala, India
AryaXAI stands at the forefront of AI innovation, revolutionizing AI for mission-critical, highly regulated industries by building explainable, safe, and aligned systems that scale responsibly. Our mission is to create AI tools that empower research...
decor
2 Days ago
Software Test Engineer
Information Technology
  • Thiruvananthapuram, Kerala, India
By clicking the “Apply” button, I understand that my employment application process with Takeda will commence and that the information I provide in my application will be processed in line with Takeda’s Privacy Notice and Terms of Use. I further att...
decor
2 Days ago
Software Developer 5 (Java Fullstack)
Information Technology
  • Thiruvananthapuram, Kerala, India
Job DescriptionBuilding off our Cloud momentum, Oracle has formed a new organization - Oracle Health Applications & Infrastructure. This team focuses on product development and product strategy for Oracle Health, while building out a complete platfo...
decor
2 Days ago
Java Developer - Spring Frameworks
Information Technology
  • Thiruvananthapuram, Kerala, India
Java DescriptionWe are looking for a passionate and talented Java Developer with 2-3 years of hands-on experience to join our growing development team.The ideal candidate should have a strong foundation in Java technologies and the ability to develo...
decor

Talk to us

Feel free to call, email, or hit us up on our social media accounts.
Social media