Free cookie consent management tool by TermsFeed Senior Big Data Engineer - Performance | Antal Tech Jobs
Back to Jobs
2 Days ago

Senior Big Data Engineer - Performance

decor
Information Technology
Full-Time
Qualys

Overview

Come work at a place where innovation and teamwork come together to support the most exciting missions in the world!
Description:
We are seeking a talented Sr. Big Data Engineer to deliver roadmap features of Enterprise TruRisk Platform which would help customers to Measure, Communicate and Eliminate Cyber Risks.
Working with a team of engineers and architects, you will be responsible for prototyping, designing, developing and supporting a highly scalable, distributed SaaS based Security Risk Prioritization product.
This is a fantastic opportunity to be an integral part of a team building Qualys next generation platform using Big Data & Micro-Services based technology to process over billions of transactions data per day, leverage open-source technologies, and work on challenging and business-impacting initiatives.

Responsibilities:
  • Be the thought leader in data platform and pipeline along with Risk Evaluation.
  • Provide technical leadership to the engineering organization on data platform design, roll out and evolution.
  • Liason to product teams, professional services and sales engineers on solution and trade-off reviews and represent engineering in such conversations.
  • Drive technology explorations and roadmaps.
  • Serve as a technical lead on our most demanding, cross-functional departments.
  • Ensure the quality of architecture and design of systems.
  • Functionally decompose complex problems into simple, straight-forward solutions.
  • Fully and completely understand system interdependencies and limitations.
  • Possess expert knowledge in performance, scalability, enterprise system architecture, and engineering best practices.
  • Leverage knowledge of internal and industry prior art in design decisions.
  • Effectively research and benchmark cloud technology against other competing systems in the industry.
  • Able to document the details so it will be easy for developers to understand the requirements.
  • Assisting developers with proper requirements and directions.
  • Assist in the career development of others, actively mentoring individuals and the community on advanced technical issues and helping managers guide the career growth of their team members.
  • Exert technical influence over multiple teams, increasing their productivity and effectiveness by sharing your deep knowledge and experience.
  • Able to share knowledge and train others.

Qualifications:
  • Bachelor’s degree in computer science or equivalent
  • 6+ years of total experience.
  • 2+ years of relevant experience in design and architecture Big Data solutions using Spark
  • 3+ years experience in working with engineering resources for innovation.
  • 4+ years experience in understanding Big Data events flow pipeline.
  • 3+ years experience in performance testing for large infrastructure.
  • 3+ In depth experience in understanding various search solutions solr/elastic.
  • 3+ years experience in Kafka
  • In depth experience in Data lakes and related ecosystems.
  • In depth experience of messing queue
  • In depth experience in giving requirements to build a scalable architecture for Big data and Micro-services environments.
  • In depth experience in understanding caching components or services
  • Knowledge in Presto technology.
  • Knowledge in Airflow.
  • Hands-on experience in scripting and automation
  • In depth understanding of RDBMS/NoSQL, Oracle , Cassandra , Kafka , Redis, Hadoop, lambda architecture, kappa , kappa ++ architectures with flink data streaming and rule engines
  • Experience in working with ML models engineering and related deployment.
  • Design and implement secure big data clusters to meet many compliances and regulatory requirements.
  • Experience in leading the delivery of large-scale systems focused on managing the infrastructure layer of the technology stack.
  • Strong experience in doing performance benchmarking testing for Big data technologies.
  • Strong troubleshooting skills.
  • Experience leading development life cycle process and best practices
  • Experience in Big Data services administration would be added value.
  • Experience with Agile Management (SCRUM, RUP, XP), OO Modeling, working on internet, UNIX, Middleware, and database related projects.
  • Experience mentoring/training the engineering community on complex technical issue.
  • Project management experience
Share job
Similar Jobs
View All
3 Hours ago
Data Analyst (Kannada Speakers)
AI & Machine Learning Advancement
  • 1 - 20 Yrs
  • Karnataka, India
For thousands of years, maps have provided humans with the knowledge they need to make decisions. As a Maps Evaluator, you will have the opportunity to provide ground truth for your town, city or country. At Peroptyx, we are looking for Data Ana...
decor
9 Hours ago
Data Analyst (Marathi Speakers)
AI & Machine Learning Advancement
  • 1 - 20 Yrs
  • India, Pune
For thousands of years, maps have provided humans with the knowledge they need to make decisions. As a Maps Evaluator, you will have the opportunity to provide ground truth for your town, city or country. At Peroptyx, we are looking for Data...
decor
9 Hours ago
Data Analyst (Telugu Speakers)
AI & Machine Learning Advancement
  • 1 - 20 Yrs
  • Andhra Pradesh, Telangana, India
For thousands of years, maps have provided humans with the knowledge they need to make decisions. As a Maps Evaluator, you will have the opportunity to provide ground truth for your town, city or country. At Peroptyx, we are looking for Data Ana...
decor
1 Day ago
Java Developer – Payments Domain
Information Technology
  • 4 - 7 Yrs
  • Mumbai (All Areas)
We are hiring Java Developers with 4–6 years of hands-on experience in backend development, particularly within the Payments or FinTech domain. The ideal candidate should possess a strong foundation in Java technologies and be capable of working in a...
decor
1 Day ago
SAP Functional Architect
Information Technology
  • 40,00,000 - 45,00,000 INR - Annual
  • 12 - 15 Yrs
  • Bangalore, Chennai
We are seeking an experienced SAP Pre-Sales Architect with a strong functional background and deep expertise in at least one SAP functional area. The ideal candidate will have extensive knowledge of cross-module integrations and a proven track record...
decor
1 Day ago
Senior React Native Developer
Information Technology
  • 7 - 12 Yrs
  • Jaipur
The NineHertz is on the lookout for a Senior React Native Developer who is passionate about mobile app development and thrives in a fast-paced environment. This is a fantastic opportunity to work with a dynamic team, drive innovation, and help delive...
decor
1 Day ago
Senior Data & AI Analytics Engineer (Remote)
AI & Machine Learning Advancement
  • 18,00,000 - 24,00,000 INR - Annual
  • 5 - 8 Yrs
  • Pune
Job Ref: NT-DAAI-003 Experience: 5–8 years Client: A prestigious AI-first tech company  Notice: Early joiners preferred (Immediate- 30 days) We are hiring on behalf of a prestigious AI-first technology client for a Senior Data & AI Analytics En...
decor
1 Day ago
AI Engineering Manager (Remote)
Information Technology
  • 40,00,000 - 50,00,000 INR - Annual
  • 10 - 15 Yrs
  • Pune
Experience: 10 to 15 years Location: Remote  Notice Period: Immediate to 30 days preferred Client: Leading mid-sized firm specializing in AI-driven solutions Overview: We are looking for an AI Engineering Manager to lead a dynamic team of ...
decor

Talk to us

Feel free to call, email, or hit us up on our social media accounts.
Social media