Information Technology
Qualys
Overview
Come work at a place where innovation and teamwork come together to support the most exciting missions in the world!
We are seeking a talented Lead Big Data Engineer to deliver roadmap features of Enterprise TruRisk Platform which would help customers to Measure, Communicate and Eliminate Cyber Risks.
Working with a team of engineers and architects, you will be responsible for prototyping, designing, developing and supporting a highly scalable, distributed SaaS based Security Risk Prioritization product.
This is a fantastic opportunity to be an integral part of a team building Qualys next generation platform using Big Data & Micro-Services based technology to process over billions of transactions data per day, leverage open-source technologies, and work on challenging and business-impacting initiatives.
Responsibilities:
- Be the thought leader in data platform and pipeline along with Risk Evaluation.
- Provide technical leadership to the engineering organization on data platform design, roll out and evolution.
- Liason to product teams, professional services and sales engineers on solution and trade-off reviews and represent engineering in such conversations.
- Drive technology explorations and roadmaps.
- Serve as a technical lead on our most demanding, cross-functional departments.
- Ensure the quality of architecture and design of systems.
- Functionally decompose complex problems into simple, straight-forward solutions.
- Fully and completely understand system interdependencies and limitations.
- Possess expert knowledge in performance, scalability, enterprise system architecture, and engineering best practices.
- Leverage knowledge of internal and industry prior art in design decisions.
- Effectively research and benchmark cloud technology against other competing systems in the industry.
- Able to document the details so it will be easy for developers to understand the requirements.
- Assisting developers with proper requirements and directions.
- Assist in the career development of others, actively mentoring individuals and the community on advanced technical issues and helping managers guide the career growth of their team members.
- Exert technical influence over multiple teams, increasing their productivity and effectiveness by sharing your deep knowledge and experience.
- Able to share knowledge and train others.
Qualifications:
- Bachelor’s degree in computer science or equivalent
- 8+ years of total experience.
- 4+ years of relevant experience in design and architecture Big Data solutions using Spark
- 3+ years experience in working with engineering resources for innovation.
- 4+ years experience in understanding Big Data events flow pipeline.
- 3+ years experience in performance testing for large infrastructure.
- 3+ In depth experience in understanding various search solutions solr/elastic.
- 3+ years experience in Kafka
- In depth experience in Data lakes and related ecosystems.
- In depth experience of messing queue
- In depth experience in giving requirements to build a scalable architecture for Big data and Micro-services environments.
- In depth experience in understanding caching components or services
- Knowledge in Presto technology.
- Knowledge in Airflow.
- Hands-on experience in scripting and automation
- In depth understanding of RDBMS/NoSQL, Oracle , Cassandra , Kafka , Redis, Hadoop, lambda architecture, kappa , kappa ++ architectures with flink data streaming and rule engines
- Experience in working with ML models engineering and related deployment.
- Design and implement secure big data clusters to meet many compliances and regulatory requirements.
- Experience in leading the delivery of large-scale systems focused on managing the infrastructure layer of the technology stack.
- Strong experience in doing performance benchmarking testing for Big data technologies.
- Strong troubleshooting skills.
- Experience leading development life cycle process and best practices
- Experience in Big Data services administration would be added value.
- Experience with Agile Management (SCRUM, RUP, XP), OO Modeling, working on internet, UNIX, Middleware, and database related projects.
- Experience mentoring/training the engineering community on complex technical issue.
- Project management experience
Similar Jobs
View All
2 Days ago
TrueFan - Senior Machine Learning Engineer
Information Technology
- Thiruvananthapuram, Kerala, India
About UsTrueFan is at the forefront of AI-driven content generation, leveraging cutting-edge generative models to build next-generation products. Our mission is to redefine content generation space through advanced AI technologies, including deep ge...
2 Days ago
Salesforce commerce cloud consultant
Information Technology
- Thiruvananthapuram, Kerala, India
Salesforce Commerce Cloud consultant 5+ Years of Experience 6 to 12 months Mode - Remote 1.1LPM - 1.2LPM Max Key Responsibilities Translate business requirements into scalable Salesforce Service Cloud solutions, in collaboration with CAE's technic...
2 Days ago
Cloud Infrastructure Engineer
Information Technology
- Thiruvananthapuram, Kerala, India
DescriptionInvent the future with us. Recognized by Fast Company’s 2023 100 Best Workplaces for Innovators List, Ampere is a semiconductor design company for a new era, leading the future of computing with an innovative approach to CPU design focuse...
2 Days ago
Devops Engineer- Intermetiate
Information Technology
- Thiruvananthapuram, Kerala, India
BackJD: Dev ops Engineer:As a DevOps Specialist- should be able to take ownership of the entire DevOps process, including Automated CI/CD pipelines and deployment to production.They should also be comfortable with risk analysis and prioritization.Le...
2 Days ago
Sr Data Scientist (London)
Information Technology
- Thiruvananthapuram, Kerala, India
AryaXAI stands at the forefront of AI innovation, revolutionizing AI for mission-critical, highly regulated industries by building explainable, safe, and aligned systems that scale responsibly. Our mission is to create AI tools that empower research...
2 Days ago
Software Test Engineer
Information Technology
- Thiruvananthapuram, Kerala, India
By clicking the “Apply” button, I understand that my employment application process with Takeda will commence and that the information I provide in my application will be processed in line with Takeda’s Privacy Notice and Terms of Use. I further att...
2 Days ago
Software Developer 5 (Java Fullstack)
Information Technology
- Thiruvananthapuram, Kerala, India
Job DescriptionBuilding off our Cloud momentum, Oracle has formed a new organization - Oracle Health Applications & Infrastructure. This team focuses on product development and product strategy for Oracle Health, while building out a complete platfo...
2 Days ago
Java Developer - Spring Frameworks
Information Technology
- Thiruvananthapuram, Kerala, India
Java DescriptionWe are looking for a passionate and talented Java Developer with 2-3 years of hands-on experience to join our growing development team.The ideal candidate should have a strong foundation in Java technologies and the ability to develo...
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in