Senior Data Engineer - Big Data

We're Hiring! Data Engineer Bangalore.

Lifesight is on a mission to empower businesses with advanced data intelligence!. We are a fast-growing SaaS company helping brands leverage data & AI for better customer acquisition and retention. With 300+ customers across the US, Singapore, India, Australia, and the UK, we deal with petabytes of data and process 400TB+ daily to power attribution and measurement platforms.

Now, we are looking for a Sr. Data Engineer to join our growing team in Bangalore! If you love working with big data, cloud environments, and cutting-edge technologies like Apache Spark, Kafka, Airflow, Presto, and NoSQL databases, this is the opportunity for you.

What Youll Be Doing

• Build highly scalable, available, fault-tolerant distributed data processing systems (batch and streaming systems) processing over 100s of terabytes of data ingested every day and petabyte-sized data warehouse and elasticsearch cluster.
• Build quality data solutions and refine existing diverse datasets to simplified models encouraging self-service.
• Build data pipelines that optimize on data quality and are resilient to poor quality data sources.
• Own the data mapping, business logic, transformations and data quality Low level systems debugging, performance measurement & optimization on large production clusters.
• Participate in architecture discussions, influence product roadmap, and take ownership and responsibility over new projects.
• Maintain and support existing platforms and evolve to newer technology stacks and architectures.
  
  

Were Excited If You Have

• Proficiency in Python and pyspark.
• Deep understanding of Apache Spark, Spark tuning, creating RDDs, and building data frames.
• Create Java/ Scala Spark jobs for data transformation and aggregation.
• Experience in big data technologies like HDFS, YARN, Map-Reduce, Hive, Kafka, Spark, Airflow, Presto, etc.
• Experience in building distributed environments using any of Kafka, Spark, Hive, Hadoop, etc.
• Good understanding of the architecture and functioning of Distributed database systems.
• Experience working with various file formats like Parquet, Avro, etc for large volumes of data.
• Experience with one or more NoSQL databases.
• Experience with AWS, GCP.
• 5+ years of professional experience as a data or software engineer.
  
  

Why Join Us?

At Lifesight, we believe in growing togethernot just as a company, but as individuals.

We foster an environment where innovation, collaboration, and personal well-being are valued just as much as business success.

Beyond leveraging smart technology to solve complex challenges, we cultivate a workplace culture that prioritizes work-life balance and team camaraderie.

Heres What You Can Expect

• Be part of one of the fastest-growing and most successful Marketing Measurement Platform making a global impact.
• Join as an early team member, influencing key decisions on tech stack, product development, and strategies for building scalable solutions.
• Work in small, agile teams within a non-bureaucratic, fast-paced environment.
• Enjoy a culture of empowerment, where you have the space to achieve your objectives and drive meaningful impact.
• Receive competitive compensation and benefits.
• Thrive in a collaborative and engaging work environment that values professional growth and team bonding.
  
  

(ref:hirist.tech)