Free cookie consent management tool by TermsFeed Senior Data Engineer (Streaming and Big Data) | Antal Tech Jobs
Back to Jobs
2 Days ago

Senior Data Engineer (Streaming and Big Data)

decor
Thane, Maharashtra, India
Information Technology
Full-Time
Lytx, Inc.

Overview

Lytx

Are you looking to take your career in Data Engineering to the next level? Do you enjoy building data pipelines that enable critical business insights? Are you an expert in designing and delivering scalable data streaming solutions? Lytx is looking for a Senior Data Engineer to join our growing team!

You’ll know you’re right for this job if you enjoy designing, developing, deployment and maintaining Big Data pipelines in the Cloud. In addition, you intimately know the Data Engineering landscape and enjoy advising software developers and mentoring more junior employees.

What You'll Do

  • Participate in the full software development lifecycle (requirements, design, code, unit test, deployment, sustaining)
  • Provide senior-level contributions to the development teams responsible for implementing mission critical data applications
  • Participate in the research, design, and testing of next generation data engine platforms
  • Develop and guide long-term strategy for data pipelines and persistent and NoSQL data storage
  • Evaluate and recommend database infrastructure and tools including cloud technologies
  • Build integrated and automated data pipelines using the Hadoop Ecosystem (Spark, Kafka, Hive, Yarn, Oozie)
  • Develop and manage steaming data pipelines used for training and developing machine learning models
  • Process documentation and data flow diagramming
  • Mentor and coach junior engineers ,software developers, and data analysts
  • Perform other related duties as assigned

What You'll Need

  • Bachelor’s degree in Information Technology or relevant experience.
  • Minimum 5 years of experience in Data Engineering and/or Software Engineering
  • Minimum 5 years experience developing data pipelines with Java, Python or Scala (Real time pipelines preferred)
  • Strong knowledge of Apache Hadoop ecosystem such as HDFS, MapReduce, Sqoop, Yarn, Hive, and Oozie
  • Significant experience with Spark, Kafka, Nifi, and other streaming data tools
  • Experience deploying data pipelines in the cloud (AWS preferred)
  • Strong experience with Data Lake technologies and techniques
  • Solid understanding of T-SQL and ETL programming including SQL Server Integration Services (SSIS)
  • Excellent conceptual, analytical, and problem-solving skills
  • Experience in a high growth, fast paced environment
  • Demonstrated record of delivering quality technology outcomes
  • Strong organizational skills and a keen attention to detail
  • Self-motivated, engaged, and accountable

Innovation Lives Here

You go all in no matter what you do, and so do we. At Lytx, we’re powered by cutting-edge technology and Happy People. You want your work to make a positive impact in the world, and that’s what we do. Join our diverse team of hungry, humble and capable people united to make a difference.

Together, we help save lives on our roadways.

Find out how good it feels to be a part of an inclusive, collaborative team. We’re committed to delivering an environment where everyone feels valued, included and supported to do their best work and share their voices.

Lytx, Inc. is proud to be an equal opportunity/affirmative action employer and maintains a drug-free workplace. We’re committed to attracting, retaining and maximizing the performance of a diverse and inclusive workforce. EOE/M/F/Disabled/Vet.
Share job
Similar Jobs
View All
47 Minutes ago
US Voice Process (Banking Domain)
Telecommunications
  • 40000 - 45000 INR - Monthly
  • 1 - 1 Yrs
  • Greater Noida
Process: US Voice – Banking (International) Eligibility: Graduate / Undergraduate with 6 months international voice process experience Experience: 6 months – 2+ years (in International BPO – Voice) Salary: ₹40,000 CTC (6 months+ experienc...
decor
1 Day ago
Data Analyst
Information Technology
  • 300000 - 1200000 INR - Annual
  • 1 - 7 Yrs
  • Anywhere in India/Multiple Locations
Location: Remote – India Experience: 1–7 years Employment Type: Full-time & Part-time options available About the Role We’re seeking analytical minds who love turning data into actionable insights. As a Data Analyst, you’ll work closely w...
decor
1 Day ago
Sr. ServiceNow Developer | 8+ Years | Pune
Information Technology
  • 30 - 40 INR - Annual
  • 8 - 11 Yrs
  • Pune
About the Role: This is a senior-level ServiceNow Developer role where you’ll be responsible for driving the technical vision and execution of complex ServiceNow solutions across the organization. What We’re Looking For: Strong hands-...
decor
1 Day ago
Mobile Developer
Information Technology
  • 350000 - 1000000 INR - Annual
  • 1 - 6 Yrs
  • Anywhere in India/Multiple Locations
About the Role We're looking for talented Mobile Developers—whether you're a rising star with a year of experience or a seasoned engineer with eight—to build intuitive, high-performance mobile applications for Android and iOS. You’ll collaborate w...
decor
1 Day ago
Senior Software Engineer - Data Platform
Information Technology
  • Lucknow, Uttar Pradesh, India
Get to know OktaOkta is The World’s Identity Company. We free everyone to safely use any technology, anywhere, on any device or app. Our flexible and neutral products, Okta Platform and Auth0 Platform, provide secure access, authentication, and auto...
decor
1 Day ago
Business Analyst - Fertilizers Industry
Information Technology
  • 600000 - 800000 INR - Yearly
  • Hyderabad, Telangana, India
Job Summary: The role is open for a Business Analyst with 3 to 6 years of experience in the Fertilizers Industry. The candidate should be proficient in gathering, reviewing, and analyzing business operations data, preparing models and process maps ...
decor
1 Day ago
Senior Program Manager - IT
Information Technology
  • Lucknow, Uttar Pradesh, India
R1 RCM Inc. is a leading provider of technology-enabled revenue cycle management services that transform and solve challenges across health systems, hospitals, and physician practices. Headquartered in Chicago, R1® is a publicly traded organization ...
decor
1 Day ago
Software Developer in Mohali, Chandigarh
Information Technology
  • Thane, Maharashtra, India
Key Responsibilities Develop, test, and maintain high-quality software applications Collaborate with cross-functional teams to define, design, and ship new features Participate in code reviews to ensure code quality and integrity Write clean, sc...
decor

Talk to us

Feel free to call, email, or hit us up on our social media accounts.
Social media