Free cookie consent management tool by TermsFeed Lead Data Engineer | Antal Tech Jobs
Back to Jobs
2 Days ago

Lead Data Engineer

decor
Bangalore, Karnataka, India
Information Technology
Full-Time
TransUnion

Overview

TransUnion's Job Applicant Privacy Notice

What We'll Bring

Data Pipeline Engineer at Orion project are embedded within our engineering teams and support the development and operation.

What You'll Bring

Lead Data Engineer

What We Offer

We are looking for an individual to be part of an autonomous, cross-functional agile/scrum team where everyone shares responsibility for all aspects of the work.

The ideal candidate will have a strong interest to join our growing Data Engineering and Analytics track of GFS Core services who will drive building next generation suite of products and platform by designing, coding, building and deploying highly scalable and robust solutions. We are looking for enthusiastic professionals who are excited to learn, love a good challenge, and are always looking for opportunities to contribute. Finally yet importantly, we look for dedicated team players who enjoy collaboration and can work effectively with others to achieve common goals.

TransUnion is currently seeking a Lead Data Engineer with 7+ years’ experience to work in our Chennai office, India. You will be working with some of the latest tools and a great team of cross-functional engineers. We work with multiple technologies. This will be an opportunity to work on core services of an industrial strength Identity and Risk solution by streamlining design and collaborating with the team to build orchestration platform in cloud.

Who We Are

At TransUnion, we are dedicated to finding ways information can be used to help people make better and smarter decisions. As a trusted provider of global information solutions, our mission is to help people around the world access the opportunities that lead to a higher quality of life, by helping organizations optimize their risk-based decisions and enabling consumers to understand and manage their personal information. Because when people have access to more complete and multidimensional information, they can make decisions that are more informed and achieve great things. Every day TransUnion offers our employees the tools and resources they need to find ways information can be used in diverse ways.

What You’ll Bring

  • Bachelor's Degree in a quantitative field, plus 7+ years of work experience or equivalent practical experience.
  • 5+ years of experience in Big Data technologies
  • Experience designing and implementing data pipelines
  • Experience with SQL, PostgreSQL and/or Redshift, or other data management, reporting and query tools.
  • Big Data Technologies – Hadoop HDFS, Hive, Spark, Kafka, Sqoop
  • Designing Logical Data Model and Physical Data Models including data warehouse and data mart designs.
  • Expertise in writing complex, highly optimized queries across large data sets to write data pipelines and data processing layers.
  • Cloud System experience on AWS, Azure, GCP –Preferably GCP
  • Coach / Mentor / Lead a team of Data Engineers
  • Design, build, test and deploy cutting edge Big Data solutions at scale
  • Extract, Clean, transform, and analyze vast amounts of raw data from various Data Sources
  • Build data pipelines and API integrations with various internal systems
  • Proactively monitor, identify, and escalate issues or root causes of systemic issues
  • Evaluate and communicate technical risks effectively and ensure assignments delivery in scheduled time with desired quality
  • Work across Data Engineering, Data Architecture, Data Visualization functions

What We’ll Bring

  • At TransUnion, we have a welcoming and energetic environment that encourages collaboration and innovation we’re – consistently exploring new technologies and tools to be agile. This environment gives our people the opportunity to hone current skills and build new capabilities, while discovering their genius.
  • Come be a part of our team – you will work with great people, pioneering products and cutting-edge technology.
  • This role is for a Lead Data Engineer that will operate as a lead for Data Pipeline track and responsible for development of the global fraud solutions of TransUnion.
  • We pride ourselves in working in a collaborative cross-functional manner where all engineers are expected to contribute to design, build, deployment and operation of our cloud platform.

Technical Leadership

Design/build scalable data pipelines using Java, Spark, PySpark, BigQuery, and AWS (S3, , EMR).

Implement real-time data solutions with Kafka and Nifi.

Optimize distributed systems (Spark/Kubernetes) for performance and cost.

Team Management

Mentor junior engineers, conduct code reviews, and unblock technical challenges.

Drive agile processes (sprint planning, task grooming).

Data Solutions

Architect relational and NoSQL databases for transactional/analytical workloads.

Develop reporting tools for big data (e.g., Tableau, Metabase).

Troubleshoot data quality/performance issues end-to-end.

Innovation

Research new technologies (e.g., Delta Lake, Flink) for feature development.

Location: Chennai

Job Type: Full-time day job

We are an equal opportunity employer and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, age, disability status, veteran status, marital status, citizenship status, sexual orientation, gender identity or any other characteristic protected by law.

Impact You'll Make

N/A

This is a hybrid position and involves regular performance of job responsibilities virtually as well as in-person at an assigned TU office location for a minimum of two days a week.

TransUnion Job Title

Lead Developer, Software Development
Share job
Similar Jobs
View All
5 Hours ago
Devops Cloud Engineer
Information Technology
  • 3000000 - 3500000 INR - Monthly
  • 7 - 14 Yrs
  • Mumbai
Minimum Experience/Training Required: • At least 7 years of relevant experience, with a strong track record in deploying solutions/applications on AWS cloud environment • Proven ability to work across structured, semi-structured, and unstructured d...
decor
1 Day ago
Software Developer - SDE1 Backend
Information Technology
  • 2 - 4 Yrs
  • Mumbai
Key Responsibilities:  ● Design, develop, and maintain software applications using Golang, Node.js and PHP.  ● Create and optimize database schemas and queries using MySQL and MongoDB.  ● Implement caching solutions with Redis.  ● Integra...
decor
1 Day ago
Cybersecurity Engineer
Information Technology
  • 2 - 8 Yrs
  • Anywhere in India/Multiple Locations
Key Responsibilities: Design, implement, and manage Palo Alto Networks solutions, including: Next-Gen Firewall (NGFW) EDR/XDR (Cortex XDR) SIEM/SOAR (Cortex XSIAM) Lead and support migration projects from legacy platforms (e.g., Splunk,...
decor
1 Day ago
Application Developer
Information Technology
  • 1 - 5 Yrs
  • Anywhere in India/Multiple Locations
Project Role :Application Developer Must have skills :.Net Full Stack Development Summary:As an Application Developer, you will engage in the design, construction, and configuration of applications tailored to fulfill specific business processe...
decor
1 Day ago
Rosmerta Technologies - Software Java Developer - Spring Boot Framework
Information Technology
  • Pune, Maharashtra, India
Job SummaryWe are seeking a highly experienced and skilled Software Java Developer with a minimum of 8 years of experience to join our dynamic engineering team.The ideal candidate will be a seasoned professional with a strong foundation in Java back...
decor
1 Day ago
Machine Learning Engineer - NLP/Generative AI
Information Technology
  • Pune, Maharashtra, India
About UsWe are a UK-based conveyancing firm dedicated to transforming property transactions through cutting-edge artificial intelligence. We are seeking a talented Machine Learning Engineer with 12 years of experience to join our growing AI team. Th...
decor
1 Day ago
Lead Software Engineer-R-248730
Information Technology
  • Pune, Maharashtra, India
Our PurposeMastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we’re helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments ch...
decor
1 Day ago
Software Engineer - Java Full Stack Developer
Information Technology
  • Pune, Maharashtra, India
Job DescriptionAre you ready to make an impact at DTCC? Do you want to work on innovative projects, collaborate with a dynamic and supportive team, and receive investment in your professional development? At DTCC, we are at the forefront of innovati...
decor

Talk to us

Feel free to call, email, or hit us up on our social media accounts.
Social media