Bangalore, Karnataka, India
Information Technology
Full-Time
Brillio
Overview
Lead Data Engineer
Primary Skills
Primary Skills
- MapReduce, HDFS, Spark - Pyspark, ETL Fundamentals, SQL, SQL (Basic + Advanced), Spark - Scala, Python, Data Warehousing, Hive, Modern Data Platform Fundamentals, Data Modelling Fundamentals, PLSQL, T-SQL, Stored Procedures, Oozie
- Primary Skills (Must Have) : Programming language: Python / Java / Scala, Framework: Spark, Hadoop, Declarative language: SQL Secondary Skills (Good to Have) : Databricks , AWS Scope of Work :
- Developing and maintaining Big Data ETL jobs.
- Conducting data analysis and profiling.
- Collaborating with cross-functional teams (e.g., data scientists, business analysts) to align data engineering solutions with business objectives.
- Automating data workflows to increase system efficiency and reduce manual intervention.
- Monitoring, troubleshooting, and optimizing data pipelines to ensure high performance and reliability.
- Ensuring data security and compliance with Mastercard policies and industry standards. Role of Resource : Senior Data Engineer Role USP : Opportunity to work on cutting-edge Big Data technologies like Spark, Databricks, Cloud services with a focus on optimizing and scaling data processing pipelines. If Domain knowledge required : Banking / Mastercard data knowledge is an added advantage and preferable. Experience Range : 5 to 10 years
Similar Jobs
View All
16 Hours ago
Principal Engineer - UI/UX
Information Technology
- 6 - 11 Yrs
- Mumbai (All Areas)
looking for a technically savvy and experienced Principal Engineer to take up front-end development efforts. You will design and develop elegant interfaces that exceed client expectations in terms of value and benefit. You will collaborate on scalabi...
16 Hours ago
Principal Engineer - Beckend
Information Technology
- 7 - 11 Yrs
- Mumbai (All Areas)
Principal Engineer - Backend
Mumbai, Maharashtra, India | Product Engineering | Full-time
We are looking for a technically savvy and experienced senior developer to lead development efforts. You will help the team grow in size and skills, optim...
16 Hours ago
Principal Engineer - DevOps/DBA
Information Technology
- 7 - 11 Yrs
- Mumbai (All Areas)
we are looking for a technically savvy and passionate Principal DevOps Engineer or Senior Database Administrator to cater to the development and operations efforts in product. You will choose and deploy tools and technologies to build and support a r...
18 Hours ago
C++ Developer | 5 - 8 Years
Information Technology
- 30 - 45 INR - Yearly
- 5 - 12 Yrs
- Pune
About the Client:
The company has been a global leader in delivering cutting-edge in-flight entertainment and connectivity (IFEC) solutions for over 40 years.
About the Role:
Title:
SDE 3 C++ - 5 to 8 Years
SDE 4 C++ - 8 to 13 Years
...
2 Days ago
Business Analyst(GRC Domain) Internship in Hyderabad
Information Technology
- Gurugram, Haryana, India
Selected Intern's Day-to-day Responsibilities Include Gather, analyze, and document business requirements. Translate business needs into functional specifications and user stories. Support in preparing business requirement documents (BRD), functi...
2 Days ago
Creditsafe - Data Test Engineer
Information Technology
- Gurugram, Haryana, India
We are looking for a Test Engineer who will become part of our team building and testing the Creditsafe data.You will be working closely with the database teams and data engineering to build specific systems facilitating the extraction and transform...
2 Days ago
Business Advisory Analyst
Information Technology
- Gurugram, Haryana, India
Skill required: Finance & Accounting - Budgeting and ForecastingDesignation: Business Advisory AnalystQualifications:Any GraduationYears of Experience:3 to 5 yearsAbout AccentureAccenture is a global professional services company with leading capabi...
2 Days ago
IN_Senior Associate_.Net Developer_Emerging Businesses_Advisory_Gurugram
Information Technology
- Gurugram, Haryana, India
Line of ServiceAdvisory Industry/SectorNot Applicable SpecialismEmerging Technologies Management LevelSenior Associate Job Description & SummaryAt PwC, our people in software and product innovation focus on developing cutting-edge software solutions...
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in