Information Technology
Full-Time
MathCo
Overview
As a Lead Data Engineer, you will be responsible for:
Ability to build/drive reusable frameworks that can drive efficiency of the overall data system.
Has executed and lead multiple projects including on streaming, batch, large data pipelines, etc.
Manages conversation with the client stakeholders to understand the requirement and translate it into technical outcomes.
Required Tech Stack
- Leading a team of talented data engineers responsible for designing, building, and maintaining scalable data pipelines and infrastructure.
- Work closely with cross-functional teams to ensure client data systems meet the highest standards of quality and performance.
- Lead, mentor, and develop a team of data engineers, fostering a collaborative and inclusive team environment.
- Conduct regular performance reviews, provide feedback, and set goals for team members.
- Identify and address skill gaps, and provide opportunities for professional development.
- Plan, execute, and deliver data engineering projects on time and within scope.
- Coordinate with stakeholders to gather requirements, set priorities, and define project timelines.
- Ensure projects align with overall business objectives and data strategy.
- Oversee the design, development, and maintenance of data pipelines, ETL processes, and data warehouse.
- Ensure data quality, integrity, and security across all data engineering projects.
- Identify opportunities for process improvements and drive initiatives to enhance the efficiency and effectiveness of data operations.
Ability to build/drive reusable frameworks that can drive efficiency of the overall data system.
Has executed and lead multiple projects including on streaming, batch, large data pipelines, etc.
Manages conversation with the client stakeholders to understand the requirement and translate it into technical outcomes.
Required Tech Stack
- Has strong execution knowledge of Data Modeling, Databases in general (SQL and NoSQL), software development lifecycle and practices, unit testing, functional programming, etc.
- Working knowledge of an ETL and/or orchestration tools like IICS, Metallion, Airflow, Azure Data Factory, AWS Glue, GCP Composer, etc.
- Working knowledge of one or more Data Warehouse like Snowflake, Redshift, Hive, Big Query, etc.
- Proficient in Spark and can optimize Spark jobs with ease.
- Proficient in at least one programming language used in data engineering, such as Python (Non-negotiable) and Scala/Rust/Java.
- Understanding of Medallion architecture pattern.
- Has strong SQL knowledge along with optimization skills.
- Strong problem-solving skills with an ability to assess the financial impact of decisions, both in running the delivery team and delivering solutions to clients.
- Proficient in written and verbal communication and able to hold conversations with mid-management-level clients.
- Ability to recognize pragmatic alternatives vis-- -vis a perfect solution and get the delivery teams on board to pursue them, balancing time priorities with potential business impact.
- Strong people skills, including conflict resolution, empathy, communication, listening, and negotiation.
- Shows proficiency in providing technical guidance and provide leadership and mentorship to the delivery team.
- Self-driven with a strong sense of ownership.
Similar Jobs
View All
10 Hours ago
Program Manager
Information Technology
- 15 - 18 Yrs
- Gurgaon / Gurugram
We’re Hiring | Program Manager
Location: Gurugram, India
Domain: Program Management | Digital Systems | Java/.NET | Agile | Fintech/Supply Chain
Are you a strategic thinker with deep experience in program management of digital products? We’re lo...
11 Hours ago
Technical Fullstack Architect - Node.js
Information Technology
- 50,00,000 - 60,00,000 INR - Annual
- 12 - 18 Yrs
- Hyderabad
About the Role:
We are seeking a Fullstack Technical Architect with deep expertise in backend development using Node.js and proficiency in frontend technologies like React or any modern JavaScript framework. You will play a key role in building an...
11 Hours ago
Principal Engineer - Fullstack
Information Technology
- 30,00,000 - 40,00,000 INR - Annual
- 8 - 12 Yrs
- Mumbai
Looking for candidate who is enthusiastic to work in a Startup environment and build things from Scratch individually
Candidate has past experience in scalable consumer facing applications managing latency and traffic FullStack Individual Contribu...
11 Hours ago
Asst. Manager / Dy. Manager – Talent Acquisition
Automotive
- 4,00,000 - 8,00,000 INR - Yearly
- 4 - 8 Yrs
- West Bengal
We are looking for dynamic and experienced professionals for the Talent Acquisition team at our Kharagpur Plant location. The incumbent will be responsible for managing the full-cycle recruitment process for both technical and functional roles across...
1 Day ago
Data Analyst (Kannada Speakers)
AI & Machine Learning Advancement
- 1 - 1 Yrs
- Karnataka, India
For thousands of years, maps have provided humans with the knowledge they need to make decisions. As a Maps Evaluator, you will have the opportunity to provide ground truth for your town, city or country.
At Peroptyx, we are looking for Data Ana...
1 Day ago
Data Analyst (Telugu Speakers)
AI & Machine Learning Advancement
- 1 - 1 Yrs
- Andhra Pradesh, Telangana, India
For thousands of years, maps have provided humans with the knowledge they need to make decisions. As a Maps Evaluator, you will have the opportunity to provide ground truth for your town, city or country.
At Peroptyx, we are looking for Data Ana...
1 Day ago
Solution Architect – Databricks
Information Technology
- 40,00,000 - 50,00,000 INR - Annual
- 9 - 15 Yrs
- Mumbai
Summary role description:
Hiring for a Solution Architect – Databricks for global technology consulting and system integration firm specializing in data engineering, AI and ML.
Company description:
Our client is a US-headquarte...
1 Day ago
Interesting Job Opportunity: Utilli - Full Stack Developer - Node.js/React.js
Information Technology
- Bangalore, Karnataka, India
Job SummaryWe are seeking a highly skilled Full Stack Engineer to lead a team of developers in building and maintaining scalable web applications. This role requires a hands-on leader with deep expertise in JavaScript frameworks and modern developme...
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in