Free cookie consent management tool by TermsFeed Data Engineer | Antal Tech Jobs
Back to Jobs
2 Weeks ago

Data Engineer

decor
Bangalore, Karnataka, India
Information Technology
Full-Time
HP

Overview

Job Summary

We are looking for a Senior Analytics Engineer to drive data excellence and innovation in our organization. As a thought leader in data engineering and analytics principles, you will be responsible for designing, building, and optimizing our data infrastructure while ensuring cost efficiency, security, and scalability. You will play a crucial role in managing Databricks and AWS usage, ensuring budget adherence, and taking proactive measures to optimize costs. This role also requires expertise in ETL processes, large-scale data processing, analytics, and data-driven decision-making, along with strong analytical and leadership skills.

Responsibilities

  • Act as a thought leader in data engineering and analytics, driving best practices and standards.
  • Oversee cost management of Databricks and AWS, ensuring resource usage stays within allocated budgets and taking corrective actions when necessary.
  • Design, implement, and optimize ETL pipelines for incremental data loading, ensuring seamless data ingestion, transformation, and performance tuning.
  • Lead migration activities, ensuring smooth transitions while maintaining data integrity and availability.
  • Handle massive data loads efficiently, optimizing storage, compute usage, and query performance.
  • Adhere to Git principles for version control, ensuring best practices for collaboration and deployment.
  • Implement and manage DSR (Airflow) workflows to automate and schedule data pipelines efficiently.
  • Ensure data security and compliance, especially when handling PII data, aligning with regulations like GDPR and HIPAA.
  • Optimize query performance and data storage strategies to improve cost efficiency and speed of analytics.
  • Collaborate with data analysts and business stakeholders to enhance analytics capabilities, enabling data-driven decision-making.
  • Develop and maintain dashboards, reports, and analytical models to provide actionable insights for business and engineering teams.

Required Skills & Qualifications

  • Four-year or Graduate Degree in Computer Science, Information Systems, or any other related discipline or commensurate work experience or demonstrated competence.
  • 6-11 years of experience in Data Engineering, Analytics, Big Data, or related domains.
  • Strong expertise in Databricks, AWS (S3, EC2, Lambda, RDS, Redshift, Glue, etc.), and cost optimization strategies.
  • Hands-on experience with ETL pipelines, incremental data loads, and large-scale data processing.
  • Proven experience in analyzing large datasets, deriving insights, and optimizing data workflows.
  • Strong knowledge of SQL, Python, PySpark, and other data engineering and analytics tools.
  • Strong problem-solving, analytical, and leadership skills.
  • Experience with BI tools like Tableau, Looker, or Power BI for data visualization and reporting.

Preferred Certifications

  • Certified Software Systems Engineer (CSSE)
  • Certified Systems Engineering Professional (CSEP)

Cross-Org Skills

  • Effective Communication
  • Results Orientation
  • Learning Agility
  • Digital Fluency
  • Customer Centricity

Impact & Scope

  • Impacts function and leads and/or provides expertise to functional project teams and may participate in cross-functional initiatives.

Complexity

  • Works on complex problems where analysis of situations or data requires an in-depth evaluation of multiple factors.

Disclaimer

  • This job description describes the general nature and level of work performed in this role. It is not intended to be an exhaustive list of all duties, skills, responsibilities, knowledge, etc. These may be subject to change and additional functions may be assigned as needed by management.
Share job
Similar Jobs
View All
11 Hours ago
Program Manager
Information Technology
  • 15 - 18 Yrs
  • Gurgaon / Gurugram
We’re Hiring | Program Manager Location: Gurugram, India Domain: Program Management | Digital Systems | Java/.NET | Agile | Fintech/Supply Chain Are you a strategic thinker with deep experience in program management of digital products? We’re lo...
decor
12 Hours ago
Technical Fullstack Architect - Node.js
Information Technology
  • 50,00,000 - 60,00,000 INR - Annual
  • 12 - 18 Yrs
  • Hyderabad
About the Role: We are seeking a Fullstack Technical Architect with deep expertise in backend development using Node.js and proficiency in frontend technologies like React or any modern JavaScript framework. You will play a key role in building an...
decor
12 Hours ago
Principal Engineer - Fullstack
Information Technology
  • 30,00,000 - 40,00,000 INR - Annual
  • 8 - 12 Yrs
  • Mumbai
Looking for candidate who is enthusiastic to work in a Startup environment and build things from Scratch individually Candidate has past experience in scalable consumer facing applications managing latency and traffic FullStack Individual Contribu...
decor
12 Hours ago
Asst. Manager / Dy. Manager – Talent Acquisition
Automotive
  • 4,00,000 - 8,00,000 INR - Yearly
  • 4 - 8 Yrs
  • West Bengal
We are looking for dynamic and experienced professionals for the Talent Acquisition team at our Kharagpur Plant location. The incumbent will be responsible for managing the full-cycle recruitment process for both technical and functional roles across...
decor
1 Day ago
Data Analyst (Kannada Speakers)
AI & Machine Learning Advancement
  • 1 - 1 Yrs
  • Karnataka, India
For thousands of years, maps have provided humans with the knowledge they need to make decisions. As a Maps Evaluator, you will have the opportunity to provide ground truth for your town, city or country. At Peroptyx, we are looking for Data Ana...
decor
1 Day ago
Data Analyst (Telugu Speakers)
AI & Machine Learning Advancement
  • 1 - 1 Yrs
  • Andhra Pradesh, Telangana, India
For thousands of years, maps have provided humans with the knowledge they need to make decisions. As a Maps Evaluator, you will have the opportunity to provide ground truth for your town, city or country. At Peroptyx, we are looking for Data Ana...
decor
1 Day ago
Solution Architect – Databricks
Information Technology
  • 40,00,000 - 50,00,000 INR - Annual
  • 9 - 15 Yrs
  • Mumbai
Summary role description: Hiring for a Solution Architect – Databricks for global technology consulting and system integration firm specializing in data engineering, AI and ML. Company description: Our client is a US-headquarte...
decor
1 Day ago
Interesting Job Opportunity: Utilli - Full Stack Developer - Node.js/React.js
Information Technology
  • Bangalore, Karnataka, India
Job SummaryWe are seeking a highly skilled Full Stack Engineer to lead a team of developers in building and maintaining scalable web applications. This role requires a hands-on leader with deep expertise in JavaScript frameworks and modern developme...
decor

Talk to us

Feel free to call, email, or hit us up on our social media accounts.
Social media