Guntur, islas baleares, Spain
Information Technology
Full-Time
etelligens Technologies
Overview
About The Role
We are seeking an experienced Data Engineer - Python with 58 years of hands-on expertise in building scalable data solutions. The ideal candidate will design, develop, and optimize ETL pipelines, ensure data quality and reliability, and collaborate with cross-functional teams to enable data-driven decision-making.
Key Responsibilities
We are seeking an experienced Data Engineer - Python with 58 years of hands-on expertise in building scalable data solutions. The ideal candidate will design, develop, and optimize ETL pipelines, ensure data quality and reliability, and collaborate with cross-functional teams to enable data-driven decision-making.
Key Responsibilities
- Design, develop, and maintain ETL/ELT pipelines using Python, PySpark, and SQL.
- Build and optimize scalable data pipelines leveraging AWS services (Glue, Lambda, S3, Athena, Step Functions).
- Implement and manage Data Warehousing solutions with strong knowledge of SCD (Type 1, Type 2) and Medallion Architecture.
- Develop efficient data models and ensure partitioning, indexing, and performance optimization in big data environments.
- Ensure high standards of data quality, governance, and security across pipelines and platforms.
- Collaborate with data scientists, analysts, and business stakeholders to translate business requirements into technical solutions.
- Monitor and troubleshoot production pipelines to ensure reliability and scalability.
- Contribute to automation, process improvements, and documentation for data engineering workflows.
- 5-8 years of proven experience in Data Engineering.
- Strong proficiency in Python, PySpark, and SQL for data processing and Solid understanding of ETL/ELT design principles and experience with AWS services (Glue, Lambda, S3, Athena, Step Functions).
- Hands-on experience with Data Warehousing concepts, SCD (Type 1, Type 2), and Medallion Architecture.
- Expertise in data modeling, partitioning strategies, and query performance tuning.
- Strong problem-solving and debugging skills in big data environments.
- Excellent communication skills to explain technical concepts to non-technical stakeholders.
- Experience with DBT for data transformation and testing.
- Exposure to Databricks and the Lakehouse architecture.
- Familiarity with CI/CD for data pipelines and infrastructure-as-code (Terraform, Knowledge of data security, compliance, and governance best practices.
Similar Jobs
View All
1 Day ago
Full Stack Developer in Bangalore
Information Technology
- Guntur, islas baleares, Spain
As a Full Stack Developer at Skillcurve Careerlabs Private LTD, you will be a key member of our dynamic team, working on cutting-edge projects that push the boundaries of technology. Your expertise in Node.js, JavaScript, and CSS will be vital in cr...
1 Day ago
Full Stack Developer at Cekura (Django + React)
Information Technology
- Guntur, islas baleares, Spain
About Us\ Cekura is a Y Combinator–backed, early-stage AI startup revolutionizing the testing and observability of AI voice agents. Founded by IIT Bombay alumni, with deep roots in Computer Science (IIT Bombay ’21) and research experience from ETH Z...
1 Day ago
Java Developer
Information Technology
- Guntur, islas baleares, Spain
About IntugineThe physical goods we consume everyday(think dairy, snacks, furniture, clothing, electronics, automobiles etc.) are sourced, manufactured, stored, and moved across a highly intricate supply chain before they can reach us. The brands th...
1 Day ago
Senior Software Engineer - React JS Node JS
Information Technology
- Guntur, islas baleares, Spain
Job DescriptionOptum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy b...
1 Day ago
Teamcenter Technical Lead
Information Technology
- Guntur, islas baleares, Spain
At Capgemini Engineering, the world leader in engineering services, we bring together a global team of engineers, scientists, and architects to help the world’s most innovative companies unleash their potential. From autonomous cars to life-saving r...
1 Day ago
IT Analyst I
Information Technology
- Guntur, islas baleares, Spain
Job DescriptionJob DescriptionAs a Business Systems Specialist here at Honeywell, you will be responsible for managing and optimizing our business systems to ensure they meet the needs of our organization. Your role will involve analyzing system req...
1 Day ago
DHI Solutions - Full Stack Developer - Java/React.js
Information Technology
- Guntur, islas baleares, Spain
Job Title : Java Full Stack DeveloperJob SummaryWe are looking for a skilled Full Stack Developer with strong expertise in backend Java development and experience with frontend frameworks like Vue.js (preferred) or React.js. The ideal candidate shou...
1 Day ago
Software Engineer - QA Automation
Information Technology
- Guntur, islas baleares, Spain
Job DescriptionAgilent inspires and supports discoveries that advance the quality of life. We provide life science, diagnostic, and applied market laboratories worldwide with instruments, services, consumables, applications, and expertise. Agilent e...
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in