Information Technology
Full-Time
Quest Global
Overview
Job Requirements
Work Experience
- Support the design, implementation, and maintenance of enterprise ETL processes for data platforms, for a global client base.
- Develop scalable and efficient code to process data, ensuring availability and accessibility in a timely manner.
- Leverage big data processing frameworks such as Apache Spark and Hadoop to build and optimize data pipelines.
- Collaborate with senior engineers to address data challenges, contributing to solutions that maintain high data quality.
- Assist in the data delivery process, working alongside Data Engineers and Analysts to support accurate, high-value data solutions across various clients and industries.
- Build strong working relationships with team members and clients, contributing to both local and global projects.
- Learn and apply industry best practices, including version control, code reviews, and data validation, to ensure quality in data processes.
- Use SQL and other database technologies to help optimize data processing and reduce the time required to handle large data sets.
- Design, implement, and maintain data pipelines using ETL frameworks, orchestration tools, and distributed data processing engines.
- Participate in efforts to automate routine data tasks and streamline processes.
Work Experience
- Deep understanding and experience with modern Data Platforms – Cloudera Data Platform (CDP)
- Strong hands-on experience with PySpark.
- Experience with Cloudera Data Platform (CDE, CDW, Ozone, Airflow, SDX), Apache Ranger
- Deep understanding of distributed data systems and Hive Metastore
- Experience and understanding of cataloging, lineage, and governance
- Experience / understanding Open Data Contract Standard (ODCS) and its implementation
- Experience working with SQL, file formats (Iceberg/Parquet), and partitioning/bucketing strategies.
- Nice to have
- Experience modernizing enterprise finance systems or regulated environments
- Knowledge of CI/CD, data engineering best practices
- Understanding of financial data structures, accounting processes, or reconciliation workflows.
Similar Jobs
View All
1 Day ago
Scrum Master – Modernization
Information Technology
Career Area: Engineering Job Description: Your Work Shapes the World at Caterpillar Inc. When you join Caterpillar, you're joining a global team who cares not just about the work we do – but also about each other. We are the makers, problem solvers, ...
1 Day ago
Software Engineer - II
Information Technology
Are you looking for a unique opportunity to be a part of something great? Want to join a 17,000-member team that works on the technology that powers the world around us? Looking for an atmosphere of trust, empowerment, respect, diversity, and communi...
1 Day ago
Software Developer & IT Trainer
Information Technology
- 13000 - 17000 INR - Monthly
Job SummaryWe are looking for a knowledgeable and enthusiastic IT Trainer to join our team. The candidate will be responsible for training students and professionals in various IT and computer-related courses, conducting practical sessions, and suppo...
1 Day ago
Python Django Developer with Azure Databricks
Information Technology
At InfoBeans, we believe in making other people’s lives better— through our work and everyday interactions....
1 Day ago
Java Developer
Information Technology
TransUnion's Job Applicant Privacy Notice What We'll Bring: The Java Developer position will be responsible to assess our capabilities and current architecture to help us drive the implementation of improvement to become “best in class.” This role wi...
1 Day ago
Test Engineer / Senior Test Engineer (Manual)
Information Technology
Location: Pune, India Business: Energy Systems Contract type: Permanent Employee Job ID: 6778Benefits Please note, benefits may depend on your contract type, please confirm with your recruiter. Profit Share You’ll be part of our global profit share...
1 Day ago
Senior Cloud Architect
Information Technology
Experience: We are looking for a Senior Cloud Architect with 13+ years of overall experience and strong expertise in AWS, or Google Cloud Platform, or Microsoft Azure. The candidate must have proven experience in designing and implementing large-scal...
1 Day ago
Dataplane Acceleration & Fast Path - Technical Lead
Information Technology
We are seeking an experienced Technical Lead with strong expertise in dataplane acceleration and Linux fast‑path networking. This role requires hands‑on development skills in DPDK‑based packet processing, OVS‑DPDK pipelines, and performance tuning. R...
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in