Senior Data Engineer

Overview

Job Title: Data Engineer – Data Operations
Experience Required: 5+ Years and 7+ years
Location: Kolkata

Job Overview

We are seeking a skilled Data Engineer with strong experience in data operations to join our team on a contract basis. The ideal candidate will have a proven background in building and maintaining robust data pipelines, particularly in environments integrating with Oracle Flexcube and the Cloudera Data Platform. This role will play a critical part in ensuring data flows smoothly and securely while optimizing performance, quality, and scalability.

Key Responsibilities

• Design, build, and maintain efficient, scalable data pipelines integrating data from Oracle Flexcube and other systems into Cloudera Data Platform.
• Leverage Hadoop for storage and Hive/Impala for querying and processing large datasets.
• Monitor, troubleshoot, and optimize data pipelines to ensure continuous, error-free data flow.
• Implement and uphold best practices in data governance, data quality, and data security.
• Collaborate with cross-functional teams to understand data needs and deliver robust engineering solutions.
• Automate recurring data processes and workflows to improve operational efficiency.
• Maintain clear, comprehensive documentation of data engineering and operational processes.
• Support performance tuning and scaling of big data systems.

Required Qualifications

• Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related field.
• Minimum 5 years of experience in data engineering and data operations, preferably in banking or financial services.
• Hands-on expertise in:
• Oracle Flexcube, APIs, JDBC/ODBC
• SQL, Python, and PySpark
• Cloudera Data Platform, Hadoop, Hive, and Impala
• Strong analytical and troubleshooting skills.
• Experience in designing, building, and managing scalable data pipelines.
• Excellent verbal and written communication skills.
• Ability to work both independently and within a collaborative team environment.
• Cloud experience or certification in data engineering is a plus.

Job Type: Full-time

Pay: ₹100,000.00 - ₹200,000.00 per month

Schedule:

• Day shift

Experience:

• Data Engineering: 5 years (Required)
• Banking Sector: 5 years (Required)

Location:

• Kolkata, West Bengal (Required)

Work Location: In person

Application Deadline: 02/05/2025