Senior Data Engineer

Overview

Job Title: Senior Data Engineer

Location: Remote

Experience: 5+ years

Job Summary:

We are looking for a talented and experienced Senior Data Engineer who has hands-on expertise with Databricks, Spark, Java, and Web Services. The ideal candidate will be able to understand the bigger picture, collaborate with various teams, and drive high-performance data engineering solutions. This role requires a strong technical background along with excellent problem-solving and leadership skills.

Essential Job Functions:

• Collaborate with architects to design scalable and efficient data systems.
• Develop, maintain, and optimize Databricks and Spark-based solutions for data processing.
• Continuously monitor system cost and performance, ensuring efficient resource usage.
• Work closely with Business Analysts to understand and fulfill integration requirements.
• Troubleshoot performance bottlenecks and other functional issues across the data pipeline.
• Pay attention to details and document key architectural and design decisions.
• Mentor and guide junior developers, ensuring code quality through thorough code reviews.
• Handle fast-paced projects and provide support for production issues as needed.

Other Responsibilities:

• Document and maintain comprehensive project artifacts.
• Keep up-to-date with industry standards, methodologies, processes, and best practices.
• Report any known or suspected loss, theft, or unauthorized disclosure of personal information to the General Counsel or Chief Compliance Officer.
• Safeguard company assets and adhere to compliance programs.
• Maintain a customer-centric mindset, focusing on efficiency, quality, and growth.
• Collaborate effectively with other team members and departments.
• Perform other duties as assigned.

Minimum Qualifications and Job Requirements:

• At least 5 years of IT development experience, with a focus on data-driven projects.
• Strong analytical and problem-solving skills.
• Experience in designing data solutions, conducting code reviews, and mentoring junior engineers.
• Strong proficiency in SQL and backend development.
• Hands-on experience with the following technologies:
• Python/PySpark
• SQL/PLSQL
• Databricks

Preferred Qualifications:

• Experience with Java or C#.
• Familiarity with cloud platforms, particularly Azure.
• Experience with Kafka, Node.js, and Azure Data Factory.

Job Type: Full-time

Pay: ₹1,000,000.00 - ₹1,500,000.00 per year

Schedule:

• Day shift

Work Location: Remote