Technical Lead

Overview

Job Title: Database Tech Lead

Experience: 7-8 years

Location: Mumbai

Job Type: Full-time

Type of Hire : On Roll

About Us: CRISIL is a leading rating company that is seeking an experienced Database Software Engineer to join our team. We are looking for a skilled and motivated individual who can design, develop, and maintain our database systems and ETL pipelines to support our growing business.

Job Summary: We are seeking a highly skilled Database Tech Lead with 7-8 years of experience to join our team. Ability to work in a fast-paced environment and prioritize multiple tasks and projects. The successful candidate will be responsible for designing, developing, and maintaining our database systems and ETL pipelines, ensuring high performance, scalability, and reliability. The Database Tech Lead will work closely with our development team to ensure that our database systems meet the requirements of our applications and services.

Key Responsibilities:

• Lead the design, development, and maintenance of database architectures, including data modeling, database schema, and data warehousing.
• Collaborate with development teams to ensure database integration with applications and services.
• Provide technical guidance and mentorship to junior team members.
• Working knowledge of large-scale databases, including database performance tuning, backup and recovery, and security.
• Ensure database compliance with organizational policies, industry standards, and regulatory requirements.
• Develop and implement database monitoring and alerting systems.

• Develop and maintain database models, including entity-relationship diagrams and schema definitions
• Implement database security measures to ensure data integrity and confidentiality
• Quickly resolving user-reported issues, troubleshooting problems, and collaborating with stakeholders to implement fixes, minimizing the impact on user experience

• Design and develop ETL pipelines to extract, transform, and load data from various sources
• Develop and maintain ETL scripts using Python/PySpark and other programming languages
• Ensure data quality and integrity throughout the ETL process

• Integrate data from various sources, including APIs, files, and databases
• Develop and execute data migration plans to ensure seamless data transition

• Analyze and optimize database performance, including query optimization and indexing
• Implement caching and other techniques to improve database performance

• Experience in client facing role
• Experience understanding functional requirements, technical feasibility and translating to technical advantage
• Work closely with development teams to ensure database systems meet application requirements
• Communicate database design and implementation plans to stakeholders
• Provide technical guidance and support to junior team members

Technical Requirements:

• Python (required)
• PySpark

• Experience with relational databases (e.g. MySQL, PostgreSQL, Oracle)

• Experience with any open source ETL tools

• Experience with various data formats (e.g. CSV, JSON, Avro, Parquet)

• Experience with Linux/Unix operating systems
• Familiarity with AWS cloud-based platforms

Nice to Have:

• Data warehousing and business intelligence tools (e.g. Tableau, Power BI)
• Containerization and orchestration tools (e.g. Docker, Kubernetes)

Example of Python skills we are looking for:

• Experience with Python ETL frameworks : PySpark
• Python 3.x
• Pandas, NumPy, and other data science libraries

Example of ETL skills we are looking for:

• Experience with any open source ETL tools
• Familiarity with data integration frameworks (e.g. Apache NiFi, AWS Glue)
• Knowledge of data quality and data governance best practices
• Experience with data migration and data warehousing concepts