Database Software Engineer

Job Summary: We are seeking a highly skilled Database Software Engineer with 4-5 years of experience to join our team. The successful candidate will be responsible for designing, developing, and maintaining our database systems and ETL pipelines, ensuring high performance, scalability, and reliability. The Database Software Engineer will work closely with our development team to ensure that our database systems meet the requirements of our applications and services.

Key Responsibilities:

• Design and develop database architectures to support business requirements
• Develop and maintain database models, including entity-relationship diagrams and schema definitions
• Implement database security measures to ensure data integrity and confidentiality

• Design and develop ETL pipelines to extract, transform, and load data from various sources
• Develop and maintain ETL scripts using Python and other programming languages
• Ensure data quality and integrity throughout the ETL process

• Integrate data from various sources, including APIs, files, and databases
• Develop and execute data migration plans to ensure seamless data transition

• Analyze and optimize database performance, including query optimization and indexing
• Implement caching and other techniques to improve database performance

• Work closely with development teams to ensure database systems meet application requirements
• Communicate database design and implementation plans to stakeholders
• Provide technical guidance and support to junior team members

Technical Requirements:

• Python (required)
• PySpark

• Experience with relational databases (e.g. MySQL, PostgreSQL, Oracle)

• Experience with any open source ETL tools

• Experience with various data formats (e.g. CSV, JSON, Avro, Parquet)

• Experience with Linux/Unix operating systems
• Familiarity with AWS cloud-based platforms

Nice to Have:

• Data warehousing and business intelligence tools (e.g. Tableau, Power BI)
• Containerization and orchestration tools (e.g. Docker, Kubernetes)

Example of Python skills we are looking for:

• Python 3.x
• Pandas, NumPy, and other data science libraries
• Experience with Python ETL frameworks : PySpark

Example of ETL skills we are looking for:

• Experience with any open source ETL tools
• Familiarity with data integration frameworks (e.g. Apache NiFi, AWS Glue)
• Knowledge of data quality and data governance best practices
• Experience with data migration and data warehousing concepts