Senior Data Engineer

ProArch is seeking a highly skilled Data Engineer with 6+ years of experience in the IT industry, specializing in Data Engineering and Data Migration. The ideal candidate will have strong expertise in Oracle to PostgreSQL migration and be well-versed in AWS DMS (Database Migration Service). The role requires proficiency in Python and PySpark to work on various data migration projects and ensure seamless data transformations.

Key Responsibilities:

• • Lead and execute data migration initiatives, specifically from Oracle to PostgreSQL.
  • Design, develop, and implement AWS DMS solutions to migrate databases.
  • Collaborate with cross-functional teams to understand data requirements and ensure smooth migration processes.
  • Develop and optimize data pipelines using Python and PySpark.
  • Troubleshoot migration issues and implement corrective actions to ensure minimal disruptions during data transfer.
  • Ensure data integrity, accuracy, and quality throughout the migration process.
  • Create and maintain detailed documentation for migration processes, workflows, and data transformations.
  • Stay up to date with the latest technologies, best practices, and tools in data engineering and migration.

Requirements

Requirements

• • 5+ years of experience in the IT Industry, with a focus on Data Engineering.
  • Strong hands-on experience with Oracle to PostgreSQL migrations.
  • Expertise in using AWS DMS (Database Migration Service) for seamless data migration.
  • Proficient in Python and PySpark, with a strong understanding of data engineering concepts and data pipeline development.
  • Solid understanding of database architecture, SQL, and data modeling.
  • Experience in troubleshooting, optimizing, and scaling data migration workflows.
  • Ability to work independently and in a team environment with strong problem-solving skills.
  • Excellent written and verbal communication skills.

Preferred Qualifications:

• • Experience with other AWS services such as AWS Lambda, S3, and Redshift is a plus.
  • Familiarity with other database migration tools and technologies.
  • Certifications in AWS or other relevant data engineering domains.