Specialist Software Engineer - YARS Integrator (Bigdata Admin)

Reference 25000D16

Responsibilities

Job Title: Integrator - YARS Support Team

Job Description:

We are seeking a skilled Integrator to join our support team to manage and maintain the YARS tool, which is responsible for synchronizing data from our on-premise Hadoop cluster to Azure cloud storage. The ideal candidate will have a strong background in Hadoop ecosystems, cloud technologies, and data synchronization processes. The Integrator will play a crucial role in ensuring the smooth operation of data transfers and the overall performance of the YARS tool.

Roles and Responsibilities:

Tool Management

• Oversee the operation and maintenance of the YARS tool within the Cloudera distribution.
• Ensure that the tool is configured correctly for optimal performance and reliability.
  
  

Data Synchronization

• Manage the synchronization process of data from the on-premise Hadoop cluster to Azure cloud storage.
• Monitor data transfer jobs to ensure they are completed successfully and within the expected timeframes.
  
  

Production Support

• Provide production support for the YARS tool, addressing any issues that arise during data synchronization.
• Troubleshoot and resolve problems related to data transfer and tool performance.
  
  

Performance Monitoring

• Implement monitoring solutions to track the performance of the YARS tool and data synchronization processes.
• Analyse logs and metrics to identify potential bottlenecks or issues in the data transfer workflow.
  
  

Collaboration

• Work closely with data engineering and IT teams to ensure seamless integration of the YARS tool with existing systems.
• Collaborate with cloud architects to optimize data storage solutions in Azure.
  
  

Documentation

• Maintain comprehensive documentation of the YARS tool configuration, processes, and troubleshooting steps.
• Update user manuals and provide training to team members on the use of the YARS tool.
  
  

Continuous Improvement

• Identify opportunities for process improvements and implement best practices in data synchronization and tool management.
• Stay updated on the latest technologies and trends in Hadoop, cloud storage, and data synchronization.
  
  

Compliance and Security

• Ensure that data transfers comply with organizational policies and relevant regulations.
• Implement security best practices to protect sensitive data during synchronization.
  
  

Required

Profile required

Qualifications:

• Bachelor’s degree in computer science, Information Technology, or a related field.
• Proven experience with Hadoop ecosystems, specifically Cloudera distributions.
• Strong understanding of cloud storage solutions, particularly Azure.
• Experience with data synchronization tools and processes.
• Proficient in troubleshooting and resolving technical issues.
• Excellent communication and collaboration skills.
• Proficient in Shell/Python Scripting
  
  

Why join us

"We are committed to creating a diverse environment and are proud to be an equal opportunity employer. All qualified applicants receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status”.

Business insight

At Société Générale, we are convinced that people are drivers of change, and that the world of tomorrow will be shaped by all their initiatives, from the smallest to the most ambitious. Whether you’re joining us for a period of months, years or your entire career, together we can have a positive impact on the future. Creating, daring, innovating, and taking action are part of our DNA. If you too want to be directly involved, grow in a stimulating and caring environment, feel useful on a daily basis and develop or strengthen your expertise, you will feel right at home with us!

Still hesitating?

You should know that our employees can dedicate several days per year to solidarity actions during their working hours, including sponsoring people struggling with their orientation or professional integration, participating in the financial education of young apprentices, and sharing their skills with charities. There are many ways to get involved.

We are committed to support accelerating our Group’s ESG strategy by implementing ESG principles in all our activities and policies. They are translated in our business activity (ESG assessment, reporting, project management or IT activities), our work environment and in our responsible practices for environment protection.

Diversity and Inclusion

We are an equal opportunities employer and we are proud to make diversity a strength for our company. Societe Generale is committed to recognizing and promoting all talents, regardless of their beliefs, age, disability, parental status, ethnic origin, nationality, gender identity, sexual orientation, membership of a political, religious, trade union or minority organisation, or any other characteristic that could be subject to discrimination.