UDL Data Engineer

Greetings from QUESS Corp Limited!!!

ABOUT QUESS CORP LIMITED:

Established in 2007 and headquartered in Bengaluru, Quess is one of India’s largest private-sector employers and integrated business service providers. The company has a presence in over 64 locations across India, Southeast Asia, and North America, with a strength of 500,000+ employees.

We provide a host of technology-enabled staffing and managed outsourcing services across processes such as sales & marketing, customer care, after-sales service, back-office operations, manufacturing operations, facilities and security management, HR & F&A operations, IT & mobility services, etc.

Our business strategy is aligned with our goal of creating a more productive workforce.

It includes training and skill development initiatives for better employability, helping job seekers find job opportunities easily, digitising workflows, and providing social security benefits to a wider employable population. Quess has been certified ‘Great Place to Work’ thrice in a row in recognition of its culture that supports diversity, equal opportunity, and collaboration. Learn more about how we drive productivity and achieve success for our clients.

Duties and responsibilities:

• The duties and responsibilities of this job are to prepare data and make it available in an efficient and optimized format for our different data consumers, ranging from BI and analytics to data science applications. It requires to work with current technologies used by IntelDS and in particular Apache Spark, Lambda & Step Functions, Glue Data Catalog, and RedShift on AWS environment. This includes:

• Design and develop new data ingestion patterns into IntelDS Raw and/or Unified data layers based on the requirements and needs for connecting new data sources or for building new data objects. Working in ingestion patterns allow to automate the data pipelines.

• Participate to and apply DevSecOps practices by automating the integration and delivery of data pipelines in a cloud environment. This can include the design and implementation of end-to-end data integration tests and/or CICD pipelines.

• Analyse existing data models, identify and implement performance optimizations for data ingestion and data consumption. The objective is to accelerate data availability within the platform and to consumer applications.

• Support client applications in connecting and consuming data from the platform, and ensure they follow our guidelines and best practices.

• Participate in the monitoring of the platform and debugging of detected issues and bugs.

Qualifications:

Minimum of 3 years prior experience as data engineer with proven experience on Big Data and Data Lakes on a cloud environment.

Bachelor or Master degree in computer science or applied mathematics (or equivalent).

Qualifications include:

• Proven experience working with data pipelines / ETL / BI regardless of the technology.

• Proven experience working with AWS including at least 3 of: RedShift, S3, EMR, Cloud Formation, DynamoDB, RDS, lambda.

• Big Data technologies and distributed systems: one of Spark, Presto or Hive.

• Python language: scripting and object oriented.

• Fluency in SQL for datawarehousing (RedShift in particular is a plus).

• Good undesrtanding on datawarehousing and Data modelling concepts

• Familiar with GIT, Linux, CI/CD pipelines is a plus.

• Strong systems/process orientation with demonstrated analytical thinking, organization skills and problem-solving skills.

• Ability to self-manage, prioritize and execute tasks in a demanding environment.

• Strong consultancy orientation and experience, with the ability to form collaborative, productive working relationships across diverse teams and cultures is a must.

• Willingness and ability to train and teach others.

• Ability to facilitate meetings and follow up with resulting action items.

Application Process:

To fast-track your application, HYRGPT (AI Agent) will guide you through a seamless screening process:

Step 1: Automated Screening

HYRGPT evaluates your responses to basic qualification questions to determine if you meet the role’s requirements.

Step 2: Virtual First-Round Interview

If you pass the screening, HYRGPT conducts a short AI-driven interview tailored to your role, ensuring a fair and timely evaluation.

Step 3: Live Interview

Shortlisted candidates will proceed to live interviews with our hiring team.