Data Engineer - D

Job Description

Data engineers are responsible for building reliable and scalable data infrastructure that enables organizations to derive meaningful insights, make data-driven decisions, and unlock the value of their data assets.

Job Description - Grade Specific

The role involves leading and managing a team of data engineers, defining and executing the data engineering strategy, and ensuring the effective delivery of data solutions. They provide technical expertise, drive innovation, and collaborate with stakeholders to deliver high-quality, scalable, and reliable data infrastructure and solutions.

Skills (competencies)

Ab Initio

Agile (Software Development Framework)

Apache Hadoop

AWS Airflow

AWS Athena

AWS Code Pipeline

AWS EFS

AWS EMR

AWS Redshift

AWS S3

Azure ADLS Gen2

Azure Data Factory

Azure Data Lake Storage

Azure Databricks

Azure Event Hub

Azure Stream Analytics

Azure Sunapse

Bitbucket

Change Management

Client Centricity

Collaboration

Continuous Integration and Continuous Delivery (CI/CD)

Data Architecture Patterns

Data Format Analysis

Data Governance

Data Modeling

Data Validation

Data Vault Modeling

Database Schema Design

Decision-Making

DevOps

Dimensional Modeling

GCP Big Table

GCP BigQuery

GCP Cloud Storage

GCP DataFlow

GCP DataProc

Git

Google Big Tabel

Google Data Proc

Greenplum

HQL

IBM Data Stage

IBM DB2

Industry Standard Data Modeling (FSLDM)

Industry Standard Data Modeling (IBM FSDM))

Influencing

Informatica IICS

Inmon methodology

JavaScript

Jenkins

Kimball

Linux - Redhat

Negotiation

Netezza

NewSQL

Oracle Exadata

Performance Tuning

Perl

Platform Update Management

Project Management

PySpark

Python

R

RDD Optimization

SantOs

SaS

Scala Spark

Shell Script

Snowflake

SPARK

SPARK Code Optimization

SQL

Stakeholder Management

Sun Solaris

Synapse

Talend

Teradata

Time Management

Ubuntu

Vendor Management