Delhi, Delhi, India
Finance & Banking
Full-Time
Liberin Technologies
Overview
Responsibilities and Duties
Required Experience, Skills, and Qualifications
- Design, develop, and optimize scalable data architectures in AWS environments.
- Implement and manage data pipelines for real-time and batch data ingestion, processing, and transformation.
- Model relational and non-relational databases, ensuring efficiency and scalability.
- Manage and optimize databases in AWS using services such as Amazon RDS, Aurora, DynamoDB, S3, Glue, EMR, Lambda, Kinesis, and others.
- Develop and optimize ETLs/ELTs using tools like AWS Glue, Apache Spark, dbt, and Airflow.
- Ensure data quality, security, and governance through best practices and tools like Lake Formation and AWS IAM.
- Collaborate with Data Science, Analytics, and Development teams to optimize data access and processing.
- Implement data quality testing and automated validations.
Required Experience, Skills, and Qualifications
- Bachelor’s degree in Systems Engineering, Computer Science, Mathematics, Statistics, or related fields.
- AWS Certified Data Analytics – Specialty or AWS Certified Solutions Architect certification (preferred).
- 3 to 5 years of experience in data engineering in cloud-first environments.
- Experience working with large-scale data (Big Data) and scalable architectures.
- Experience integrating data from multiple sources in structured and unstructured environments.
- Data Modeling: Experience in designing SQL and NoSQL databases optimized for performance and scalability.
- Cloud & AWS Data Services: Advanced knowledge of Redshift, RDS, DynamoDB, Glue, Kinesis, Lambda, EMR, S3, and other AWS data tools.
- Data Processing: Experience with Apache Spark, PySpark, Pandas, SQL, dbt, and Apache Airflow.
- Programming Languages: Strong proficiency in Python, SQL, Scala, or Java.
- Automation & DevOps: Experience with Terraform, Docker, and CI/CD for deploying data infrastructures.
- Optimization & Performance: Expertise in SQL query performance tuning, storage, and data processing optimization.
- Data Security & Governance: Implementation of access policies, auditing, and regulatory compliance (GDPR, HIPAA).
Similar Jobs
View All
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in