Bangalore, Karnataka, India
Information Technology
Full-Time
Epigee, Inc
Overview
Job Title: Data Analyst (Remote, Full-Time)
Location: Remote
Employment Type: Full-Time
Experience Level: 4+
Job Summary:
We are seeking a skilled Data Analyst with strong hands-on experience in ETL/ELT pipeline development, cloud deployment, and DevOps practices. The ideal candidate is comfortable working with AWS, Airflow, Docker, and Python, and can manage complex data workflows with a focus on automation, transformation, and cloud-native deployment.
Key Responsibilities:
- Design, develop, and maintain ETL/ELT pipelines for ingesting, transforming, and loading data using Python, SQL, and AWS services.
- Work with tools like Apache Airflow for orchestration and automate job scheduling.
- Develop and deploy pipelines to AWS S3, Redshift, or other storage/compute services.
- Implement transformation logic using SQL scripting and Python .
- Handle flat file ingestion and ensure efficient loading and transformation into SQL databases.
- Ensure proper handling of null values or None types in Python for JSON serialization.
- Use Docker for containerizing applications and pipelines.
- Work with Infrastructure as Code (IaC) tools like Terraform or CloudFormation for deployment automation.
- Collaborate with cross-functional teams to understand data requirements and deliver solutions.
- Ensure pipelines are scalable, monitored, and follow best practices for performance and data integrity.
- Participate in DevOps processes, including CI/CD, deployment automation, and environment management.
Key Skills & Qualifications:
- 3+ years of experience in data analysis and pipeline development.
- Strong proficiency in Python and libraries such as Pandas, NumPy, and JSON handling.
- Deep understanding of ETL/ELT principles and best practices.
- Strong command over SQL for data extraction, transformation, and loading.
- Experience with AWS services like S3, Lambda, EC2, RDS, etc.
- Familiarity with Apache Airflow for pipeline orchestration and automation.
- Hands-on experience with Docker and deployment in DevOps environments.
- Knowledge of Terraform and/or AWS CloudFormation for infrastructure management.
- Understanding of data serialization formats and how Python dictionaries map to JSON.
- Ability to ensure data quality, handle edge cases, and avoid data loss during transformation.
- Experience in working with automated vs. manual job scheduling and pipeline triggers.
Best Regards
Abhishek Sharma
Abhishek.sharma@epigeeus.com
Job Type: Full-time
Pay: ₹100,000.00 - ₹120,000.00 per year
Schedule:
- Day shift
Supplemental Pay:
- Performance bonus
Work Location: Remote
Similar Jobs
View All
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in