Pune, Maharashtra, India
Information Technology
Full-Time
Go Digital Technology Consulting LLP
Overview
Designation – Data Engineer (Engineer & Senior Engineer Level)
Location: Remote (across India)
Experience: 3 to 8 years
Technologies / Skills
Location: Remote (across India)
Experience: 3 to 8 years
Technologies / Skills
- Strong hands-on experience with AWS data engineering services (ETL, orchestration, and streaming tools.
- Proficiency in SQL, Python (Pandas, NumPy) and PySpark.
- Experience in ETL/ELT pipeline development, data modeling and working with large-scale data systems.
- Familiarity with CI/CD workflows, Git and version control practices.
- Collaborate with business stakeholders and technical teams to gather requirements and translate them into scalable data solutions.
- Design, build and maintain robust, secure, high-performance data pipelines
- Ensure adherence to data quality, governance and compliance standards
- Work with architects and engineering leads to follow best practices and optimize for performance
- Communicate insights and technical decisions effectively with cross-functional stakeholders
- Participate in Agile ceremonies and deliver iterative improvements in data infrastructure
- 3+ years of hands-on experience with AWS data engineering services, including:
- AWS Glue, Athena, EMR, Redshift, Lambda, Kinesis, S3, Step Functions, CloudWatch.
- Expertise in building data pipelines using PySpark/Spark SQL.
- Strong SQL and Python skills with experience in large-scale data transformation and ingestion.
- Knowledge of Spark internals (joins, partitioning, memory management) and performance tuning via Spark UI.
- Experience with Git, CI/CD pipelines, and working in Agile environments.
- Understanding of partitioning, schema design, and query performance optimization.
- Experience with workflow orchestration tools like Apache Airflow or AWS Step Functions.
- Exposure to streaming platforms such as Kafka, Kinesis etc .
- Working knowledge of AWS SDKs (e.g., Boto3) for automation and integration.
- Familiarity with modern ETL/ELT patterns and data modeling techniques.
- Basic proficiency in shell scripting for automation and support tasks.
Similar Jobs
View All
1 Day ago
.NET Developer - Fresher
Information Technology
- 200000 - 200001 INR - Monthly
- Pune, Maharashtra, India
About the job:Key responsibilities: 1. Understand requirements and design. 2. Write code in C# and develop complex SQL queries for the assigned work. 3. Test the code and submit it to Git. 4. Demonstrate the developed modules for client approval.Wh...
1 Day ago
Java Backend Developer
Information Technology
- Gurugram, Haryana, India
About BNP Paribas India SolutionsEstablished in 2005, BNP Paribas India Solutions is a wholly owned subsidiary of BNP Paribas SA, European Union’s leading bank with an international reach. With delivery centers located in Bengaluru, Chennai and Mumb...
1 Day ago
Kanerika Software - Senior Data Governance Engineer - Microsoft Purview
Information Technology
- Pune, Maharashtra, India
Key Responsibilities Set up and manage Microsoft Purview accounts, collections, and access controls (RBAC). Integrate Purview with data sources : Azure Data Lake, Synapse, SQL DB, Power BI, Snowflake. Schedule and monitor metadata scanning and cl...
1 Day ago
DevOps Engineer - CI/CD Pipeline
Information Technology
- Pune, Maharashtra, India
Company DescriptionCloudologic is a prominent cloud consulting and IT service provider based in Singapore, with a deep-rooted presence in India.Specializing in cloud operations, cyber security, and managed services, Cloudologic has earned trust worl...
1 Day ago
Business Analyst in Delhi, Ghaziabad, Gurgaon, Indore, Lucknow, Chandigarh, Dehradun, Noida, Mohali, Jaipur (Hybrid)
Information Technology
- Pune, Maharashtra, India
We are looking for a motivated Business Analyst to join our organization. This is a great opportunity for fresh graduates who want to grow in the business analysis and technology domain.Key Responsibilities You will support cross-functional teams i...
1 Day ago
SQL Developer(f/m/d)
Information Technology
- Pune, Maharashtra, India
Introducing Thinkproject PlatformPioneering a new era and offering a cohesive alternative to the fragmented landscape of construction software, Thinkproject seamlessly integrates the most extensive portfolio of mature solutions with an innovative pl...
1 Day ago
Business Analyst in Delhi, Ghaziabad, Gurgaon, Indore, Lucknow, Chandigarh, Dehradun, Noida, Mohali, Jaipur (Hybrid)
Information Technology
- Pune, Maharashtra, India
We are looking for a motivated Business Analyst to join our organization. This is a great opportunity for fresh graduates who want to grow in the business analysis and technology domain.Key Responsibilities You will support cross-functional teams i...
1 Day ago
Business Analyst in Delhi, Ghaziabad, Gurgaon, Indore, Lucknow, Chandigarh, Dehradun, Noida, Mohali, Jaipur (Hybrid)
Information Technology
- Pune, Maharashtra, India
We are looking for a motivated Business Analyst to join our organization. This is a great opportunity for fresh graduates who want to grow in the business analysis and technology domain.Key Responsibilities You will support cross-functional teams i...
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in