Gurugram, Haryana, India
Information Technology
Full-Time
Arcgate
Overview
Arcgate is a dynamic and rapidly growing team of 2500+ professionals passionate about data and technology. We deliver cutting-edge solutions to some of the world’s most innovative startups to market leaders across application development, quality engineering, AI data preparation, data enrichment, search relevance, and content moderation.
Responsibilities
Click the Apply button below and become an Arcgatian!
Apply
Responsibilities
- Design, build, and optimize Python based data pipelines that handle large, complex, and messy datasets efficiently.
- Develop and manage scalable data infrastructures, including databases and data warehouses such as Snowflake, Azure Data Factory etc. ensuring reliability and performance.
- Build, maintain, and optimize CDC processes that integrate data from multiple sources into the data warehouse.
- Collaborate closely with data scientists, analysts, and operations teams to gather requirements and deliver high-quality data solutions.
- Perform data quality checks, validation, and verification to ensure data integrity and consistency.
- Support and optimize data flows, ingestion, transformation, and publishing across various systems.
- Work with AWS infrastructure (ECS, RDS, S3), manage deployments using Docker, and package services into containers.
- Use tools like Prefect, Dagster and dbt to orchestrate and transform data workflows.
- Implement CI/CD pipelines using Harness and GitHub Actions.
- Monitor system health and performance using DataDog.
- Manage infrastructure orchestration with Terraform and Terragrunt.
- Stay current with industry trends, emerging tools, and best practices in data engineering.
- Coach and mentor junior team members, promoting best practices and skill development.
- Contribute across diverse projects, demonstrating flexibility and adaptability.
- Bachelor’s degree in Computer Science, Engineering, Mathematics, Physics, or a related field.
- 5+ years of demonstrable experience building reliable, scalable data pipelines in production environments.
- Strong experience with Python, SQL programming, and data architecture.
- Hands-on experience with data modeling in Data Lake or Data Warehouse environments (Snowflake preferred).
- Familiarity with Prefect, Dagster, dbt, and ETL/ELT pipeline frameworks.
- Experience with AWS services (ECS, RDS, S3) and containerization using Docker.
- Knowledge of TypeScript, React, Node.js is a plus for collaborating on the application platform.
- Strong command of GitHub for source control and Jira for change management.
- Strong analytical and problem-solving skills, with a hands-on mindset for wrangling data and solving complex challenges.
- Excellent communication and collaboration skills; ability to work effectively with cross- functional teams.
- A proactive, start-up mindset, adaptable, ambitious, responsible, and ready to contribute wherever needed.
- Passion for delivering high-quality solutions with meticulous attention to detail.
- Enjoy working in an inclusive, respectful, and highly collaborative environment where every voice matters.
- Competitive salary package.
- Opportunities for growth, learning, and professional development.
- Dynamic, collaborative, and innovation-driven work culture.
- Work with cutting-edge technologies and leading-edge startups.
Click the Apply button below and become an Arcgatian!
Apply
Similar Jobs
View All
1 Day ago
Senior Software Engineer II
Information Technology
- Gurugram, Haryana, India
Would you like to be part of a team that delivers high-quality software to our customers?Are you a highly visible champion with a ‘can do’ attitude and enthusiasm that inspires others?About Our TeamOur team consists of software engineers, data scien...
1 Day ago
Software Engineer - L3 Support
Information Technology
- Gurugram, Haryana, India
Canonical is a leading provider of open source software and operating systems to the global enterprise and technology markets. Our platform, Ubuntu, is very widely used in breakthrough enterprise initiatives such as public cloud, data science, AI, e...
1 Day ago
Software Engineer III
Information Technology
- Gurugram, Haryana, India
Are you ready for the next step in your engineering career?Would you enjoy working on our cutting-edge products?About The TeamThe Product Information Manager team oversees the organization's Product Information Management system, ensuring accurate, ...
1 Day ago
Reports and Analytics Software Engineer
Information Technology
- Gurugram, Haryana, India
We are seeking a highly skilled and hands-on Reports and Analytics Software Engineer to join our growing data team. This role is crucial in transforming raw data into actionable insights through the design, development, and maintenance of robust rep...
1 Day ago
Software Engineer - L3 Support
Information Technology
- Gurugram, Haryana, India
Canonical is a leading provider of open source software and operating systems to the global enterprise and technology markets. Our platform, Ubuntu, is very widely used in breakthrough enterprise initiatives such as public cloud, data science, AI, e...
1 Day ago
Manager_ Business Analyst
Information Technology
- Chennai, Tamil Nadu, India
Key Responsibilities Deeply understand user journeys to generate data-driven insights and actionable recommendations for product and customer success teams. Develop hypotheses, design and run A/B experiments, and identify high-confidence areas of op...
1 Day ago
React Developer Systems Engineer
Information Technology
- Chennai, Tamil Nadu, India
About AutozoneAutoZone is the nation's leading retailer and a leading distributor of automotive replacement parts and accessories with more than 6,000 stores in US, Puerto Rico, Mexico, and Brazil. Each store carries an extensive line for cars, spor...
1 Day ago
Conversational AI Engineer
Information Technology
- Gurugram, Haryana, India
Roboyo is not a typical technology consultancy. We have been at the forefront of Business Process Automation since the sector began, less than a decade ago.We started as pioneers. Today, we are the world’s largest specialist Intelligent Automation c...
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in