Chennai, Tamil Nadu, India
Information Technology
Full-Time
ShyftLabs
Overview
Position Overview
We are looking for an experienced Lead Data Engineer to join our dynamic team. If you are passionate about building scalable software solutions, and work collaboratively with cross-functional teams to define requirements and deliver solutions we would love to hear from you.
ShyftLabs is a growing data product company that was founded in early 2020 and works primarily with Fortune 500 companies. We deliver digital solutions built to help accelerate the growth of businesses in various industries, by focusing on creating value through innovation.
Job Responsibilities:
We are looking for an experienced Lead Data Engineer to join our dynamic team. If you are passionate about building scalable software solutions, and work collaboratively with cross-functional teams to define requirements and deliver solutions we would love to hear from you.
ShyftLabs is a growing data product company that was founded in early 2020 and works primarily with Fortune 500 companies. We deliver digital solutions built to help accelerate the growth of businesses in various industries, by focusing on creating value through innovation.
Job Responsibilities:
- Develop and maintain data pipelines and ETL/ELT processes using Python
- Design and implement scalable, high-performance applications
- Work collaboratively with cross-functional teams to define requirements and deliver solutions
- Develop and manage near real-time data streaming solutions using Pub, Sub or Beam
- Contribute to code reviews, architecture discussions, and continuous improvement initiatives
- Monitor and troubleshoot production systems to ensure reliability and performance
- 5+ years of professional software development experience with Python
- Strong understanding of software engineering best practices (testing, version control, CI/CD)
- Experience building and optimizing ETL/ELT processes and data pipelines
- Proficiency with SQL and database concepts
- Experience with data processing frameworks (e.g., Pandas)
- Understanding of software design patterns and architectural principles
- Ability to write clean, well-documented, and maintainable code
- Experience with unit testing and test automation
- Experience working with any cloud provider (GCP is preferred)
- Experience with CI/CD pipelines and Infrastructure as code
- Experience with Containerization technologies like Docker or Kubernetes
- Bachelor's degree in Computer Science, Engineering, or related field (or equivalent experience)
- Proven track record of delivering complex software projects
- Excellent problem-solving and analytical thinking skills
- Strong communication skills and ability to work in a collaborative environment
- Experience with GCP services, particularly Cloud Run and Dataflow
- Experience with stream processing technologies (Pub/Sub)
- Familiarity with big data technologies (Airflow)
- Experience with data visualization tools and libraries
- Knowledge of CI/CD pipelines with Gitlab and infrastructure as code with Terraform
- Familiarity with platforms like Snowflake, Bigquery or Databricks,
- GCP Data engineer certification
Similar Jobs
View All
1 Day ago
Data Analyst (Odia Speakers)
AI & Machine Learning Advancement
- 1 - 20 Yrs
- Jharkhand, Andhra Pradesh, Odisha
For thousands of years, maps have provided humans with the knowledge they need to make decisions. As a Maps Evaluator, you will have the opportunity to provide ground truth for your town, city or country.
At Peroptyx, we are looking for Data Ana...
1 Day ago
Data Analyst (Kannada Speakers)
AI & Machine Learning Advancement
- 1 - 20 Yrs
- Karnataka, India
For thousands of years, maps have provided humans with the knowledge they need to make decisions. As a Maps Evaluator, you will have the opportunity to provide ground truth for your town, city or country.
At Peroptyx, we are looking for Data Ana...
1 Day ago
Technical Lead - Backend Development - Node.Js
Finance & Banking
- 50,00,000 - 55,00,000 INR - Annual
- 6 - 8 Yrs
- Bangalore
What youʼll be doing
We are much more than our job descriptions, but here is where you will begin:
● Collaborate with stakeholders, including product owners, project managers, and scrum masters, to define and clarify project requirements.
● Transl...
1 Day ago
Engineering Manager
Finance & Banking
- 55,00,000 - 60,00,000 INR - Annual
- 8 - 12 Yrs
- Bangalore
What youʼll be doing
Weʼre much more than our job descriptions, but hereʼs where youʼll begin:
● Lead and deliver large-scale platform and product initiatives that impact millions of users.
● Collaborate with product, design, and business teams to...
1 Day ago
Technical Project Manager (WordPress)
Information Technology
- 6 - 10 Yrs
- Ahmedabad
Location: Ahmedabad / Remote
Experience: 6+ Years
About Us:
E2M Solutions is home to a growing remote team of WordPress experts building innovative digital solutions. We pride ourselves on delivering consistent value and excellence to our client...
1 Day ago
Senior WordPress Frontend Developer
Information Technology
- 5 - 10 Yrs
- Ahmedabad
At E2M Solutions, we're building a powerhouse remote team to deliver high-performing, user-centric WordPress solutions. If you live and breathe frontend development and are looking to work on cutting-edge WordPress projects with a passionate global t...
2 Days ago
Python Developer - C++/EDA
Information Technology
- Chennai, Tamil Nadu, India
Job DescriptionWe are seeking a highly skilled C++ Python Developer with a strong background in software development, scripting, and EDA tool integration. This role focuses on creating, enhancing, and maintaining tools used in silicon design and ver...
2 Days ago
Business Analyst
Information Technology
- Chennai, Tamil Nadu, India
Project Role : Business AnalystProject Role Description : Analyze an organization and design its processes and systems, assessing the business model and its integration with technology. Assess current state, identify customer requirements, and defin...
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in