Pune, Maharashtra, India
Information Technology
Full-Time
Jeavio
Overview
We are seeking an experienced Senior Data Engineer to join our team.
The ideal candidate will have a strong background in data engineering and AWS infrastructure, with hands-on experience in building and maintaining data pipelines and the necessary infrastructure components.
Responsibilities
The role will involve using a mix of data engineering tools and AWS services to design, build, and optimize data Responsibilities :
The ideal candidate will have a strong background in data engineering and AWS infrastructure, with hands-on experience in building and maintaining data pipelines and the necessary infrastructure components.
Responsibilities
The role will involve using a mix of data engineering tools and AWS services to design, build, and optimize data Responsibilities :
- Design, develop, and maintain data pipelines using Airflow and AWS services.
- Implement and manage data warehousing solutions with Databricks and PostgreSQL.
- Automate tasks using GIT / Jenkins.
- Develop and optimize ETL processes, leveraging AWS services like S3, Lambda, AppFlow, and DMS.
- Create and maintain visual dashboards and reports using Looker.
- Collaborate with cross-functional teams to ensure smooth integration of infrastructure components.
- Ensure the scalability, reliability, and performance of data platforms.
- Work with Jenkins for infrastructure and functional areas of expertise :
- Working as a senior individual contributor on a data intensive project.
- Strong experience in building high performance, resilient & secure data processing pipelines preferably using Python based stack.
- Extensive experience in building data intensive applications with a deep understanding of querying and modeling with relational databases preferably on time-series data.
- Intermediate proficiency in AWS services (S3, Airflow).
- Proficiency in Python and PySpark.
- Proficiency with ThoughtSpot or Databricks.
- Intermediate proficiency in database scripting (SQL).
- Basic experience with Jenkins for task to Have :
- Intermediate proficiency in data analytics tools (Power BI / Tableau / Looker / ThoughSpot).
- Experience working with AWS Lambda, Glue, AppFlow, and other AWS transfer services.
- Exposure to PySpark and data automation tools like Jenkins or CircleCI.
- Familiarity with Terraform for infrastructure-as-code.
- Experience in data quality testing to ensure the accuracy and reliability of data pipelines.
- Proven experience working directly with U.
- Ability to work independently and take the lead on and experience :
- Bachelors or masters in computer science or related fields.
- 5+ years of needed :
- Databricks.
- PostgreSQL.
- Python & Pyspark.
- AWS Stack.
- Power BI / Tableau / Looker / ThoughSpot.
- Familiarity with GIT and/or CI/CD tools.
Similar Jobs
View All
1 Day ago
Agira Technologies - Senior DevOps Engineer - Cloud Infrastructure
Information Technology
- Pune, Maharashtra, India
Job Title : Senior DevOps Engineer / Principal DevOps Engineer.Location : Chennai.Experience : 8+ Years.Notice : Immediate to 15 days.Job DescriptionWe are seeking a Principal DevOps Engineer to drive the development, automation, and optimization of...
1 Day ago
NetScore Technologies - .Net Developer
Information Technology
- Pune, Maharashtra, India
NetScore Technologies, an award-winning Oracle NetSuite Partner, is currently looking for talented individuals to join our growing cloud ERP practice in Hyderabad.Headquartered in Vienna, Virginia with a strong focus on building AI powered cloud app...
1 Day ago
Estuate - Data Engineer/Integration Developer - Apache Spark
Information Technology
- Pune, Maharashtra, India
Key Responsibilities Design, develop, and maintain scalable and reliable data pipelines and ETL processes. Write, test, and deploy efficient Python code for data manipulation, scripting, and interacting with APIs. Utilize Apache Airflow for sched...
1 Day ago
WizCommerce - Technical Support Engineer - Ticketing System
Information Technology
- Pune, Maharashtra, India
About The CompanyAt WizCommerce, we are revolutionising B2B commerce for manufacturers, wholesalers, and distributors across the USA, India and Canada. Our mission is to empower businesses with innovative technology solutions that drive revenue and ...
1 Day ago
FictiveBox - Business Analyst
Information Technology
- Pune, Maharashtra, India
We are seeking an experienced Business Analyst with a strong background in handling large-scale government projects. The role will begin with a mandatory 3-4 month on-site engagement at a designated government workshop, aimed at gaining an in-depth ...
1 Day ago
Full Stack Developer - Python/React.js
Information Technology
- Pune, Maharashtra, India
Leading role to handle team and project deliverables independently. Onboarding with project team as lead and ownership to each project life cycle implementation and deliverables. Collaborate with a cross-functional team to design, develop, and imp...
1 Day ago
ELLKAY - System Administrator - IT Infrastructure
Information Technology
- Pune, Maharashtra, India
Were looking for a skilled Mid-Level System Administrator to join our IT infrastructure team. The ideal candidate has hands-on experience managing both Windows and Linux systems, working with cloud platforms (Azure and AWS), and supporting productio...
1 Day ago
Estuate - .Net Full Stack Developer - C#/AngularJS
Information Technology
- Pune, Maharashtra, India
Key Responsibilities Design, develop, and support robust backend applications using .NET Core (6 or later) and C#. Build and maintain RESTful APIs and service architectures with a strong understanding of EF Core, LINQ, and MVC patterns. Develop d...
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in