Free cookie consent management tool by TermsFeed Data Engineer | Antal Tech Jobs
Back to Jobs
2 Days ago

Data Engineer

decor
Pune, Maharashtra, India
Information Technology
Full-Time
FinStrat Management

Overview

The Role

We are looking for a highly skilled Data Engineer with strong expertise in Python programming, data processing, and analytical problem-solving. This role requires a blend of analytical skills, engineering capabilities, and hands-on data manipulation to derive actionable insights, build efficient pipelines, and support data-driven decision-making across teams.

Responsibilities

Data Exploration & Analysis:

  • Analyze large and complex datasets to extract meaningful insights and drive decision-making processes.
  • Identify data trends, anomalies, and opportunities for improvement within datasets and communicate findings clearly to stakeholders.
  • Collaborate with cross-functional teams to understand business requirements and transform them into technical solutions.

Data Pipeline Development

  • Design, develop, and maintain robust data pipelines for efficient data ingestion, transformation, and storage.
  • Optimize and automate data workflows to improve data availability, quality, and processing efficiency.
  • Implement ETL (Extract, Transform, Load) processes to support analytics and reporting needs.

Data Modeling & Feature Engineering

  • Build, validate, and maintain data models to support machine learning and statistical analysis needs.
  • Engineer and preprocess features for machine learning algorithms and ensure data quality and consistency.
  • Develop scalable solutions for feature storage, retrieval, and real-time model serving.

Programming & Scripting

  • Write efficient, scalable, and well-documented Python code to support data engineering and analysis tasks.
  • Collaborate on code reviews, optimize code performance, and apply best practices in coding and version control.
  • Use Python libraries (e.g., Pandas, NumPy, SQLAlchemy) to streamline data workflows and support analysis.

Performance Optimization & Troubleshooting

  • Monitor, troubleshoot, and enhance the performance of data systems and pipelines.
  • Address data integrity and pipeline issues promptly to ensure reliable data availability and system uptime.
  • Implement monitoring and logging to preemptively detect and resolve issues.

Collaboration & Communication

  • Work closely with data scientists, analysts, and other engineers to develop cohesive data solutions.
  • Translate complex technical issues into non-technical language for clear communication with stakeholders.
  • Contribute to documentation, data standards, and best practices to foster a data-centric culture.

Job Requirements

  • Technical Skills: Strong proficiency in Python and familiarity with data processing libraries (e.g., Pandas, NumPy, PySpark). Experience with SQL for data extraction and manipulation.
  • Data Engineering Knowledge: Experience in designing, building, and managing data pipelines, ETL workflows, and data warehousing solutions.
  • Statistical & Analytical Skills: Ability to apply statistical methods for data analysis and familiarity with machine learning concepts.
  • Problem-Solving Mindset: Proven ability to troubleshoot complex data issues and continuously improve workflows for efficiency and accuracy.
  • Communication: Effective communication skills to convey data insights to technical and non-technical stakeholders alike.
  • Bonus: Experience with cloud platforms (e.g., AWS, GCP), containerization (e.g., Docker), and orchestration tools (e.g., Airflow) is a plus.\

Preferred Education & Experience

  • Bachelor’s or Master’s degree in Computer Science, Data Science, Engineering, Mathematics, or a related field.
  • 3+ years of experience in a data science or data engineering role.

Benefits

  • Compensation commensurate with experience
  • Unlimited vacation
  • Ongoing education and training
  • Bonuses and profit-sharing
Share job
Similar Jobs
View All
7 Hours ago
Lead Python Developer
Information Technology
  • 8 - 12 Yrs
  • Anywhere in India/Multiple Locations
My Client is revolutionizing the hospitality industry by transforming how businesses manage their finances through cutting-edge Accounts Payable automation. Our mission? To eliminate manual work from business expenses and empower operators with real-...
decor
1 Day ago
US Voice Process (Banking Domain)
Telecommunications
  • 40000 - 45000 INR - Monthly
  • 1 - 1 Yrs
  • Greater Noida
Process: US Voice – Banking (International) Eligibility: Graduate / Undergraduate with 6 months international voice process experience Experience: 6 months – 2+ years (in International BPO – Voice) Salary: ₹40,000 CTC (6 months+ experienc...
decor
1 Day ago
Software/Web Developer - AngularJS/Javascript
Information Technology
  • Hyderabad, Telangana, India
We are hiring for women who are on career break in Hyderabad.Company : MicronRole : Software Developer - Application Development and SupportSkills : Web Development, JavaScript & Angular, C# & SQL, Agile methodologies, API, Cloud experience Azure, A...
decor
1 Day ago
OculusIT - Network Administrator
Information Technology
  • Hyderabad, Telangana, India
Company DescriptionOculusIT is higher education's high-touch, customer-centric IT services partner of choice.They specialize in cost-effective, responsive, and flexible IT Leadership; Managed ERP, Security, and Infrastructure Services; and 24x7 Oper...
decor
1 Day ago
Software Engineer - Backend Technologies
Information Technology
  • Pune, Maharashtra, India
Job DescriptionOur engineering team is hiring a backend software engineer to contribute to the development of our Warehouse Management System (WMS) and its companion Handy Terminal device, both of which are integral to our logistics product suite.Th...
decor
1 Day ago
DevOps Engineer - Cloud Infrastructure
Information Technology
  • Hyderabad, Telangana, India
Key Responsibility Areas (KRAs) CI/CD Pipeline Management : Design, build, and maintain robust, automated CI/CD pipelines for various applications, ensuring seamless integration, testing, and deployment processes. Infrastructure as Code (IaC) : De...
decor
1 Day ago
Software Engineer - Frontend Internship in Noida, Gurgaon
Information Technology
  • Pune, Maharashtra, India
Selected Intern's Day-to-day Responsibilities Include Develop web apps and landing pages as provided by the designer Work on challenging projects involving heavy rendering Demonstrate team spirit and collaborate with peers About Company: Nicola ...
decor
1 Day ago
Snowflake Data Engineer - SQL
Information Technology
  • Pune, Maharashtra, India
About The JobExp : 8 - 14 YrsWork Mode : HybridLocation : Bangalore, Chennai, Kolkata, Pune and GurgaonPrimary Skills : Architect, Snowflake, SQL, DWH, Power BI, ETL and Informatica.We are seeking a skilled Snowflake Developer with a strong backgrou...
decor

Talk to us

Feel free to call, email, or hit us up on our social media accounts.
Social media