Free cookie consent management tool by TermsFeed Data Engineer - Python/PySpark | Antal Tech Jobs
Back to Jobs
1 Day ago

Data Engineer - Python/PySpark

decor
Gurugram, Haryana, India
Information Technology
Full-Time
Sphere IT

Overview

Responsibilities

  • Ability to write clean, maintainable, and robust code in Python
  • Understanding and expertise of software engineering concepts and best practices
  • Knowledge of testing frameworks and libraries
  • Experience with analytics (descriptive, predictive, EDA), feature engineer, algorithms, anomaly detection, data quality assessment and python visualization libraries - e.g. matplotlib, seaborn or other
  • Comfortable with notebook and source code development - Jupyter, Pycharm/VScode
  • Hands-on experience of technologies like Python, Spark/Pyspark, Hadoop/MapReduce/HIVE, Pandas etc.
  • Familiarity with query languages and database technologies, CI/CD, testing and validation of data and software
  • Tech stack and activities that you would use and preform on a daily basis :
  • Python
  • Spark (PySpark)
  • Jupyter
  • SQL and No-SQL DBMS
  • Git (as source code versioning and CI/CD)
  • Exploratory Data Analysis (EDA)
  • Imputation Techniques
  • Data Linking / Cleansing
  • Feature Engineering
  • Apache Airflow/ Jenkins scheduling and automation, Github and Github Actions
  • Collaborative - able to build strong relations that enable robust debate, and resolve periodic disagreements regarding priorities.
  • Excellent interpersonal, and communication skills
  • Ability to communicate effectively with technical and non-technical audience
  • Ability to work under pressure with a solid sense for setting priorities
  • Ability to lead technical work with strong sense of ownership
  • Strong command of English language (both verbal and written)
  • Practical and action oriented
  • Compelling communicator
  • Excellent stakeholder management
  • Foster and promote entrepreneurial spirit and curiosity amongst team members
  • Team player
  • Quick learner

(ref:hirist.tech)
Share job
Similar Jobs
View All
12 Hours ago
MERN Stack Developer - Remote
Information Technology
  • 2 - 4 Yrs
  • Anywhere in India/Multiple Locations
Job responsibility: Hire and mentor a team of high-calibre front-end and Backend engineers Design and develop new user-facing full-stack applications. Building reusable components and front-end, backend libraries for future use Optimizing...
decor
1 Day ago
ScaleUp Technologies - Software Engineer - Golang
Information Technology
  • Bangalore, Karnataka, India
Skills Experience in modern RESTful API development In-depth expertise in microservices, Docker and Kubernetes Strong knowledge in software architecture, data structures / design patterns Strong knowledge of Go programming language, paradigms, c...
decor
1 Day ago
Republic World - Junior DevOps Engineer - Google Cloud Platform
Information Technology
  • Bangalore, Karnataka, India
DevOps Engineer (2 - 5 Years Exp.) | NoidaLocation : Sector 158, Noida | On-site Description : Are you a seasoned DevOps Engineer with 2-5 years of experience, ready to take ownership of large-scale infrastructure and cloud deployments?We're looking...
decor
1 Day ago
ScaleUp Technologies - .Net Developer - C#/Javascript
Information Technology
  • Gurugram, Haryana, India
Job DescriptionWe are looking for a highly skilled and versatile .NET Developer to join our engineering team. The ideal candidate will have a strong foundation in .NET Core and C#, experience with modern frontend frameworks, and a passion for buildi...
decor
1 Day ago
Interesting Job Opportunity: Azure Architect
Information Technology
  • Bangalore, Karnataka, India
Job DescriptionThe Azure Architect will offer technical leadership in Microsoft Cloud, Azure, and Azure DevOps. include overseeing new implementations, cloud migrations, DevOps practices, governance, and platform strategy, as well as delivering cust...
decor
1 Day ago
FINVASIA - Linux System Administrator - Virtualization
Information Technology
  • Bangalore, Karnataka, India
Job SummaryWe are looking for a knowledgeable and proactive Linux System and Networking Administrator with strong experience in virtualization (especially Proxmox and VMware vCenter) and a deep understanding of enterprise networking.You will be resp...
decor
1 Day ago
Republic World - Junior DevOps Engineer - Cloud Environment
Information Technology
  • Bangalore, Karnataka, India
We're Hiring | Junior DevOps Engineer (2-5 Years Exp)Location : Noida | Immediate Joiners PreferredWe are looking for a Junior DevOps Engineer with 2-5 years of experience to join our team and support our deployment processes and infrastructure.This...
decor
1 Day ago
Technical Lead - PHP
Information Technology
  • Bangalore, Karnataka, India
Tech Lead PHP (Laravel / Phalcon + Full Stack)Location : Ahmedabad.Experience : 68 Years.Job DescriptionWere looking for a Tech Lead who will actively do R&D, code hands-on, mentor developers, and drive the technical direction of our product platfor...
decor

Talk to us

Feel free to call, email, or hit us up on our social media accounts.
Social media