Free cookie consent management tool by TermsFeed Senior Data Engineer | Antal Tech Jobs
Back to Jobs
5 Days ago

Senior Data Engineer

decor
Information Technology
Full-Time
Schneider Electric

Overview

Does working with data on a day-to-day basis excite you? Are you interested in building robust data architecture to identify data patterns and optimize data consumption for our customers, who will forecast and predict what actions to undertake based on data? If this is what excites you, then you’ll love working in our Data Analytics team.

 

We are looking for a savvy Data Engineer to join our growing team of AI , BI and machine learning experts. You will be responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up.

 

The Data Engineer will support our software engineers, data analysts, dashboard developers and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. They must be self-directed and comfortable supporting the data needs of multiple teams, systems and products.

Responsibilities

  • Create and maintain optimal data pipeline architecture; assemble large, complex data sets that meet functional / non-functional requirements.
  • Design the right schema to support the functional requirement and consumption pattern.
  • Design and build production data pipelines from ingestion to consumption.
  • Build the necessary datamarts, data warehouse required for optimal extraction, transformation, and loading of data from a wide variety of data sources.
  • Create necessary preprocessing and postprocessing for various forms of data for training/ retraining and inference ingestions as required
  • Create data visualization and business intelligence tools for stakeholders and data scientists for necessary business/ solution insights
  • Identify, design, and implement internal process improvements: automating manual data processes, optimizing data delivery, etc.
  • Ensure our data is separated and secure across national boundaries through multiple data centers and AWS regions.

Requirements and Skills

  • You should have a bachelor’s or master’s degree in computer science, Information Technology or other quantitative fields
  • You should have at least 5 years working as a data engineer in supporting large data transformation initiatives related to machine learning, with experience in building and optimizing pipelines and data sets
  • Strong analytic skills related to working with unstructured datasets.

 

Must-have Programming Skills:

  • Significant programming experience python programming, spark is must.
  • Good Hands -on experience in SQL, writing analytical queries and windows functions.
  • Good Hands - on experience in creating external tables, partitioning, parquet files.
  • 3-5 years of solid experience in Big Data technologies a must.
  • Data Engineering experience using AWS core services (Lambda, Glue, EMR and RedShift)
  • Knowledge of Python and Pyspark is an absolute must.

 

Requirements/Skill sets:

  • Knowledge of Database Concepts - Indexing, Partitioning is must.
  • Knowledge of Data warehousing - Normalization, Denormalization, Star/Snow-flake schemas.
  • Good Hands -on the table’s creations, DDL, DML and TCL
  • Hands on experience in Informatica PowerCenter/IICS as an ETL tool
  • Experience with AWS cloud services: EC2, EMR, RDS, Redshift, S3, Athena and familiarity with various log formats from AWS.
  • Experience with object-oriented/object function scripting languages: Python, Pyspark
  • Experience in, Dbeaver tool, AWS Glue ETL, AWS Crawler, AWS Lambda, Glue Data Catalog, AWS Glue Studio.

 

Good to Have Skill sets:

 

  • Experience with big data tools: Hadoop, Spark, Kafka, etc.
  • Experience with data pipeline and workflow management tools: Airflow, Luigi etc.
  • Experience with stream-processing systems: Storm, Spark-Streaming, etc.
  • You should be a good team player and committed for the success of team and overall project. 

Requirements/Skill sets:

  • Knowledge of Database Concepts - Indexing, Partitioning is must.
  • Knowledge of Data warehousing - Normalization, Denormalization, Star/Snow-flake schemas.
  • Good Hands -on the table’s creations, DDL, DML and TCL
  • Hands on experience in Informatica PowerCenter/IICS as an ETL tool
  • Experience with AWS cloud services: EC2, EMR, RDS, Redshift, S3, Athena and familiarity with various log formats from AWS.
  • Experience with object-oriented/object function scripting languages: Python, Pyspark
  • Experience in, Dbeaver tool, AWS Glue ETL, AWS Crawler, AWS Lambda, Glue Data Catalog, AWS Glue Studio.

 

Good to Have Skill sets:

 

  • Experience with big data tools: Hadoop, Spark, Kafka, etc.
  • Experience with data pipeline and workflow management tools: Airflow, Luigi etc.
  • Experience with stream-processing systems: Storm, Spark-Streaming, etc.
  • You should be a good team player and committed for the success of team and overall project.

Looking to make an IMPACT with your career?

When you are thinking about joining a new team, culture matters. At Schneider Electric, our values and behaviors are the foundation for creating a great culture to support business success. We believe that our  IMPACT values - Inclusion, Mastery, Purpose, Action, Curiosity, Teamwork - starts with us.

IMPACT is also your invitation to join Schneider Electric where you can contribute to turning sustainability ambition into actions, no matter what role you play. It is a call to connect your career with the ambition of achieving a more resilient, efficient, and sustainable world.

We are looking for IMPACT Makers; exceptional people who turn sustainability ambitions into actions at the intersection of automation, electrification, and digitization. We celebrate IMPACT Makers and believe everyone has the potential to be one.

Become an IMPACT Maker with Schneider Electric - apply today!

€36 billion global revenue
+13% organic growth
150 000+ employees in 100+ countries
#1 on the Global 100 World’s most sustainable corporations

You must submit an online application to be considered for any position with us. This position will be posted until filled.

Schneider Electric aspires to be the most inclusive and caring company in the world, by providing equitable opportunities to everyone, everywhere, and ensuring all employees feel uniquely valued and safe to contribute their best. We mirror the diversity of the communities in which we operate, and ‘inclusion’ is one of our core values. We believe our differences make us stronger as a company and as individuals and we are committed to championing inclusivity in everything we do.

At Schneider Electric, we uphold the highest standards of ethics and compliance, and we believe that trust is a foundational value. Our Trust Charter is our Code of Conduct and demonstrates our commitment to ethics, safety, sustainability, quality and cybersecurity, underpinning every aspect of our business and our willingness to behave and respond respectfully and in good faith to all our stakeholders. You can find out more about our Trust Charter here
 
Schneider Electric is an Equal Opportunity Employer. It is our policy to provide equal employment and advancement opportunities in the areas of recruiting, hiring, training, transferring, and promoting all qualified individuals regardless of race, religion, color, gender, disability, national origin, ancestry, age, military status, sexual orientation, marital status, or any other legally protected characteristic or conduct.

Share job
Similar Jobs
View All
1 Day ago
PHP Developer
Information Technology
  • 3 - 7 Yrs
  • Anywhere in India/Multiple Locations
We are looking for Senior PHP Developer, capable of developing high-end web applications using PHP ,MY SQL & CodeIgniter. Working knowledge in API Integrations for E-commerce portals preferred.   Required Candidate profile 3+ years Exp. with P...
decor
1 Day ago
Java Developer
Information Technology
  • 2 - 5 Yrs
  • Anywhere in India/Multiple Locations
Role - Software Engineer (Java Developer) Years of Experience - 2 to 5 Work Mode - Remote Bachelors degree in computer science, Engineering, or a related field. 2 to 5 years of experience in Java development. Proficiency in Java, with...
decor
1 Day ago
Sr Engineer II (C++ Developer)
Information Technology
  • Pune, Maharashtra, India
Seeking a highly motivated and self-driven Software Developer who will be responsible for developing slot content for Digital applications (Heart of Vegas, Cashman Casinos & Lightning Link) across various platforms (iOS, Android and Web).Quick Learn...
decor
1 Day ago
Freelance UI Developer (Client Hire)
Information Technology
  • Pune, Maharashtra, India
Flexing It is a freelance consulting marketplace that connects freelancers and independent consultants with organisations seeking independent talent. Flexing It has partnered with ur client, a leading Procurement intelligence company which deals in...
decor
1 Day ago
Network Engineer
Information Technology
  • Pune, Maharashtra, India
OverviewRapiscan Systems is an industry leader in detection technology, providing cargo and vehicle inspection systems and services for ports, borders, military, high-threat facilities, and checkpoints to help customers combat terrorism, drug smuggl...
decor
1 Day ago
Senior Software Engineer
Information Technology
  • Pune, Maharashtra, India
OverviewWorking at AtlassianAtlassians can choose where they work – whether in an office, from home, or a combination of the two. That way, Atlassians have more control over supporting their family, personal goals, and other priorities. We can hire ...
decor
1 Day ago
Cloud Platform Engineer
Information Technology
  • Pune, Maharashtra, India
Project Role : Cloud Platform EngineerProject Role Description : Designs, builds, tests, and deploys cloud application solutions that integrate cloud and non-cloud infrastructure. Can deploy infrastructure and platform environments, creates a proof ...
decor
1 Day ago
Application Developer
Information Technology
Project Role : Application DeveloperProject Role Description : Design, build and configure applications to meet business process and application requirements.Must have skills : React.jsGood to have skills : NAMinimum 7.5 Year(s) Of Experience Is Req...
decor

Talk to us

Feel free to call, email, or hit us up on our social media accounts.
Social media