Bangalore, Karnataka, India
Information Technology
Full-Time
Wits Innovation Lab
Overview
Job Description
We are looking for energetic, self-motivated and exceptional Data engineer to work on extraordinary enterprise products based on AI and Big Data engineering leveraging AWS/Databricks tech stack. He/she will work with star team of Architects, Data Scientists/AI Specialists, Data Engineers and Integration.
Skills And Qualifications
We are looking for energetic, self-motivated and exceptional Data engineer to work on extraordinary enterprise products based on AI and Big Data engineering leveraging AWS/Databricks tech stack. He/she will work with star team of Architects, Data Scientists/AI Specialists, Data Engineers and Integration.
Skills And Qualifications
- 5+ years of experience in DWH/ETL Domain; Databricks/AWS tech stack
- 2+ years of experience in building data pipelines with Databricks/ PySpark /SQL
- Experience in writing and interpreting SQL queries, designing data models and data standards.
- Experience in SQL Server databases, Oracle and/or cloud databases.
- Experience in data warehousing and data mart, Star and Snowflake model.
- Experience in loading data into database from databases and files.
- Experience in analyzing and drawing design conclusions from data profiling results.
- Understanding business process and relationship of systems and applications.
- Must be comfortable conversing with the end-users.
- Must have ability to manage multiple projects/clients simultaneously.
- Excellent analytical, verbal and communication skills.
- Work with business stakeholders and build data solutions to address analytical & reporting requirements.
- Work with application developers and business analysts to implement and optimise Databricks/AWS-based implementations meeting data requirements.
- Design, develop, and optimize data pipelines using Databricks (Delta Lake, Spark SQL, PySpark), AWS Glue, and Apache Airflow
- Implement and manage ETL workflows using Databricks notebooks, PySpark and AWS Glue for efficient data transformation
- Develop/ optimize SQL scripts, queries, views, and stored procedures to enhance data models and improve query performance on managed databases.
- Conduct root cause analysis and resolve production problems and data issues.
- Create and maintain up to date documentation of the data model, data flow and field level mappings.
- Provide support for production problems and daily batch processing.
- Provide ongoing maintenance and optimization of database schemas, data lake structures (Delta Tables, Parquet), and views to ensure data integrity and performance
Similar Jobs
View All
1 Day ago
Devops Cloud Engineer
Information Technology
- 3000000 - 3500000 INR - Monthly
- 7 - 14 Yrs
- Mumbai
Minimum Experience/Training Required:
• At least 7 years of relevant experience, with a strong track record in deploying solutions/applications on AWS cloud environment
• Proven ability to work across structured, semi-structured, and unstructured d...
1 Day ago
eGrove Systems - Senior Python Developer - Django/Flask
Information Technology
- Bangalore, Karnataka, India
eGrove Systems Pvt Ltd is looking for Senior Python Developer to join its team of experts.Skill : Senior Python Developer.Exp : 4+Yrs.NP : Immediate to 15days.Location : Chennai/Madurai.Skills Requirement Hands-on software development skills, deep ...
1 Day ago
Java Developer - Associate
Space Exploration & Research, Information Technology
- Hyderabad, Telangana, India
At PwC, our people in software and product innovation focus on developing cutting-edge software solutions and driving product innovation to meet the evolving needs of clients. These individuals combine technical experience with creative thinking to ...
1 Day ago
Lead Software Engineer – Full Stack Java
Space Exploration & Research, Information Technology
- Hyderabad, Telangana, India
Full Time Pune Posted 14 seconds ago Website Trading TechnologiesMulti-asset platform for capital marketsWe are currently seeking driven and talented Senior Software Engineers who thrive on pushing the limits of technology to produce state-of-the-...
1 Day ago
Senior Data Engineer
Space Exploration & Research, Information Technology
- Hyderabad, Telangana, India
Job Title: Senior Data EngineerLocation: CoimbatoreExperience: 5+ YearsJob Type: Full-TimeKey Responsibilities Design, develop, and maintain robust data pipelines using Airflow and AWS services. Implement and manage data warehousing using Databrick...
1 Day ago
Senior Data Analyst
Information Technology
- Bangalore, Karnataka, India
Company : Fives India Engineering & Projects Pvt. Ltd.Job Title : Data Analyst/Senior Data Analyst (BI developer)Job Location : Chennai, Tamil Nadu, IndiaJob Department : ITEducational Qualification : BE/B.Tech/MCA from a reputed Institute in Comput...
1 Day ago
ServiceNow System Architect
Space Exploration & Research, Information Technology
- Hyderabad, Telangana, India
The OpportunityJoin SoftwareOne as a ServiceNow Platform Architect and play a pivotal role in shaping our ServiceNow practice. Drive innovation in service and project delivery, ensuring our solutions meet our clients' needs. Collaborate with cross-f...
1 Day ago
Technical Lead, Firmware Development
Space Exploration & Research, Information Technology
- Hyderabad, Telangana, India
Landis+Gyr is a leading global provider of integrated energy management solutions. We measure and analyze energy utilization to generate empowering analytics for smart grid and infrastructure management, enabling utilities and consumers to reduce en...
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in