Hyderabad, Telangana, India
Information Technology
Full-Time
SkyBridge HR Solutions
Overview
Job Description
Primarily looking for a Data Engineer (AWS) with expertise in processing data pipelines using Data bricks, PySpark SQL on Cloud distributions like AWS
Must have : AWS Data bricks
Good-to-have : PySpark, Snowflake, Talend
Requirements
Primarily looking for a Data Engineer (AWS) with expertise in processing data pipelines using Data bricks, PySpark SQL on Cloud distributions like AWS
Must have : AWS Data bricks
Good-to-have : PySpark, Snowflake, Talend
Requirements
- Candidate must be experienced working in projects involving
- Primarily looking for a data engineer with expertise in processing data pipelines using Databricks Spark SQL on Hadoop distributions like AWS EMR Data bricks Cloudera etc.
- Should be very proficient in doing large scale data operations using Databricks and overall very comfortable using Python
- Familiarity with AWS compute storage and IAM concepts
- Experience in working with S3 Data Lake as the storage tier
- Any ETL background Talend AWS Glue etc. is a plus but not required
- Cloud Warehouse experience Snowflake etc. is a huge plus
- Carefully evaluates alternative risks and solutions before taking action.
- Optimizes the use of all available resources
- Develops solutions to meet business needs that reflect a clear understanding of the objectives practices and procedures of the corporation department and business unit
- Hands on experience on Databricks Spark SQL AWS Cloud platform especially S3 EMR
- Experience on Shell scripting
- Exceptionally strong analytical and problem-solving skills
- Relevant experience with ETL methods and with retrieving data from dimensional data models and data warehouses
- Strong experience with relational databases and data access methods especially SQL
- Excellent collaboration and cross functional leadership skills
- Excellent communication skills both written and verbal
- Ability to manage multiple initiatives and priorities in a fast-paced collaborative environment
- Ability to leverage data assets to respond to complex questions that require timely answers
Similar Jobs
View All
6 Hours ago
Lead Python Developer
Information Technology
- 8 - 12 Yrs
- Anywhere in India/Multiple Locations
My Client is revolutionizing the hospitality industry by transforming how businesses manage their finances through cutting-edge Accounts Payable automation. Our mission? To eliminate manual work from business expenses and empower operators with real-...
23 Hours ago
US Voice Process (Banking Domain)
Telecommunications
- 40000 - 45000 INR - Monthly
- 1 - 1 Yrs
- Greater Noida
Process: US Voice – Banking (International)
Eligibility: Graduate / Undergraduate with 6 months international voice process experience
Experience: 6 months – 2+ years (in International BPO – Voice)
Salary:
₹40,000 CTC (6 months+ experienc...
1 Day ago
Software/Web Developer - AngularJS/Javascript
Information Technology
- Hyderabad, Telangana, India
We are hiring for women who are on career break in Hyderabad.Company : MicronRole : Software Developer - Application Development and SupportSkills : Web Development, JavaScript & Angular, C# & SQL, Agile methodologies, API, Cloud experience Azure, A...
1 Day ago
OculusIT - Network Administrator
Information Technology
- Hyderabad, Telangana, India
Company DescriptionOculusIT is higher education's high-touch, customer-centric IT services partner of choice.They specialize in cost-effective, responsive, and flexible IT Leadership; Managed ERP, Security, and Infrastructure Services; and 24x7 Oper...
1 Day ago
Software Engineer - Backend Technologies
Information Technology
- Pune, Maharashtra, India
Job DescriptionOur engineering team is hiring a backend software engineer to contribute to the development of our Warehouse Management System (WMS) and its companion Handy Terminal device, both of which are integral to our logistics product suite.Th...
1 Day ago
DevOps Engineer - Cloud Infrastructure
Information Technology
- Hyderabad, Telangana, India
Key Responsibility Areas (KRAs) CI/CD Pipeline Management : Design, build, and maintain robust, automated CI/CD pipelines for various applications, ensuring seamless integration, testing, and deployment processes. Infrastructure as Code (IaC) : De...
1 Day ago
Software Engineer - Frontend Internship in Noida, Gurgaon
Information Technology
- Pune, Maharashtra, India
Selected Intern's Day-to-day Responsibilities Include Develop web apps and landing pages as provided by the designer Work on challenging projects involving heavy rendering Demonstrate team spirit and collaborate with peers About Company: Nicola ...
1 Day ago
Snowflake Data Engineer - SQL
Information Technology
- Pune, Maharashtra, India
About The JobExp : 8 - 14 YrsWork Mode : HybridLocation : Bangalore, Chennai, Kolkata, Pune and GurgaonPrimary Skills : Architect, Snowflake, SQL, DWH, Power BI, ETL and Informatica.We are seeking a skilled Snowflake Developer with a strong backgrou...
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in