Bangalore, Karnataka, India
Information Technology
Full-Time
Quantiphi
Overview
While technology is the heart of our business, a global and diverse culture is the heart of our success. We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth.
If working in an environment that encourages you to innovate and excel, not just in professional but personal life, interests you- you would enjoy your career with Quantiphi!
Role: Senior Data Engineer (Databricks)
Experience Level: 3 to 6 Years
Work location: Trivandrum
Role & Responsibilities
If working in an environment that encourages you to innovate and excel, not just in professional but personal life, interests you- you would enjoy your career with Quantiphi!
Role: Senior Data Engineer (Databricks)
Experience Level: 3 to 6 Years
Work location: Trivandrum
Role & Responsibilities
- Design and implement data solutions (ETL pipelines, Processing and Transformation logic) using Snowflake as a key platform.
- Design Virtual warehouses which are optimized for performance and cost (auto scaling, idle time etc)
- Write SQL , stored procedures to implement business logic, other critical requirements like encryption, data masking etc
- Implement solutions with features like Snowpipe, tasks, streams,dynamic tables etc
- Design the solutions by leveraging key concepts around the architecture of Snowflake, its data distribution and partitioning mechanism, data caching etc.
- Identify queries which take more time , look at the logs etc and provide solutions to optimize those queries
- 3+ years’ experience of Hands-on in data structures, distributed systems, Spark, SQL, PySpark, NoSQL Databases
- Strong software development skills in at least one of: Python, Pyspark or Scala.
- Develop and maintain scalable & modular data pipelines using databricks & Apache Spark
- Experience building and supporting large-scale systems in a production environment
- Experience working on either of the cloud storages - AWS S3, Azure data lake, GCS buckets
- Exposure to the ELT tools offered by the cloud platforms like, ADF, AWS Glue, Google dataflow
- Integrate Databricks with other cloud services like AWS, Azure or Google Cloud
- Implement and optimize Spark jobs, data transformations, and data processing workflows in Databricks
- Managing and configuring databricks environments, including clusters and notebooks
- Experience working with different file formats - parquet, databricks delta lake
- Experience working with data governance on databricks, implementing unity catalog, delta share
Similar Jobs
View All
1 Day ago
Chief Technology Officer
Finance & Banking
- 10 - 18 Yrs
- Bangalore
About the Role:
We are seeking a dynamic Chief Technology Officer (CTO) to lead our technology function, blending strategic vision with deep technical expertise. The ideal candidate will have hands-on mastery in modern full-stack development, clou...
1 Day ago
Senior Software Engineer-Payments
Information Technology
- Ahmedabad, Gujarat, India
Job DescriptionAbout RipplingRippling gives businesses one place to run HR, IT, and Finance. It brings together all of the workforce systems that are normally scattered across a company, like payroll, expenses, benefits, and computers. For the first...
1 Day ago
Data Engineer - RTCDP
Information Technology
- Ahmedabad, Gujarat, India
Are you a seasoned Data Engineer with deep Adobe Experience Platform expertise? We're partnering with a leading Canadian bank to deliver large-scale personalization initiativesand were looking for you to join the mission.In this high-impact role, yo...
1 Day ago
Business Analyst - UiPath
Information Technology
- Ahmedabad, Gujarat, India
Job role: Business 4-5 KolkataAre you a BA ready to revolutionize banking operations with intelligent automation? Join a high-impact team driving digital transformation through innovative UiPath solutions.What You'll DoAs a Business Analyst you'll b...
1 Day ago
Software Developer 3 - OCI
Information Technology
- Ahmedabad, Gujarat, India
Job DescriptionSenior Software Development Engineer - OCI AI Platform, Services & Solutions OrgOCI is Oracle’s next-generation cloud platform, built for the most demanding enterprise workloads. We are focused on delivering high-performance computing...
1 Day ago
Voxvalley - Java Backend Developer - Spring Boot/Microservices Architecture
Information Technology
- Ahmedabad, Gujarat, India
Job SummaryWe are seeking a highly skilled Java Backend Developer with 5 to 8 years of experience to join our dynamic team. The ideal candidate will have strong expertise in Java, Spring Boot, Microservices, and Cloud technologies to design, develop...
1 Day ago
Junior Full Stack Developer in Pune
Information Technology
- Ahmedabad, Gujarat, India
Key Responsibilities Assist in designing, developing, and deploying responsive web and mobile applications. Contribute to both front-end (React, React Native, HTML, CSS, JavaScript) and back-end (Node.js, Express.js, Python, Java, PHP) development...
1 Day ago
Excelacom - Lead Java Microservices Developer
Information Technology
- Ahmedabad, Gujarat, India
Location SirusseriNotice Period Preferred - Immediate Joiners To 15 DaysHaving proficiency in these below skills and to contribute effectively to enterprise-level applications, web services, microservices, and distributed systemsOverall Skillset Mi...
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in