Hyderabad, Telangana, India
Information Technology
Full-Time
Gainwell Technologies
Overview
Summary
We’re looking for a dynamic Data Engineer with Apache Spark and AWS experience to join the data analytics team at Gainwell Technologies. You will have the opportunity to work as part of a cross-functional team to define, design and deploy frameworks for data collection, normalization, transformation, storage and reporting on AWS to support the analytic missions of Gainwell and its clients.
Your role in our mission
We’re looking for a dynamic Data Engineer with Apache Spark and AWS experience to join the data analytics team at Gainwell Technologies. You will have the opportunity to work as part of a cross-functional team to define, design and deploy frameworks for data collection, normalization, transformation, storage and reporting on AWS to support the analytic missions of Gainwell and its clients.
Your role in our mission
- Design, develop and deploy data pipelines including ETL-processes for getting, processing and delivering data using Apache Spark Framework.
- Monitor, manage, validate and test data extraction, movement, transformation, loading, normalization, cleansing and updating processes. Build complex databases that are useful, accessible, safe and secure.
- Coordinates with users to understand data needs and delivery of data with a focus on data quality, data reuse, consistency, security, and regulatory compliance.
- Collaborate with team-members on data models and schemas in our data warehouse.
- Collaborate with team-members on documenting source-to-target mapping.
- Conceptualize and visualize data frameworks
- Communicate effectively with various internal and external stakeholders.
- Bachelor's degree in computer sciences or related field
- 5 years of experience working with big data technologies on AWS/Azure/GCP
- 4 years of experience in the Apache Spark/DataBricks framework (Python/Scala)
- Experience working with different between database structures (e.g., transaction based vs. data warehouse)
- Databricks and AWS developer/architect certifications a big plus
- Design, develop and deploy data pipelines including ETL-processes for getting, processing and delivering data using Apache Spark Framework.
- Monitor, manage, validate and test data extraction, movement, transformation, loading, normalization, cleansing and updating processes. Build complex databases that are useful, accessible, safe and secure.
- Coordinates with users to understand data needs and delivery of data with a focus on data quality, data reuse, consistency, security, and regulatory compliance.
- Collaborate with team-members on data models and schemas in our data warehouse.
- Collaborate with team-members on documenting source-to-target mapping.
- Conceptualize and visualize data frameworks
- Communicate effectively with various internal and external stakeholders.
Similar Jobs
View All
20 Hours ago
Data Analyst
Information Technology
- 300000 - 1200000 INR - Annual
- 1 - 7 Yrs
- Anywhere in India/Multiple Locations
Location: Remote – India
Experience: 1–7 years
Employment Type: Full-time & Part-time options available
About the Role
We’re seeking analytical minds who love turning data into actionable insights. As a Data Analyst, you’ll work closely w...
20 Hours ago
Sr. ServiceNow Developer | 8+ Years | Pune
Information Technology
- 30 - 40 INR - Annual
- 8 - 11 Yrs
- Pune
About the Role:
This is a senior-level ServiceNow Developer role where you’ll be responsible for driving the technical vision and execution of complex ServiceNow solutions across the organization.
What We’re Looking For:
Strong hands-...
20 Hours ago
Mobile Developer
Information Technology
- 350000 - 1000000 INR - Annual
- 1 - 6 Yrs
- Anywhere in India/Multiple Locations
About the Role
We're looking for talented Mobile Developers—whether you're a rising star with a year of experience or a seasoned engineer with eight—to build intuitive, high-performance mobile applications for Android and iOS. You’ll collaborate w...
2 Days ago
IT Support Executive
Information Technology
- Hyderabad, Telangana, India
hackajob is collaborating with British Airways to connect them with exceptional tech professionals for this role.A career without limitsAs the nation’s flag carrier, we take great pride in connecting Britain with the world and the world with Britain...
2 Days ago
Full Stack Developer (Java + AWS DevOps Focus)
Information Technology
- Hyderabad, Telangana, India
Company Description We are a Stealth GenAI B2B Startup focused on revolutionizing construction industry using Artificial General Intelligence. Our team is comprised of visionaries, researchers, and engineers dedicated to pushing the boundaries of AI...
2 Days ago
DevOps Engineer
Information Technology
- Surat, Gujarat, India
About QuantaniteQuantanite is a customer experience (CX) solutions company that helps fast-growing companies and leading global brands to transform and grow. We do this through a collaborative and consultative approach, rethinking business processes...
2 Days ago
Tech Carrot - Data Engineer - Python/ETL
Information Technology
- Hyderabad, Telangana, India
Skills Advanced working knowledge and experience with relational and non-relational databases. Experience building and optimizing Big Data pipelines, architectures, and datasets. Strong analytic skills related to working with structured and unstr...
2 Days ago
Software Engineer - Java8 & React Fullstack_C2E
Information Technology
- Surat, Gujarat, India
Reference 250008EIResponsibilitiesJob description:As a full stack developer, you’ll will work in agile. You will participate to all the agile ceremonies (sprint planning, refinement, retrospective, poker planning et sprint review)As part of the Pari...
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in