Free cookie consent management tool by TermsFeed Data Engineer 2 | Antal Tech Jobs
Back to Jobs
2 Days ago

Data Engineer 2

decor
Chennai, Tamil Nadu, India
Space Exploration & Research, Information Technology
Full-Time
Intuit

Overview

Overview

Come join the GBSG Data Engineering team at IDC as a "Software Engineer - 2". We are leveraging Big Data Technologies to gain new Insights into our QuickBooks/IES customer experiences. Some of the technologies leveraged by our team include: Hadoop, Spark, and AWS Data Services. We foster an open and collaborative team environment where direct interactions are highly valued, and working code is prioritised over isolated efforts or 'working in a cave.' Transparency, teamwork, and real progress are at the heart of everything we do."

What you'll bring

  • BS/MS in computer science or equivalent work experience.
  • Experience in developing data pipelines using Cloud service providers such as AWS, Azure, GCP etc
  • 2+ years of experience in developing data pipelines using Spark and Hive
  • Experience in developing complex data models/dimension models on datalake
  • Ideal candidate to have 3+ years of experience in end-to-end data warehouse implementations and at least 2 projects with 4TB+ data volume.
  • Good knowledge of Operating Systems (Unix or Linux).
  • Hands on experience in any of the programming languages (Shell scripting, Python, Java, etc).
  • Must have been through several full life cycle Data Warehousing implementations and involved in scalability and performance related design aspects in datalake and ETL.
  • Solid communication skills: Demonstrated ability to explain complex technical issues related to technical and non-technical audiences.
  • Demonstrated understanding of the Software design and architecture process.
  • Experience with unit testing and data quality automation checks
  • Should be results oriented, self-motivated, accountable and work under minimal supervision.
  • Excellent written, oral communication and presentation Skills.

How you will lead

  • Strong understanding of data engineering and dimensional design fundamentals, good at SQL, integration (ETL), front-end analysis / data visualization, learns new technologies quickly.
  • Good understanding of data warehouse schema design and granularity of the data.
  • Good understanding of data federation techniques and aggregation of data at scale from multiple source systems.
  • Designing and developing ETL pipelines across multiple platforms and tools including Spark, Hadoop and AWS Data Services.
  • Gathering functional requirements, developing technical specifications, and project & test planning.
  • Work with business users to develop and refine analytical requirements for quantitative data (view-through, clickstream, acquisition, product usage, transactions), qualitative data (survey, market research) and unstructured data (blog, social network).
  • Designing and developing schema definitions and support data warehouse/mart to enable integration of disparate data sources from within Intuit and outside, aggregate it and make it available for analysis.
  • Support large data volumes and accommodate flexible provisioning of new sources.
  • As a key member of the team drive adoption of new technologies, tools, and process improvements to build world class analytical capabilities for web analytics, optimization, experimentation and personalization.
  • Resolve defects/bugs during QA testing, pre-production, production, and post-release patches.
  • Work cross-functionally with various Intuit teams: Product Management, Project Management, Data Architects, Data Scientists, Data Analysts, Software Engineers, and other Data Engineers.
  • Contribute to the design and architecture of project across the data landscape.
  • Experience with Agile Development, SCRUM, or Extreme Programming methodologies.
  • Helps to align to overall strategies and reconcile competing priorities across organization.
Share job
Similar Jobs
View All
1 Day ago
Lead Python Developer
Information Technology
  • 8 - 12 Yrs
  • Anywhere in India/Multiple Locations
My Client is revolutionizing the hospitality industry by transforming how businesses manage their finances through cutting-edge Accounts Payable automation. Our mission? To eliminate manual work from business expenses and empower operators with real-...
decor
1 Day ago
Business Analyst I, DeviceOS
Information Technology
  • Chennai, Tamil Nadu, India
This job is with Amazon, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. DescriptionAmazon is looking for a data-savvy professional to crea...
decor
1 Day ago
IT Support Mgr II
Information Technology
  • Chennai, Tamil Nadu, India
This job is with Amazon, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. DescriptionAre you passionate about helping people solve IT proble...
decor
1 Day ago
EverestDX - Senior Python Developer
Information Technology
  • Chennai, Tamil Nadu, India
Job Title : Sr. Python DeveloperJob Location : Hyderabad Type : Full : 8+ Period : Immediate to 15 days joiners are highly : Design, develop, and maintain scalable Python applications and AI-powered solutions. Collaborate with cross-functional tea...
decor
1 Day ago
.NET Application Developer
Information Technology
  • Chennai, Tamil Nadu, India
🌟 We're Hiring: .NET Application Developer! 🌟We are looking for a skilled .NET Application Developer with at least 5 years of experience to join our dynamic team. The ideal candidate will have a strong background in developing robust applications us...
decor
1 Day ago
Full Stack Developer - Node.js/React.js
Information Technology
  • Chennai, Tamil Nadu, India
Designation : Full Stack Developer( React.js+ Node.js)Job Location : PrabhadeviJob Day & Timing : Mon - Fri , 9 AM -6 PMJob Description Perform hands-on computer program improvement, counting composing code and unit tests, doing verification of co...
decor
1 Day ago
Sr. Test Engineer - QA Job
Information Technology
  • Chennai, Tamil Nadu, India
We use cookies to offer you the best possible website experience. Your cookie preferences will be stored in your browser’s local storage. This includes cookies necessary for the website's operation. Additionally, you can freely decide and change any...
decor
1 Day ago
QA Engineer
Information Technology
  • Chennai, Tamil Nadu, India
Flowserve is a world-leading manufacturer and aftermarket service provider of comprehensive flow control systems. Join a company whose people are committed to building a more sustainable future to make the world better for everyone. With 16,000+ emp...
decor

Talk to us

Feel free to call, email, or hit us up on our social media accounts.
Social media