Data Engineer - SDE 3 (Python, PySpark, SQL)

Overview

You will be responsible for building a highly-scalable and extensible robust application. This position reports to the Engineering Manager.

Responsibilities:

• Align Sigmoid with key Client initiativesInterface daily with customers across leading Fortune 500 companies to understand strategic requirements
  Ability to understand business requirements and tie them to technology solutions
  Open to work from client location as per the demand of the project / customer.
• Facilitate in Technical AspectsDevelop and evolve highly scalable and fault-tolerant distributed components using Java technologies.
  Excellent experience in Application development and support, integration development and quality assurance.
• Provide technical leadership and manage it day to day basisInterface daily with customers across leading Fortune 500 companies to understand strategic requirements
• Stay up-to-date on the latest technology to ensure the greatest ROI for customer & SigmoidHands on coder with good understanding on enterprise level code.
  Design and implement APIs, abstractions and integration patterns to solve challenging distributed computing problems
  Experience in defining technical requirements, data extraction, data transformation, automating jobs, productionizing jobs, and exploring new big data technologies within a Parallel Processing environment
• CultureMust be a strategic thinker with the ability to think unconventional / out:of:box.
  Analytical and solution driven orientation.
  Raw intellect, talent and energy are critical.
  Entrepreneurial and Agile : understands the demands of a private, high growth company.
  Ability to be both a leader and hands on "doer".

Qualifications: -

• 7-9 years track record of relevant work experience and a computer Science or a related technical discipline is required
• Experience in development of Enterprise scale applications and capable in developing framework, design patterns etc. Should be able to understand and tackle technical challenges, and propose comprehensive solutions.
• Experience with functional and object-oriented programming, Java (Preferred) or Python is a must.
• Hand-On knowledge in Map Reduce, Hadoop, PySpark, Hbase and ElasticSearch.
• Development and support experience in Big Data domain
• Experience with database modelling and development, data mining and warehousing.
• Unit, Integration and User Acceptance Testing.
• Effective communication skills (both written and verbal)
• Ability to collaborate with a diverse set of engineers, data scientists and product managers
• Comfort in a fast-paced start-up environment.

Preferred Qualification:

• Experience in Agile methodology.
• Proficient with SQL and its variation among popular databases.
• Experience working with large, complex data sets from a variety of sources.

Python,PySpark,Big data Technologies