Data Engineer

Overview

BNI grows businesses. Founded in 1985, BNI is the worldwide leader in business networking. With over 11,500+ chapters meeting every week in more than 70 countries, we have grown to over 340,000 member-businesses. Our members meet each week to share qualified business referrals with their chapters and to grow personally and professionally with like-minded colleagues. Now is an especially exciting time to join us as we embark on an ambitious growth plan for BNI’s next 30 years. Strong performers have tremendous earning potential and unlimited professional development opportunities. This is an exceptional opportunity for the right individual. See www.bni.com to learn more. BNI is an EOE.

Job Description: Data Engineer

The Data Engineer will be a part of BNI’s Global Information Technology Team and will primarily have responsibilities over the creation, development, maintenance, and enhancements for our databases, queries, routines and processes along with data engineering aspects including data pipeline development. The Data Engineer will work closely with the Database Administrator, data team, software developers, QA engineers and DevOps Engineers located within the BNI office in Bangalore, as well as all levels of BNI Management and Leadership teams. This is an unparalleled opportunity to become part of a growing team and a growing global organization. High performers will have significant growth opportunities available to them.

The candidate should be an expert in both database and query design along with data engineering aspects. He/ She should be able to write queries on the fly, should possess good hands-on experience in data engineering and should be well versed with tools mentioned in the requirements below. The person should be able to own the assignments and should be independent in terms of development of queries and other aspects in data engineering.

Job Responsibilities

• Design stable, reliable and effective databases and data warehouse systems
• Create, optimize and maintain queries, used in our software applications, as well as data extracts and ETL processes
• Design and implement Data marts and KPI’s as per requirements
• Effective communicator with the ability to translate stakeholders’ business requirements into technical requirements
• Modify and maintain databases, routines, queries in order to ensure accuracy, maintainability, scalability, and high performance of all our data systems
• Solve database usage issues and malfunctions
• Liaise with developers to improve applications and establish best practices
• Provide data management support for our users/clients
• Research, analyze and recommend upgrades to our data systems
• Prepare documentation and specifications for all deployed queries/routines/processes
• Profile, optimize and tweak queries and routines for optimal performance
• Support the Development and Quality Assurance teams with their needs for database development and access
• Administration of various tools and technologies used as part of data engineering
• Be a team player and strong problem-solver to work with a diverse team
  
  

• Accountability & Integrity
• Communication
• Analytical Thinking
• Initiative
• Interpersonal Skills
• Problem Solving
• Self-management
• Teamwork
• Technical Proficiency
  
  

• Bachelor’s Degree or equivalent work experience
• Fluent in English, with excellent oral and written communication skills
• 6+ years of experience with Linux-based MySQL/MariaDB database development and maintenance
• 3+ years of experience with Database Design/Development/Scripting
• 3+ years of experience with data engineering design and administration
• Strong SQL Experience and ability to write queries on demand. Proficient in writing and optimizing SQL Statements
• Strong proficiency in MySQL/MariaDB scripting, including functions, routines and complex data queries.
• Understanding of MySQL/MariaDB’s underlying storage engines, such as InnoDB and MyISAM
• Knowledge of standards and best practices in MySQL/MariaDB
• Knowledge of MySQL/MariaDB features, such as its event scheduler
• (Desired) Familiarity with other SQL/NoSQL databases such as PostgreSQL, MongoDB, Redis
• Experience in Python/PySpark is a must
• Experience with tools like Airflow/DBT
• Should be able design data pipelines E2E, with the ability to integrate with existing systems as necessary
• Experience with Apache Superset
• Should be proficient in monitoring systems and act as necessary to bring the system stability back to normalcy
• Knowledgeable with AWS services from Data Engineering point of view
• Glue
• RedShift
• RDS
• (Desired) Proficient Understanding of git/GitHub as a source control system
• Familiarity with working on an Agile/Iterative development framework
• Self-starter with positive attitude with the ability to collaborate with product managers and developers
  
  

Physical Demands and Working Conditions

Sedentary work. Exerting up to 10 pounds of force occasionally and/or negligible amount of force frequently or constantly to lift, carry, push, pull or otherwise move objects. Repetitive motion. Substantial movements (motions) of the wrists, hands, and/or fingers. The worker is required to have close visual acuity to perform an activity such as preparing and analyzing data and figures; transcribing; viewing a computer terminal; extensive reading.

This is a full-time position. This job description is not designed to cover or contain a comprehensive listing of activities, duties or responsibilities that are required of the employee for this job. Duties, responsibilities, and activities may change at any time with or without notice.

An equal opportunity employer.