Data Engineer

Department: Technology

Location: Kolkata

Description

Energy Aspects currently has an exciting opportunity available for a Data Engineer to join our Data Engineering team based out of our Kolkata office. This is a fantastic opportunity for an experienced data engineer to support the ETL, data pipelines, core databases and strategic projects underpinning the work of our highly regarded global oil, natural gas and energy teams, optimizing our data content and capabilities.
The successful candidate will be responsible for building entirely new data products and maintaining/iterating on our existing datasets, data pipelines, and tools used daily by the Data and Research teams at Energy Aspects. You will take ownership of systems within a cloud-first data stack and be expected to contribute quickly to production-level Python codebases. You will closely support Data Analysts/other technical analysts while helping to shape and drive forward the future state of data engineering at Energy Aspects.

Key Responsibilities

• Develop and maintain data pipelines using Python.
• Build, extend, and transform core datasets within the data warehouse.
• Collaborate with various cloud services to create new services and scrapes, facilitating data collection and presentation in diverse formats.
• Design and implement innovative data solutions for internal teams and external clients.
• Support a range of strategic, company-level data initiatives.
  
  

Requirements

• Minimum of 2 years of experience in software development.
• Proficiency in web scraping and Python-based web development.
• Experience with scheduling and orchestration tools, such as Airflow.
• Strong understanding of building, extending, and querying SQL databases, both natively and via Python.
• Knowledge of best practices for organizing and modeling data for storage, retrieval, and analysis.
• Familiarity with data development best practices, including documentation, version control, testing, and automation.
• Understanding of the importance of data governance and metadata.
• Methodical, analytical, and organized approach to managing large-scale projects and datasets.
• Effective communication skills, with the ability to present to both technical and non-technical audiences.
• Experience in building reliable and maintainable data pipelines.

Candidates with Working knowledge or familiarity with the following technologies, libraries, and services shall be preferred:

• Python: Anaconda, pandas, SQLAlchemy, web scraping libraries
• SQL: PostgreSQL
• Cloud: GCP/AWS
• DevOps: CI/CD, GitHub Actions, Cloud Build, etc.
• Orchestration: Airflow
• Data Visualisation: Plotly, Dash, Flask, FastAPI etc.

Desirable Skills:

• Experience with cloud infrastructure and familiarity with Infrastructure as Code.
• Proficiency with Docker and containerisation.
• Experience working with high-frequency time series data and/or streaming data.
• Experience in building and managing other database/datastore technologies (e.g., NoSQL variants, file stores).
• Experience with Python web frameworks, Jinja templating, and/or JavaScript.
• Prior experience or training in forecasting or modelling.
• An interest in commodities, energy, or financial markets is beneficial.
  
  

Our Culture & Benefits

Welcome to our unique workplace where a passion for our industry-leading product sits at the heart of who we are.

Life at EA is completely eclectic, fostered through the global nature of the business and a real appreciation of the many cultures of our diverse team. We unite as a single, cohesive team through an array of social clubs that cater to a spectrum of interests, from running and yoga to football and culinary adventures. These groups create a collegial and dynamic atmosphere that extends beyond work, promoting a healthy and balanced lifestyle for our team.

Our strategically located offices are all set in prestigious buildings, offering you the convenience of nearby gyms, retail therapy, diverse dining options, and accessible public transport.

Located at South City Business Park, Anandpur with convenient access around Kolkata, our office is thoughtfully equipped to enhance your day-to-day experience whether working independently or collaborating with teammates. Enjoy the simple pleasures of a freshly brewed coffee, healthy snacks, and a social space for celebratory moments.

We recognise your contribution with a competitive compensation package that includes annual bonuses, comprehensive private health insurance, and substantial pension contributions. Additionally, we offer company share options, subsidised gym memberships, lunch allowance and a generous holiday policy to support your financial and personal well-being.

Join a company that values your professional growth and personal fulfilment, all within a supportive and engaging environment.