1500000 - 1800000 Indian Rupee - Yearly
Chennai, Tamil Nadu, India
Information Technology
Full-Time
Prismberry Technologies
Overview
About The Role
We are looking for a proactive and independent Data Engineer to join our team and take ownership of automating data loading processes into our databases. This role is critical in establishing and enforcing strict data standards, with the new hire playing a key role in defining and building out these processes. The ideal candidate will be hands-on, able to work independently, and trusted to write clean, maintainable code.
Key Responsibilities
We are looking for a proactive and independent Data Engineer to join our team and take ownership of automating data loading processes into our databases. This role is critical in establishing and enforcing strict data standards, with the new hire playing a key role in defining and building out these processes. The ideal candidate will be hands-on, able to work independently, and trusted to write clean, maintainable code.
Key Responsibilities
- Automate data loading processes into our databases using task automation tools (e.g., Prefect, Airflow).
- Define, implement, and enforce data standards and validation processes.
- Scrape data from various sources, investigate data issues, and ensure clean, properly formatted data is ingested.
- Write reliable, well-tested Python code, including using frameworks like Pandas and pytest.
- Collaborate with the team to improve data pipelines and troubleshoot issues as needed.
- Strong Python programming skills.
- Experience with task automation tools such as Prefect or Airflow.
- Hands-on experience with Pandas and testing frameworks like pytest.
- Strong SQL skills with the ability to work across complex datasets.
- Experience in data scraping and cleaning, with attention to data quality and integrity.
- Familiarity with Pydantic, FastAPI, and mocking libraries.
- Experience building and optimizing APIs or related services.
- A mid-level engineer who can work independently and take full ownership of tasks.
- Detail-oriented with a strong sense of responsibility toward data accuracy and quality.
- Comfortable writing clean, tested code and contributing to process improvements.
Similar Jobs
View All
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in