Hyderabad, Telangana, India
Information Technology
Full-Time
Acuity Knowledge Partners
Overview
Job Purpose
The Data Engineer will design, construct, and maintain scalable data platforms using Python and Airflow. This role involves supervising the upkeep of existing data platform infrastructure workflows and creating data processing pipelines utilizing Python, Pandas, SQL, Docker, and other Python based tools. The Data Engineer will oversee and lead the module through planning, estimation, implementation, monitoring, and tracking.
Desired Skills And Experience
The Data Engineer will design, construct, and maintain scalable data platforms using Python and Airflow. This role involves supervising the upkeep of existing data platform infrastructure workflows and creating data processing pipelines utilizing Python, Pandas, SQL, Docker, and other Python based tools. The Data Engineer will oversee and lead the module through planning, estimation, implementation, monitoring, and tracking.
Desired Skills And Experience
- 2+ years of experience in software development with a focus on data projects using strong Python, SQL, and associated frameworks.
- Proven experience as a Data Engineer with experience Python
- Experience implementing data engineering frameworks using Python
- Strong SQL skills with RDMS or NoSQL databases.
- Experience with developing APIs using FastAPI or similar frameworks in Python.
- Familiarity with the DevOps lifecycle (git, Jenkins, etc.), CI/CD processes.
- Good understanding of ETL/ELT processes.
- Experience in the financial services industry, financial instruments, asset classes, and market data are a plus.
- Assist stakeholders with data-related technical issues and support their data infrastructure needs.
- Develop and maintain documentation for data pipeline architecture, development processes, and data governance.
- In-depth knowledge of data warehousing concepts, architecture, and implementation.
- Extremely strong organizational and analytical skills with strong attention to detail.
- Strong track record of excellent results delivered to internal and external clients.
- Excellent problem-solving skills, with the ability to work independently or as part of a team.
- Strong communication and interpersonal skills, with the ability to effectively engage with both technical and non-technical stakeholders.
- Able to work independently without the need for close supervision and collaboratively as part of cross-team efforts.
- Interpret business requirements and work with internal resources as well as application vendors.
- Design, develop, and maintain custom data engineering platforms.
- Troubleshoot and resolve data-related issues.
- Configure and create data models and data quality rules to meet customer needs.
- Handle multiple database platforms like Microsoft SQL Server and Oracle.
- Review and analyze data from multiple internal and external sources.
- Analyze existing Python code and identify areas for optimization.
- Write new optimized SQL queries or Python scripts to improve performance and reduce run time.
- Identify opportunities for efficiency and innovative approaches to completing the scope of work.
- Write clean, efficient, and well-documented code that adheres to best practices and Council IT coding standards.
- Maintain and operate existing custom code processes.
- Participate in team problem-solving efforts and offer ideas to solve client issues.
- Query writing skills with the ability to understand and implement changes to SQL functions and stored procedures.
- Effectively communicate with business and technology partners, peers, and stakeholders.
- Deliver results under demanding timelines to real-world business problems.
- Work independently and multi-task effectively.
- Configure system settings and options and execute unit/integration testing.
- Develop end-user release notes, training materials, and deliver training to a broad user base.
- Identify and communicate areas for improvement.
- Responsible for quality checks and adhering to the agreed Service Level Agreement (SLA) / Turn Around Time (TAT).
Similar Jobs
View All
1 Day ago
Senior Business Analyst
Information Technology
- Hyderabad, Telangana, India
This job is with Finastra, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. Who are we?At Finastra, we are a dynamic global provider of open...
1 Day ago
Associate QA Engineer, Software
Information Technology
- Hyderabad, Telangana, India
Position SummaryDebugs software products through the use of systematic tests to develop, apply and maintain quality standards for firm products. Develops, modifies and executes software test plans, automated scripts and programs for testing. Analyze...
1 Day ago
Cumulations Technologies - Full Stack Developer - MERN Stack
Information Technology
- Hyderabad, Telangana, India
Key Responsibilities Design, develop, test, and maintain scalable and responsive web applications using MERN stack (MongoDB, Express.js, React.js, Node.js). Build reusable frontend components with React.js, Hooks, and modern state management tools...
1 Day ago
KreditBee - Data Scientist/ML Specialist - Credit Risk Models
Information Technology
- Hyderabad, Telangana, India
About The RoleWe are looking for talented Data Science professionals to join our fast-growing fintech team. You will play a critical role in developing and deploying credit risk models for the retail segment, focusing on acquisition, portfolio manag...
1 Day ago
IT Engineer
Information Technology
- Hyderabad, Telangana, India
Primary skills:Technology->Data On Cloud - NoSQL->Amazon Dynamo DB,Technology->Microsoft Technologies->Windows PowerShell,Technology->Microsoft Technologies->Windows Server,Technology->Supply Chain Management->Terra A day in the life of an Infoscion...
1 Day ago
Technical Business Analyst
Information Technology
- Hyderabad, Telangana, India
General DescriptionJob Description for Senior Business / System Analyst TeamTechnical Skills Needed 4+ years of experience in a role Business or System or Functional Analyst Proficient in writing User Stories, Use Cases, Functional and Non-Functio...
1 Day ago
Software Developer in Gurgaon
Information Technology
- Hyderabad, Telangana, India
As a Software Developer at Aaptatt, you will be responsible for designing, developing, and implementing software solutions using a variety of programming languages and technologies, including Java, Python, React, React Native, Node.js, Express.js, a...
1 Day ago
Software Engineer_RPA_UI path
Information Technology
- Hyderabad, Telangana, India
Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data a...
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in