Information Technology
Full-Time
Equifax
Overview
What You’ll Do
- Apply the knowledge of data characteristics and data supply pattern, develop rules and tracking process to support data quality model.
- Prepare data for analytical use by building data pipelines to gather data from multiple sources and systems.
- Integrate, consolidate, cleanse and structure data for use by our clients in our solutions.
- Perform design, creation, and interpretation of large and highly complex datasets.
- Stay up-to-date with the latest trends and advancements in GCP and related technologies, actively proposing and evaluating new solutions.
- Understand best practices for data management, maintenance, reporting and security and use that knowledge to implement improvements in our solutions.
- Implement security best practices in pipelines and infrastructure.
- Develop and implement data quality checks and troubleshoot data anomalies.
- Provide guidance and mentorship to junior data engineers.
- Review dataset implementations performed by junior data engineers.
- BS degree in a STEM major or equivalent discipline; Master’s Degree strongly preferred
- 10+ years of experience as a data engineer or related role
- Cloud certification strongly preferred
- Advanced skills using programming languages such as Python or SQL and intermediate level experience with scripting languages
- Intermediate level understanding and experience with Google Cloud Platforms and overall cloud computing concepts, as well as basic knowledge of other cloud environments
- Experience building and maintaining moderately-complex data pipelines, troubleshooting issues, transforming and entering data into a data pipeline in order for the content to be digested and usable for future projects
- Experience designing and implementing moderately complex data models and experience enabling optimization to improve performance
- Demonstrates advanced Git usage and CI/CD integration skills
- Active Cloud Certification
- Experience in Apache Beam , GCP Dataflow , GCP Bigquery
- Experience in Java
- Experience in ingesting data from AWS Kinesis / GCP Pub Sub Topics
- File transfers between GCP Cloud and AWS S3
- You have expertise designing, analyzing and troubleshooting large-scale distributed systems.
- You take a system problem-solving approach, coupled with strong communication skills and a sense of ownership and drive
Similar Jobs
View All
1 Day ago
TrueFan - Senior Machine Learning Engineer
Information Technology
- Thiruvananthapuram, Kerala, India
About UsTrueFan is at the forefront of AI-driven content generation, leveraging cutting-edge generative models to build next-generation products. Our mission is to redefine content generation space through advanced AI technologies, including deep ge...
1 Day ago
Salesforce commerce cloud consultant
Information Technology
- Thiruvananthapuram, Kerala, India
Salesforce Commerce Cloud consultant 5+ Years of Experience 6 to 12 months Mode - Remote 1.1LPM - 1.2LPM Max Key Responsibilities Translate business requirements into scalable Salesforce Service Cloud solutions, in collaboration with CAE's technic...
1 Day ago
Cloud Infrastructure Engineer
Information Technology
- Thiruvananthapuram, Kerala, India
DescriptionInvent the future with us. Recognized by Fast Company’s 2023 100 Best Workplaces for Innovators List, Ampere is a semiconductor design company for a new era, leading the future of computing with an innovative approach to CPU design focuse...
1 Day ago
Devops Engineer- Intermetiate
Information Technology
- Thiruvananthapuram, Kerala, India
BackJD: Dev ops Engineer:As a DevOps Specialist- should be able to take ownership of the entire DevOps process, including Automated CI/CD pipelines and deployment to production.They should also be comfortable with risk analysis and prioritization.Le...
1 Day ago
Sr Data Scientist (London)
Information Technology
- Thiruvananthapuram, Kerala, India
AryaXAI stands at the forefront of AI innovation, revolutionizing AI for mission-critical, highly regulated industries by building explainable, safe, and aligned systems that scale responsibly. Our mission is to create AI tools that empower research...
1 Day ago
Software Test Engineer
Information Technology
- Thiruvananthapuram, Kerala, India
By clicking the “Apply” button, I understand that my employment application process with Takeda will commence and that the information I provide in my application will be processed in line with Takeda’s Privacy Notice and Terms of Use. I further att...
1 Day ago
Software Developer 5 (Java Fullstack)
Information Technology
- Thiruvananthapuram, Kerala, India
Job DescriptionBuilding off our Cloud momentum, Oracle has formed a new organization - Oracle Health Applications & Infrastructure. This team focuses on product development and product strategy for Oracle Health, while building out a complete platfo...
1 Day ago
Java Developer - Spring Frameworks
Information Technology
- Thiruvananthapuram, Kerala, India
Java DescriptionWe are looking for a passionate and talented Java Developer with 2-3 years of hands-on experience to join our growing development team.The ideal candidate should have a strong foundation in Java technologies and the ability to develo...
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in