Data Engineer

Company Overview

Worldteam - The world’s best tech teams: Available here. Embrace the vibrant multicultural environment of Worldteam, where we say, "Hey, g'day, mabuhay, kia ora, 你好, hallo, vítejte!" As Australia’s largest supplier of tech team talent, both onshore and offshore, we're on a mission to grow Australia’s tech workforce to 1,000,000 strong by 2030. Join our decade of success and help shape our future.

About the Role

As a Data Engineer at Worldteam, you will design and implement robust data infrastructure that forms the foundation of our organization's analytics and AI capabilities. You'll build scalable pipelines and data systems that directly impact our mission-critical decision making.

What You'll Do

• ETL Pipeline Development: Design, implement, and maintain efficient data extraction, transformation, and loading processes
• Data Architecture Design: Create scalable data storage solutions including data warehouses and data lakes
• Database Management: Administer and optimize both SQL and NoSQL database systems to ensure performance and reliability
• Data Quality Assurance: Implement validation processes to ensure data accuracy, completeness, and consistency
• Real-time Data Processing: Develop streaming data pipelines for applications requiring immediate insights
• Data Documentation: Create comprehensive data dictionaries, lineage tracking, and metadata management systems
• Infrastructure as Code: Manage data infrastructure using code-based approaches for reliability and reproducibility
• Data Security: Implement data protection measures ensuring compliance with privacy regulations and security standards

Our Ideal Team Mate

• Demonstrates strong proficiency in Python, Java, or Scala with experience in Spark, Kafka, and Airflow
• Has experience with cloud platforms (AWS, GCP, Azure) data services
• Can work with both SQL and NoSQL database systems including optimization techniques
• Possesses knowledge of data modeling and data warehouse design principles
• Has experience implementing ETL/ELT processes and maintaining data pipelines at scale
• Excellent verbal and written communication skills in English for client interactions

Qualifications

• Experience with big data tools: Hadoop, Spark, Kafka
• Experience with relational SQL and NoSQL databases, including Postgres and Cassandra
• Experience with data pipeline and workflow management tools: Airflow, Luigi, or similar
• Experience with cloud services: AWS EC2, EMR, RDS, Redshift or equivalent in other cloud platforms
• Experience with stream-processing systems: Storm, Spark-Streaming
• Strong analytical skills for working with unstructured datasets
• Demonstrated ability to manipulate and extract value from large disconnected datasets

Preferred Qualifications

• Bachelor's or Master's degree in Computer Science, Statistics, Informatics, Information Systems, or another quantitative field
• Strong project management and organizational skills
• Previous experience in client-facing roles

Life at Worldteam

• Fuel Your Growth: Enjoy comprehensive personal and professional development opportunities.
• Be Healthy: Benefit from our proactive Wellbeing Policy.
• Enrich Your Life: Take advantage of the flexibility to work remotely from any part of the world for up to two weeks each year.
• Be Comfortable: Relish in a casual work atmosphere every day.
• Have Fun: Engage in our vibrant culture with regular team outings, weekly lunches, and more.
• Make an Impact: At Worldteam, your work in data engineering will directly enhance our product offerings and client satisfaction. You’re not just supporting technology—you're enabling our innovative edge in a competitive market.

Worldteam is committed to fostering a diverse and inclusive work environment. We are proud to be an equal opportunity employer and do not discriminate on the basis of race, religion, gender, sexual orientation, age, or disability.

If you’re ready for this exciting challenge and to be a key part of our engineering team, we’re eager to hear from you! So, we’ve crafted a test about the things that are important for this position. Taking this will help us both discover our potential fit.

You can do it only once. You’ll get quick feedback in seconds. Plus, a real human will be in touch shortly.

Test link:https://hire.toggl.com/c/kj9rl/lq0v1

Best regards,

Sam and everyone here at Worldteam!