BigData Engineering – Technical Lead

Overview

• Experience should have 8 Years to 12 Years into BigData Engineering.
• Experience in modern cloud Data technologies, including Spark, Spark Streaming, Confluent Kafka, Git, Databricks, CICD, SQL, and ETL tools such as Data Stage.
• Possess experience in Python and Spark for automation, data transformation, reporting, data manipulation, and data cleaning.
• Requires effective communication with stakeholders to gather requirements and provide customized business solutions.
• Must have experience with medallion architecture, streaming architecture, data warehousing, and work with other tools to integrate data systems into Databricks.
• Experience in data warehouse design and maintenance
• Experience in agile development processes using Jira and Confluence.
• Experience in cross-functional teams.
• Understanding on the SDLC.
• Understanding on the Agile methodologies.
• Communication with customer and producing the Daily status report.
• Should have good oral and written communication.
• Should be a good team player.
• Should be proactive and adaptive.