Bangalore, Karnataka, India
Information Technology
Full-Time
SourcingXPress
Overview
Company: Vidpro Consultancy Services
Website: Visit Website
Business Type: Startup
Company Type: Product & Service
Business Model: B2B
Funding Stage: Series D+
Industry: Analytics
Salary Range: ₹ 24-35 Lacs PA
Job Description
This is a permanent role with Valued Client of Vidpro Consulting.
Primary Skills
Python, pyspark, Azure Data Factory, snowflake, snowpipe, snowsql, Snowsight, Snowpark, ETL and SQL.
Website: Visit Website
Business Type: Startup
Company Type: Product & Service
Business Model: B2B
Funding Stage: Series D+
Industry: Analytics
Salary Range: ₹ 24-35 Lacs PA
Job Description
This is a permanent role with Valued Client of Vidpro Consulting.
Primary Skills
Python, pyspark, Azure Data Factory, snowflake, snowpipe, snowsql, Snowsight, Snowpark, ETL and SQL.
- Snowpro certified is plus
- Developing Modern Data Warehouse solutions using Snowflake, Databricks and ADF.
- Ability to provide solutions that are forward-thinking in data engineering and analytics space
- Collaborate with DW/BI leads to understand new ETL pipeline development requirements.
- Triage issues to find gaps in existing pipelines and fix the issues
- Work with business to understand the need in the reporting layer and develop a data model to fulfill reporting needs
- Help joiner team members to resolve issues and technical challenges.
- Drive technical discussions with client architect and team members
- Orchestrate the data pipelines in the scheduler via Airflow
- Bachelor's and/or master’s degree in computer science or equivalent experience.
- Must have total 6+ yrs. of IT experience and 3+ years' experience in Data warehouse/ETL projects.
- Expertise in Snowflake security, Snowflake SQL and designing/implementing other Snowflake objects.
- Hands-on experience with Snowflake utilities, SnowSQL, Snowpipe, Snowsight and Snowflake connectors.
- Deep understanding of Star and Snowflake dimensional modeling.
- Strong knowledge of Data Management principles
- Good understanding of Databricks Data & AI platform and Databricks Delta Lake Architecture
- Should have hands-on experience in SQL and Spark (PySpark)
- Experience in building ETL / data warehouse transformation processes
- Experience with Open Source non-relational / NoSQL data repositories (incl. MongoDB, Cassandra, Neo4J)
- Experience working with structured and unstructured data including imaging & geospatial data.
- Experience working in a Dev/Ops environment with tools such as Terraform, CircleCI, GIT.
- Proficiency in RDBMS, complex SQL, PL/SQL, Unix Shell Scripting, performance tuning, troubleshooting and Query Optimization.
- Databricks Certified Data Engineer Associate/Professional Certification (Desirable).
- Comfortable working in a dynamic, fast-paced, innovative environment with several ongoing concurrent projects
- Should have experience working in Agile methodology
- Strong verbal and written communication skills.
- Strong analytical and problem-solving skills with a high attention to detail.
Similar Jobs
View All
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in