Job Details

Senior Data Engineer (Snowflake)

BURBANK-91505, CA, US
02/29/2020

-


Required Skills

    XML, ETL tools
Company

Infinity Consulting Solutions, Inc

Experience

-

Job Description

Major Responsibilities:

• Engage with product owner, architects, report developers, business analysts, and business partners to understand business requirements and develop effective database solutions that ensure reliability, quality, security, scalability and ensure performance metrics and SLA requirements are met

• Write custom code for data pipelines using SQL, Python, ETL tools and work in a DevOps-like environment

• Develop Snowflake engineering best practices and guidelines

• Collaborate and participate in application release planning and implementation

• Solid knowledge of Data Warehousing fundamentals and Data Modeling

• Must have Scripting/coding experience with SQL, Python or Java

• Must have experience in securing PII data such as data masking

• Must have experience working with Snowpipe and Snowflake API

• Experience writing, troubleshooting, and debugging complex SQL queries on distributed systems/MPP (massively parallel processing) architecture

• Strong knowledge of RDBMS, SQL data types, functions, stored procedures, security & encryption

• Database migration and ETL/ELT experience

• Experience working with data formats like CSV, XML, AVRO, JSON, PARQUET etc

• Good understanding of Amazon AWS ecosystem

• Experience working on a Scrum team or other Agile delivery methodology

• Working knowledge of GitHub or GitLab



Nice to Have:

• ETL Pipeline development experience using any one of these tools such as Informatica, Matillion, Glue or similar tools

• Familiarity with Spark, PySpark etc

• Experience with workload automation tools such as Airflow, Autosys.

• Knowledge of Big Data (HDFS, Hive), AWS (S3, IAM), and various data formats

• Knowledge of DevOps tools such as Jenkins



Data Architect
Information Technology

No Preference
Contract Only
Other
1

Candidate Requirements
-
Bachelors

Walkin Information
-
2/26/2020
-

Recruiter Details
Doug Klares
1350 Broadway, Suite 2205, NEW YORK-10018, NY
-