Senior Data Engineer (Snowflake)
BURBANK-91505, CA, US
02/29/2020
-
Required Skills
Company
Infinity Consulting Solutions, Inc
Experience
-
Job Description
Major Responsibilities:
• Engage with product owner, architects, report developers, business analysts, and business partners to understand business requirements and develop effective database solutions that ensure reliability, quality, security, scalability and ensure performance metrics and SLA requirements are met
• Write custom code for data pipelines using SQL, Python, ETL tools and work in a DevOps-like environment
• Develop Snowflake engineering best practices and guidelines
• Collaborate and participate in application release planning and implementation
• Solid knowledge of Data Warehousing fundamentals and Data Modeling
• Must have Scripting/coding experience with SQL, Python or Java
• Must have experience in securing PII data such as data masking
• Must have experience working with Snowpipe and Snowflake API
• Experience writing, troubleshooting, and debugging complex SQL queries on distributed systems/MPP (massively parallel processing) architecture
• Strong knowledge of RDBMS, SQL data types, functions, stored procedures, security & encryption
• Database migration and ETL/ELT experience
• Experience working with data formats like CSV, XML, AVRO, JSON, PARQUET etc
• Good understanding of Amazon AWS ecosystem
• Experience working on a Scrum team or other Agile delivery methodology
• Working knowledge of GitHub or GitLab
Nice to Have:
• ETL Pipeline development experience using any one of these tools such as Informatica, Matillion, Glue or similar tools
• Familiarity with Spark, PySpark etc
• Experience with workload automation tools such as Airflow, Autosys.
• Knowledge of Big Data (HDFS, Hive), AWS (S3, IAM), and various data formats
• Knowledge of DevOps tools such as Jenkins
Data Architect
Information Technology
No Preference
Contract Only
Other
1
Candidate Requirements
-
Bachelors
Walkin Information
-
2/26/2020
-
Recruiter Details
Doug Klares
1350 Broadway, Suite 2205,
NEW YORK-10018, NY
-