Job Details

Email to Friend Save Back

Data Engineer

SAINT PAUL-55104, MN, US
06/20/2019

-

Required Skills

T-SQL

Company

Infinity Consulting Solutions, Inc

Experience

5 to 8 Year(s)

Job Description

Data Engineer

Direct Hire Position

St. Paul, MN

Position Overview:

This candidate will lead the development, building, and sustaining of system enhancements and applications using multiple integration technologies.

Develop designs and specifications based on business requirements.

Responsible for the scalability, robustness, and reliability of all solutions within the application area.

Support the planning and implementation of data design services, providing sizing and configuration assistance and performing needs assessments.

Delivery of architectures for transformations and modernizations of enterprise data solutions using Azure cloud data technologies.

Design and Build Modern Data Pipelines and Data Streams.

Design and Build Data Service APIs.

Position Requirements:

Bachelor’s degree in Computer Science, Software Engineering, or a related discipline

8+ years of experience in software integration

5+ years of experience in software development

2+ years of experience working with MuleSoft, Azure API, or equivalent platform

2+ years of experience in Continuous integration and Continuous deployment

2+ years of experience working ETL/ELT Solutions

Must have experience designing, developing, and testing mission-critical solutions.

Mastery of .NET C# and T-SQL with the familiarity of U-SQL is required

Knowledge of Integration Platform Architectures

Knowledge of Azure Data Factory, Azure Data Lake, Azure SQL DW, Azure SQL, Azure App
Service, Azure HDInsight + Spark, Kafka, Azure Cosmos DB, Azure Databricks, and Azure Stream Analytics

Experience preparing data for Data Science and Machine Learning and/or Azure Databricks (preferred)

Designing and building Data Pipelines using streams of IOT data.

Knowledge of Lambda and Kappa architecture patterns.

Knowledge of Master Data Management (MDM) and Data Quality tools and processes (preferred)

Knowledge of Dev-Ops processes (including CI/CD) and Infrastructure as code fundamentals.

Working experience with Visual Studio, PowerShell Scripting, and ARM templates.

Experience with Git/TFS/VSTS