Job Details

Data Engineer

CHICAGO-60603, IL, US
07/31/2019

-


Required Skills

    Python, XML
Company

Infinity Consulting Solutions, Inc

Experience

-

Job Description

Data Engineer

Summary

The Data Engineer will be responsible for creating and maintaining optimal data pipeline architecture for next generation Data Warehouse, reporting, and data analytics environment.

The individual will be a part of a team responsible for building, managing and monitoring all data transformation and data load into a Data Lake hosted on AWS.

Key Responsibilities

Identify, design, and implement internal data process improvements by: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability.

Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of structured and unstructured data sources using SQL and AWS 'big data' technologies.

Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.

Work with internal stakeholders, including executives, to assist with data-related technical issues and
support their data needs.

Work with data and analytics experts to strive for greater functionality in our data systems.

Assist in developing data model architecture for the next generation management reporting system
Ongoing maintenance of the data warehouse

Minimum Qualifications

Bachelor's degree in Information Systems, Computer Science, Computer Engineering, or related areas

One or more Industry certifications; AWS Developer Associate, Certified Big Data Specialty, Certified
Associate in Python programing (PCAP), Apache Spark will be given preference

1-2 years of programing in the field of data engineering, SQL and related technologies

Knowledge, Experience, Skills & Abilities Required

Deep understanding and experience in the following technologies and programming environment:

Apache Spark and PySpark, Hadoop

SQL and any NoSQL and RDBMS platforms

Python, Java, JavaScript PL/SQL, XML, XSLT

Git or similar shared code repository

AWS cloud services

DevOps practices

Self-motivated problem solver who has worked on building data transformation process to support business intelligence applications in a large environment will be given preference.

Excellent organization skills, diagnostics and problem-solving abilities as well as strong written and verbal communication skills.

Energetic, able to clearly communicate ideas and deliver results



Data Architect
Information Technology

No Preference
FullTime Job
Other
1

Candidate Requirements
-
Bachelors

Walkin Information
-
7/16/2019
-

Recruiter Details
Doug Klares
1350 Broadway, Suite 2205, NEW YORK-10018, NY
-