Data Engineer
CHICAGO-60603, IL, US
07/31/2019
-
Required Skills
Company
Infinity Consulting Solutions, Inc
Experience
-
Job Description
Data Engineer
Summary
The Data Engineer will be responsible for creating and maintaining optimal data pipeline architecture for next generation Data Warehouse, reporting, and data analytics environment.
The individual will be a part of a team responsible for building, managing and monitoring all data transformation and data load into a Data Lake hosted on AWS.
Key Responsibilities
Identify, design, and implement internal data process improvements by: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability.
Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of structured and unstructured data sources using SQL and AWS 'big data' technologies.
Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.
Work with internal stakeholders, including executives, to assist with data-related technical issues and
support their data needs.
Work with data and analytics experts to strive for greater functionality in our data systems.
Assist in developing data model architecture for the next generation management reporting system
Ongoing maintenance of the data warehouse
Minimum Qualifications
Bachelor's degree in Information Systems, Computer Science, Computer Engineering, or related areas
One or more Industry certifications; AWS Developer Associate, Certified Big Data Specialty, Certified
Associate in Python programing (PCAP), Apache Spark will be given preference
1-2 years of programing in the field of data engineering, SQL and related technologies
Knowledge, Experience, Skills & Abilities Required
Deep understanding and experience in the following technologies and programming environment:
Apache Spark and PySpark, Hadoop
SQL and any NoSQL and RDBMS platforms
Python, Java, JavaScript PL/SQL, XML, XSLT
Git or similar shared code repository
AWS cloud services
DevOps practices
Self-motivated problem solver who has worked on building data transformation process to support business intelligence applications in a large environment will be given preference.
Excellent organization skills, diagnostics and problem-solving abilities as well as strong written and verbal communication skills.
Energetic, able to clearly communicate ideas and deliver results
Data Architect
Information Technology
No Preference
FullTime Job
Other
1
Candidate Requirements
-
Bachelors
Walkin Information
-
7/16/2019
-
Recruiter Details
Doug Klares
1350 Broadway, Suite 2205,
NEW YORK-10018, NY
-