Job Details

Email to Friend Save Back

Data Engineer

SAN FRANCISCO-94105, CA, US
09/28/2018

-

Required Skills

data pipelines

Company

Infinity Consulting Solutions, Inc

Experience

Job Description

Data Engineer

San Francisco, CA

Financial Services

Full Time or Contract to Hire

Role/Responsibilities

In this role you will be a member of an exciting team creating and supporting some of the industry’s leading software solutions for the structured finance industry.

You will be involved in all aspects of SDLC, working directly with key business stakeholders to build and support key SAV applications.

Typical Responsibilities include:

You will join the early stage of projects and participate in defining the platform for the next generation products

You will build API and processing pipeline for multi-tenant, high-volume, and real-time system on Spark and Hadoop platform

You will transform complex analytical models into scalable, production-ready solutions

You will continuously integrate and ship code into the cloud environment

You will participate in defining the architecture of modern tools and runtime for operating your code such as AWS, Docker

You will work directly with Product Owners to deliver products in a collaborative and agile environment

Qualifications

Bachelors or higher in Computer Science, Mathematics, or other relevant field

Excellent communication skills

Experience with object oriented/functional programming languages like Java, Scala, Python, etc.

Knowledge of Relational and NoSQL databases such as MongoDB, ElasticSearch, Postgres

Experience with distributed frameworks such as Apache Hadoop, Storm/Spark/Kafka

Experience with building data pipelines is a plus

Experience building and optimizing ‘big data’ data pipelines, architectures and data sets.

Strong analytic skills related to working with unstructured datasets.