Job Details

Email to Friend Save Back

Senior Big Data Engineer

CHARLESTON-29406, SC, US
08/20/2018

-

Required Skills

Python

Company

Infinity Consulting Solutions, Inc

Experience

Job Description

Responsibilities

• Using dynamic programming languages, such as Scala and Python to architect, implement and integrate data

analytics tools for financial markets

• Proactively assisting other developers in diagnosing and solving issues with development and build environments

• Establishing and improving infrastructure in support of production, QA, and development systems

• Implementation of system monitoring infrastructure and tools, including dashboards

• Monitoring systems for issues in real-time, responding to them as they occur, and working proactively to

minimize future issues

• Level 3 support Requirements

Qualifications

• 5+ years of experience building large scale big data applications (spark streams, kafka streams, HDFS internals)

• Proactive with a high attention to detail and ability to manage multiple projects simultaneously

• Strong working knowledge of the Linux operating system, including basic system administration and a high

degree of comfort working from the command line

• Experience with version control software and SDLC principles

• Strong programming skills using Scala and Python

• Experience with containers, orchestration and CI/CD pipelines

• Experience with Open Source software including Puppet, Jenkins, Nagios, GNU make, Redmine, OpenLDAP,

FreeRADIUS, BIND, collectd, Graphite, Grafana, Hypertable, consul, zookeeper, and PostgreSQL are a bonus

• Financial experience is not required