Job Details

Pipeline Developer

JERSEY CITY-07305, NJ, US
09/27/2018

-


Required Skills

    HTML5
Company

Infinity Consulting Solutions, Inc

Experience

-

Job Description

The Cybersecurity & Technology Controls (CTC) organization is developing an application that is a multi-tenant big data platform that supports multiple reporting, visualization, machine learning and other advanced analytics capabilities across the Cybersecurity & Technology Controls (CTC) organization. The team is seeling a senior Pipeline Developer who will build data engineering pipelines that transform data from various enterprise source systems.



” Ability to ETL/ELT data coming from disparate sources (RDBMS, Stream, File, Web, etc.) leveraging big data technologies

” Architecture and development of large scale solution (big data) to be used in a very large production environment

” Provide engineering support for cyber security products developed

” System, network and application troubleshooting



Qualifications:

” Strong experience with hadoop ecosystem: Hadoop, Spark, Map/Reduce, Hive/Pig, Impala/Drill, etc.

” Expert in Apache Spark 2.X framework (pyspark & Java)

” Experience with messaging and data transport tools: Kafka, Sqoop, NiFi, LogStash, Syslog-ng, rsyslog, etc.

” Strong research, analytical and problem solving skills

” Independent problem-solving, highly motivated and self-directing

” Strong interpersonal and communication skills; capable of writing documentation, training users in complex topics, making presentations to junior and very senior audience

” Ability to work under pressure in a fast-paced environment while remaining productive and professional; exercise patience and ability to multi task

” Comfortable with most aspect of operating system administration such as tweaking, hardening and configuring services

” A solid understanding of Unix-based operating systems, including paging/swapping, IPC, drivers and filesystem (inode, partitions, etc.)

” Desired: Having skills in the below areas is a major plus that will help the candidate integrate within the team and environment but are *not a requirement*.

” Desired: Experience with NoSQL stacks: Elasticsearch, SolR, MongoDB, etc.

” Desired: Experience with SIEM products: QRadar, Arcsight, Splunk, etc.

” Desired: Experience with Link Analysis tools and GraphDBs

” Desired: Experience with data visualization tools: Hue, Kibana, Qlikview, Tableau, etc.

” Desired: Knowledge in RIA: HTML5, node.js, bootstrap, angular, extJS, etc.



Developer
Information Technology

No Preference
Contract Only
Other
1

Candidate Requirements
-
-

Walkin Information
-
-
-

Recruiter Details
Doug Klares
1350 Broadway, Suite 2205, NEW YORK-10018, NY, US
-