Pipeline Developer
JERSEY CITY-07305, NJ, US
09/27/2018
-
Required Skills
Company
Infinity Consulting Solutions, Inc
Experience
-
Job Description
The Cybersecurity & Technology Controls (CTC) organization is developing an application that is a multi-tenant big data platform that supports multiple reporting, visualization, machine learning and other advanced analytics capabilities across the Cybersecurity & Technology Controls (CTC) organization. The team is seeling a senior Pipeline Developer who will build data engineering pipelines that transform data from various enterprise source systems.
” Ability to ETL/ELT data coming from disparate sources (RDBMS, Stream, File, Web, etc.) leveraging big data technologies
” Architecture and development of large scale solution (big data) to be used in a very large production environment
” Provide engineering support for cyber security products developed
” System, network and application troubleshooting
Qualifications:
” Strong experience with hadoop ecosystem: Hadoop, Spark, Map/Reduce, Hive/Pig, Impala/Drill, etc.
” Expert in Apache Spark 2.X framework (pyspark & Java)
” Experience with messaging and data transport tools: Kafka, Sqoop, NiFi, LogStash, Syslog-ng, rsyslog, etc.
” Strong research, analytical and problem solving skills
” Independent problem-solving, highly motivated and self-directing
” Strong interpersonal and communication skills; capable of writing documentation, training users in complex topics, making presentations to junior and very senior audience
” Ability to work under pressure in a fast-paced environment while remaining productive and professional; exercise patience and ability to multi task
” Comfortable with most aspect of operating system administration such as tweaking, hardening and configuring services
” A solid understanding of Unix-based operating systems, including paging/swapping, IPC, drivers and filesystem (inode, partitions, etc.)
” Desired: Having skills in the below areas is a major plus that will help the candidate integrate within the team and environment but are *not a requirement*.
” Desired: Experience with NoSQL stacks: Elasticsearch, SolR, MongoDB, etc.
” Desired: Experience with SIEM products: QRadar, Arcsight, Splunk, etc.
” Desired: Experience with Link Analysis tools and GraphDBs
” Desired: Experience with data visualization tools: Hue, Kibana, Qlikview, Tableau, etc.
” Desired: Knowledge in RIA: HTML5, node.js, bootstrap, angular, extJS, etc.
Developer
Information Technology
No Preference
Contract Only
Other
1
Candidate Requirements
-
-
Walkin Information
-
-
-
Recruiter Details
Doug Klares
1350 Broadway, Suite 2205,
NEW YORK-10018, NY,
US
-