E-Solutions
-
Competent Client engineer, who is independent, results driven and is capable of taking business requirements and building out the technologies to take it to production.Big Data Client Engineer with expert level experience in Hadoop ecosystem and real-time analytics tools including PySpark/Scala-Spark/Hive/Hadoop CLI/MapReduce/ Storm/Kafka/Lambda Architecture/Mongoexpert with using the larger Hadoop eco systemFamiliar with job scheduling challenges in HadoopExperienced in creating and submitting Spark jobsExperience in high performance tuning and scalabilityExperience in working on real time stream processing technologies like Spark structured streaming, Kafka, FLink + rocksDBExpertise in Python/Spark and their related libraries and frameworksExperienced with Spring Framework and Spring BootExperience in building training Client pipeline and efforts involved in Client Model deploymentExperience in other Client concepts Real time distributed model inferencing pipeline, Champion/Challenger framework, A/B Testing, Model performance Scorecard and assessment, Retraining framework, etc.Unix/Linux expertise; comfortable with Linux operating system and Shell ScriptingWorking Experience in Redis DB Writing to and from redis-- very critcal Also exp Azure cacheExperience in creating Kubernetes open-source container-orchestration system for automating application deployment, scaling, and management; (Experience in Azure is preferable)Experience in tweaking/using Jenkins, deployment orchestration and/or Kubernetes for CI/CD pipelineCreating/modifying Dockers, microservices and deploying them via KubernetesPL/SQL, RDBMS background with Oracle/MySQLFamiliarity with Cassandra, Mongo preferred.Design, Development, Unit and Integration testing of complex data pipelines and to handle data volumes to derive insightsAbility to optimize code to be able to run efficiently with stipulated SLAExcellent problem-solving skills, with attention to detail, focus on quality and timely delivery of assigned tasks.