Enconosoft
-
Big Data experience, strong development experience is the key. Must also be very proficient with Scala from a true understanding of being able to do much more than coding. Will provide an interface for programming entire clusters with implicit data parallelism and fault tolerances. Experience with platform for large-scale SQL, batch processing, stream processing, and machine learning are big pluses.We would expect the Engineer to :• Do coding, testing of Spark application written in Scala / Spark Sql (60%)• Implementation & support of the code base (20%)• Fine tuning and performance optimization of Spark code base(10%)• Must have experience on o Well versed Scala, Spark, and working with various data formats - Parquet, CSV, JSON o Kafka o Hadoop, Hive o Cassandra