Overall 4 years of experience at a minimum
Hands-on experience with one or more NoSQL DBs like MongoDB, Cassandra, etc is a MUST
Ability to build highly scalable / reliable applications for the Hadoop / Spark eco-system with at least 1-2 years hands-on experience using Spark, Kafka, PySpark, Scala, Java
Ability to build and deploy using one or more of the following tech… Maven / Ant / Jenkins / Docker / DockerSwarm / Kubernetes
Ability to manage / deploy / configure Spark clusters using Yarn / Mesos will be a plus
Experience working with AWS or Azure clouds using AWS EMR, AWS RedShift, AWS S3, AWS Glue, Azure DataFactory, Azure HDInsight, etc will be a plus
MUST have prior experience using Redis, ElasticSearch - either self hosted or managed services from AWS, Azure, Elastic.co