Overview

Los Angeles County, CA, USA
icrunchdata Network
Job Description: Should lead and guide a team of Spark developers Implantation of Spark Core, Sparks and Spark Streaming Experience on Apache Kafka Integration with Apache Spark Implementing security for Spark Applications Solid understanding of big data environments Working with Spark in combination Hadoop Ecosystem Proven experience processing and aggregating over billions of rows Good working knowledge on Hive Experience publishing RESTful API s to enable real-time data consumption Solid hands-on experience with Spark Core, Spark Streaming, SparkSQL for real-time data processing (at least one year proven experience) Developing Hive UDFs in Python or Java and integrating with Spark Integrating Spark with RDBMS (at least two mandatory) Working with Apache Kafka Should be able to fine tune performance of Spark applications Build and maintain performant, fault-tolerant, scalable distributed software systems Demonstrated success working with cross-functional teams Well-versed in the development challenges inherent with highly scalable, highly available, and highly resilient system Should lead and guide a team of Spark developers Implantation of Spark Core, Sparks and Spark Streaming Experience on Apache Kafka Integration with Apache Spark Implementing security for Spark Applications Solid understanding of big data environments Working with Spark in combination Hadoop Ecosystem Proven experience processing and aggregating over billions of rows Good working knowledge on Hive Experience publishing RESTful API s to enable real-time data consumption Solid hands-on experience with Spark Core, Spark Streaming, SparkSQL for real-time data processing (at least one year proven experience) Developing Hive UDFs in Python or Java and integrating with Spark Integrating Spark with RDBMS (at least two mandatory) Working with Apache Kafka Should be able to fine tune performance of Spark applications Build and maintain performant, fault-tolerant, scalable distributed software systems Demonstrated success working with cross-functional teams Well-versed in the development challenges inherent with highly scalable, highly available, and highly resilient systems [...]

Source: