Software Engineer, Spark


California, US / Remote
  • Job Type: Full-Time
  • Function: Engineering Software
  • Post Date: 05/07/2021
  • Website:
  • Company Address: 395 Page Mill Rd, Palo Alto, CA, 94304

About Cloudera

Cloudera, advancing digital transformation with an enterprise data cloud from the Edge to AI.

Job Description

Cloudera is looking for an exceptional passionate software engineer with strong distributed systems expertise to join the Cloudera Data Engineering + Spark team. The team builds and maintains the Cloudera Data Engineering Experiences (CDE) and Apache Spark distribution within the overall Cloudera Data Platform (CDP). 

Cloudera Data Engineering Experience is the next generation cloud-native SaaS/PaaS platform to allow customers to run large-scale data engineering workflows (consists of Spark, Airflow, etc.) with just a few clicks. 

We are looking for senior folks with experience in large-scale, distributed systems to help to build our enterprise-grade Data Engineering Experiences powered upon open source technologies such as Apache Spark and Kubernetes.

Members of

The Data Engineering team spans across the globe like the United States, Hungary, India, Australia. Many of the team members deeply involved in open source projects/communities like Apache Software Foundation, CNCF.

The team in the United States currently consists of 8 developers. We’re heavily involved in core development work for all aspects of Cloudera Data Engineering, Apache Spark, Apache Iceberg, etc.

You will…

  • Work with amazing people - We are a fun & smart team, including many of the top luminaries in Spark, Kubernetes, Hadoop, and related open source communities. 

  • Do an innovative work - Cloudera pushes the frontier of big data & data engineering.

    • We frequently interact with the research community, collaborate with engineers at other top companies & host cutting-edge researchers for tech talks. 

    • We encourage members to participate open source community and do more tech talks.

  • Be a part of great culture - Transparent and open meritocracy. Everybody is always thinking of better ways to do things, and coming up with ideas that make a difference. We build our culture to be the best workplace in our careers.

  • Gain experience - Become an expert on the latest Cloud-native/SaaS technologies such as Kubernetes, AWS, Azure, as well as Big data technologies such as Spark/Airflow, etc.



  • Relevant studies / BS or MS in Computer Science or related field

  • 5+ years experience as a Software Engineer

  • Hands-on programmer with solid data-structures and algorithms.

  • We use Java/Scala/GoLang in projects, you should have a strong understanding of at least one of the following languages: Java, Scala, GoLang, Rust, C++, Python. And interested to learn one of the languages we’re using.

  • Experience with systems design, development.

  • Passionate about programming, clean coding habits, attention to detail, and focus on quality

  • Strong oral and written communication skills.

  • Strong ability to research and solve problems independently without constant supervision

  • (Most importantly) Open-minded, desire to learn new things and build great products.


  • Experience with using/developing Apache Spark/Airflow or other related technologies.

  • Experience building and maintaining containerized applications on Kubernetes.

Strong Pluses:

  • Experience with large-scale, distributed systems design and development with an understanding of scaling, performance, and scheduling.

  • Solid experience with at least one cloud service (AWS, Azure, GCP, OpenShift)

  • Contributors to open-source projects.

Related Jobs

Release Engineer

Cloudera - Santa Clara, CA, USRemote

Senior Software Development Engineer in Test - ML Platform

Cloudera - Bangalore, IN

Sr Software Engineer - Release Engineering

Cloudera - Bangalore, IN

Sr. Software Dev Eng in Test

Cloudera - Bangalore, IN

Senior Product Manager, Kafka

Cloudera - California, USSanta Clara, CA, USIllinois, USRemote
Disclaimer: Local Candidates Only
This company does NOT accept candidates from outside recruiting firms. Agency contacts are not welcome.