Data Pipeline Engineer


San Jose, CA, US
  • Job Type: Full-Time
  • Function: Data Science
  • Post Date: 12/23/2020
  • Website:
  • Company Address: 4620 Fortran Dr Suite 202, San Jose, CA, 95134

About PatternEx

PatternEx is an Artificial Intelligence security company that has developed a platform to identify malicious user intent. The PatternEx solution enables our customers to predict and prevent cyber attacks in real time, anywhere across the enterprise.

Job Description

Be on the leading edge of applying machine learning and data modeling to the world of cyber security. As part of the product development team, you will directly impact the product by developing core algorithms to model complex problems.

Specific Responsibilities Include:

Design systems that reliably transport and process billions of events per day that arrive at network speed
Implement systems that handle scale in a VM/container environment
Provide real-time streaming and querying capability on a large volume of data
Guide our data scientists, and engineers to build and optimize data pipelines
Apply a lambda architecture for threat prediction and model creation
Incorporate cutting edge Machine Learning Algorithms to the data pipeline
Required Experience

5 years' experience building large-scale data pipelines
Deep knowledge of data structures, algorithms, distributed systems, and information retrieval
3 years’ experience developing data pipelines using NoSQL such as Cassandra, Druid etc.
Software development experience in Spark
Experience working with Kafka
Passionate about learning new technologies and solving hard problems
Team player with excellent communication skills

Contact us.

Related Jobs

Senior UI Engineer

PatternEx - San Jose, CA, US

Deep Learning Expert

PatternEx - San Jose, CA, US

Platform/Infrastructure Engineer

PatternEx - San Jose, CA, US
Disclaimer: Local Candidates Only