|
|
| Senior Engineer-Distributed Systems Architect | | UpTake | | We are a fast-growing company thriving through the economic downturn by providing a unique and much needed travel service. We are looking for an outstanding application engineer with strong web-tier development skills and a burning desire to create a great product. Candidate will have a direct impact UpTake's core data acquisition and processing infrastructure enabling us to scale our search index to massive scale.
Responsibilities:
The engineer in this role will create a world-class data processing pipeline to process massive amounts of web-data representing millions of products and reviews. At UpTake data are moved through several applications from loading and normalizing to classification and indexing. The successful candidate will own the processing pipeline, make it fault tolerant, highly scalable across distributed systems with a framework that all processing applications can plug into. The engineer will own several critical data processing applications and will work with other engineers to ensure their applications fit into the pipeline framework.
Experience (required):
• 5 years experience and world-class expertise with high volume, multi-step, data processing pipelines
• Hands on experience across a variety of data processing steps e.g. de-duplication, normalization, classification
• Native speaker of the UNIX command line, XML and regular expressions
• Current hands on experience developing some aspect of a data processing pipeline
• Likes to work in a collaborative team environment.
• Hands on experience using high performing SQL with very large data sets
• Is very familiar with common collaboration and code/build management tools such as SVN, Ant, Maven
• Able to work effectively as an individual contributor with a team of wide-spread talent
• Able to explain their architectural and design decisions with a a very talented technical team
• Ability to shift gears quickly in a start-up environment
• The successful candidate will have previously worked in small start-up search environments and have a desire to do so again
Experience (ideal):
• 5+ years experience and world-class skills in Java development including intensive and highly perform SQL
• Real-world experience with distributed processing frameworks systems such as Nutch, Hadoop.
• Robust cross-system job scheduling and process flow technologies: BPM, BPEL, Quartz, enterprise service bus such as Mule, OpenESB, GlassFish.
Experience (nice to have):
• Practical knowledge of search and text processing algorithms
• Rich experience with web application technologies: Web services, XML, SOAP, SAX, Ruby on Rails, Active Record and/or J2EE technologies including EJB, Spring, Hibernate | | Apply Now |
|
 |
|
