| Job Title: | Data Pipeline Developer | |
| Company: | Quantcast | |
| Job Location(s): |
| |
| Description: | Description Quantcast captures multiple terabytes of new data on a daily basis. This is the beginning of our data pipeline and is where we start turning raw information into the data our partners use to make critical advertising decisions. Quantcast's data pipeline team is responsible for the production software that generates the results that power our website and internal tools. Quantcast Is looking for a software engineer with extensive experience working with large data sets and developing large scale cluster data processing. The candidate needs to demonstrate an exceptional command of Java and have experience developing in a Unix environment. This engineer would be responsible for building and maintaining production MapReduce software to crunch through enormous data sets efficiently as well as building infrastructure to deliver high quality, accountable, and timely results. The ideal candidate in this position will have worked in the online advertising domain in the past and will have built out significant portions of the ad serving and evaluation infrastructure. This is an environment for talented entrepreneurs who are hungry to learn and take risks. Quantcast is looking for hands-on craftspeople who are preoccupied with efficiency and results. If you feel this describes you, we encourage you to apply. Responsibilities • Develop large scale cluster data processing • Build infrastructure to automate extremely high volumes of data delivery • Creatively solve scaling issues • Contribute to the design and architecture of innovative solutions to difficult problems Requirements • Bachelor’s Degree in Computer Science or related field • Demonstrated background working with extremely large datasets • Experience working with ad serving engines or ad platform infrastructure • Experience building distributed computing infrastructure • Willingness to jump into any problem to provide creative scaling solutions and deliver on tight deadlines • Desire to learn and implement new technologies Technologies • Excellent Java programming skills • Deep background working with Unix (ideally Linux) • Extensive SQL experience, Postgres or MySQL is preferred • Solid background working with scripting languages, Ruby or Python is preferred • Experience working with grid computing or MapReduce technologies a plus | |
| Apply Now |
