We have an unprecedented opportunity to run A/B tests with online users and innovate more quickly based on actual user response.
Microsoft needs to shift the culture from planning the exact features to planning a set of possible features, and letting customers guide us
Our Mission is to accelerate software innovation through trustworthy experimentation
The Experimentation Platform enables product groups at Microsoft and later on will enable external developers to innovate using controlled experiments with live users. The platform enables testing new ideas quickly using the best-known scientific method for establishing causality between a feature and its effects: randomized experimental design. The basic methodology in controlled experiments is to expose a percentage of users to a new treatment, measure the effect on metrics of interest, and run statistical tests to determine whether the differences are statistically significant, thus establishing causality.
We already executed over 90 experiments, several with returns in the millions of dollars to Microsoft. See http://exp-platform.com and a recent presentation at the SD Forum for more information about ExP. If you're a Microsoft employee, see selected reports and testimonials.
Components of the experimentation platform must be rock solid since they are used to test features on the largest live systems in the world, such as the MSN Home Page. Other parts are for internal use and rev fast with more risk.
As the Test Lead/Manager, you should have passion for automated testing, including correctness and scalability, and the ability to make risk assessments and decisions in an agile team that releases often (about every 8 weeks). This is not the team where you will have a large fiefdom, but rather significant influence. The Test team has 5 FTEs, an intern, and growing to 6 or 7. There are also several contractors. The position calls for a technical person.
Qualified candidates must have a solid technology background, entrepreneurial spirit, and good cross-team interaction skills. Experienced with Microsoft test methodologies, tools development are a strong plus.
Requirements:
- Significant experience in test automation
- 10-years’ experience and 5-years of management experience as a hands-on manager.
- Good communicator with ability to influence and drive a high-quality platform that’s testable as part of its design.
- Strong track record of delivery
- A CS degree or strong equivalent.
- Energy and desire to deliver high-quality software quickly through agile development
Additional valuable experience
- Prior work in data-intensive environments
- Background in highly scalable systems, preferably in web services
- Database and analytics experience (OLTP/ETL/OLAP)
Help us bring the vision that Admiral Grace Hopper set: one accurate measurement is worth a thousand expert opinions.
Details: Internal REQ, External
Please submit your resume to exp-jobs at microsoft dot you know what