Optimization Analyst (A/B Testing)

Staples - Lincolnshire, IL

Hypothesis assessment & Test results analysis (40%)
• Hypothesis validations – Participate in hypothesis generation process and clearly validate opportunities/recommend actions that can have positive improvements in the firm’s site experience and financials; help stakeholder teams to think about site opportunities in a different way by asking questions; provide feedback to stakeholders to influence test ideas that will yield the most impactful customer experience improvements on the site.
• Calculate traffic allocation – Understand traffic baselines for pages being tested, identify traffic required to achieve significance; effectively use page traffic for various concurrent tests
• Define Test KPIs – Identify conversion and engagement KPIs needed for test analysis and understand test setup and data collection standards within test environment
• Test analysis – Drive proper AB or multi-variant testing analysis with statistical rigor and perform cohort studies to answer “why?” on test result drivers. Support more complex tests from an analytical and reporting perspective
Insights & Test results communication (40%)
• Deliver insights – Objectively deliver testing insights and help create a culture of data-driven decision making.
• Tell Story – At completion of Tests, build timely, compelling, fact-based test recaps that strongly communicate the business ‘story’ behind the data and lead Test outcomes
• Communicate results – Identify successes, failures, trends and effectively communicate these findings to the organization. If test results are positive – analyze KPI improvements in pre/post AB test roll-outs; if results are negative – perform driver analysis to recommend next iteration of that test
• Summarize weekly test result findings and communicate actionable recommendations to stakeholders and executives.
Partnering & Influencing (20%)
• Establish strong working partnerships with relevant areas of the business and global teams (Marketing, Merchandising, Product Management, Engineering, UX)
• Collaborate with cross functional partners to develop clear and measurable business and testing objectives and define test KPIs (both financial and engagement metrics)
• Act as a key liaison with Global stakeholders with respect to AB test analysis framework

Experiences/Requirements:

• Minimum 3-5 years of AB testing or site optimization, usability analysis, and/or web analytics experience supporting analysis or in a related data analytics field (financial analysis, digital analysis, statistical modeling)

• Bachelor’s degree in business administration, finance, mathematics, economics, or in a quantitative discipline; Master’s degree preferred

• Experience with web analytics, AB testing or site optimization will be ideal

• Solid understanding of online analytics metrics and related statistical concepts. Experience with web analytics tools (such as Adobe SiteCatalyst / Omniture, Google Analytics); A/B or Multi-variant testing tools (such as Adobe Target, SiteSpect) and statistical analysis package such as R,SAS or SPSS is a must.

• High-level proficiency with SQL based query languages and relational data concepts and Microsoft Excel is a must

• Excellent analytical skills – ability to understand and interpret data within the context of the AB testing – solve problems and distill data into actionable recommendations.

• Excellent communication skills – this position requires confidence in directly working with senior leaders in the organization and will be tasked to communicate complex test results findings and recommendations persuasively, in a compelling and easy to understand manner

• Demonstrated ability to work with cross-functional teams; independently and proactively

• Intellectual and analytical curiosity – initiative to dig into the “why” of various results

• Excellent project management skills including the ability to formulate and identify key performance indicators for tests and drive detailed test results.

• Flexible and responsive, ability to prioritize multiple tasks, reprioritize as needed and work with a sense of urgency to meet deadlines in a fast-paced, dynamic work environment

Ideal Candidate has experience with:

• Bachelor’s degree in business administration, finance, mathematics, economics, or in a quantitative discipline; Master’s degree preferred

• Minimum 3 years of AB testing or site optimization, usability analysis, and/or web analytics experience supporting analysis or in a related data analytics field (financial analysis, digital analysis, statistical modeling)

• Hands-on experience in statistical analysis package such as R, SAS or SPSS; high-level proficiency with SQL based query languages; relational data concepts and Microsoft Excel is a must

• Excellent analytical & communication skills – ability to understand and interpret data within the context of the AB testing – initiative to dig into the “why” of various results; communicate complex test results findings into actionable recommendations

Staples is an Equal Opportunity Employer.  All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, protected veteran status, disability, or any other basis protected by federal, state, or local law.

---

Posted: 30+ days ago

Apply Now