article thumbnail

Conservation of Intent: The hidden reason why A/B tests aren’t as effective as they look

Andrew Chen

This is why you can’t add up your A/B test results. If you’re at a company that A/B tests everything and then announces the great results – that’s wonderful, of course, but just run the thought experiment of summing together all of those A/B tests. Rarely does it match.

article thumbnail

2018 essay collection on growth metrics, marketplaces, viral growth in the enterprise, and more (PDF included)

Andrew Chen

The red flags and magic numbers that investors look for in your startup’s metrics – 80 slide deck included! The deck unpacks a lot of different topics: How “growth accountingmetrics are great, but are lagging indicators. DAU/MAU is an important metric to measure engagement, but here’s where it fails.

Metrics 80
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

Performance Appraisal Systems: Everything You Need to Know

15Five

The objective is what the business or employee wants to achieve, and the key results are measurable metrics that show how well the business or individual is accomplishing the objectives. Involving employees in setting OKRs helps buy-in, accountability, and ownership of the objectives. It can also discourage risk-taking and innovation.

Scaling 52
article thumbnail

2018 essay collection on growth metrics, marketplaces, viral growth in the enterprise, and more (PDF included)

Andrew Chen

The red flags and magic numbers that investors look for in your startup’s metrics – 80 slide deck included! The deck unpacks a lot of different topics: How “growth accountingmetrics are great, but are lagging indicators. DAU/MAU is an important metric to measure engagement, but here’s where it fails.

Metrics 40
article thumbnail

The 3 Pillars of an Effective Data Management Strategy: Monitoring, Tracking, and Reporting

SME Strategy

For instance, in Marketing, data is being used to calculate ROI on marketing campaigns, or come up with new pricing strategies based on A/B testing of campaigns which helps marketing and managers bring in more revenue, and stay ahead of the competition. Need help with your strategic planning process? Why not both?

article thumbnail

How to design a referral program

Andrew Chen

Perhaps you do an analysis and figure out certain leading characteristics of high-value users as their account balance, or the types of other apps they use, or otherwise — once you think of this as personalizing an ephemeral offer to users, then you can run whatever promotions you want. But why stop at cities? The Payback.

article thumbnail

11 Awesome Patty McCord Quotes in Powerful about Building a Great Culture at Netflix

Get Lighthouse

Is it publishing your revenue metrics so the whole world can see it? So they let the data do the talking and ran an A/B test. If you want a culture of candor and accountability, you may want to consider simple, direct feedback, too. A word like "Transparency" can feel loaded these days. 8) Great hiring is hard work.

Manager 98