article thumbnail

Conservation of Intent: The hidden reason why A/B tests aren’t as effective as they look

Andrew Chen

This is why you can’t add up your A/B test results. If you’re at a company that A/B tests everything and then announces the great results – that’s wonderful, of course, but just run the thought experiment of summing together all of those A/B tests. Rarely does it match.

article thumbnail

2018 essay collection on growth metrics, marketplaces, viral growth in the enterprise, and more (PDF included)

Andrew Chen

The red flags and magic numbers that investors look for in your startup’s metrics – 80 slide deck included! The deck unpacks a lot of different topics: How “growth accounting” metrics are great, but are lagging indicators. DAU/MAU is an important metric to measure engagement, but here’s where it fails.

Metrics 80
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

2018 essay collection on growth metrics, marketplaces, viral growth in the enterprise, and more (PDF included)

Andrew Chen

The red flags and magic numbers that investors look for in your startup’s metrics – 80 slide deck included! The deck unpacks a lot of different topics: How “growth accounting” metrics are great, but are lagging indicators. DAU/MAU is an important metric to measure engagement, but here’s where it fails.

Metrics 40
article thumbnail

How to design a referral program

Andrew Chen

CEO/cofounder Drew Houston’s made a very helpful presentation describing his journey towards referral programs, and the general trajectory was the following: First, do all the things you’re “supposed” to do. In the end, probably just worth A/B testing to see what works best. The Payback.

article thumbnail

10 Practical And Effective Change Management Tools And Resources In 2022

Walk Me

Understanding change management principles helps managers present change to staff in a helpful way, allowing them to see transformation as positive and easy to integrate into a new routine. With the ever-changing shape of technology and the resulting call for technology adoption , change is an ever-present part of all business processes.

article thumbnail

The red flags and magic numbers that investors look for in your startup’s metrics – 80 slide deck included!

Andrew Chen

Of course, as an investor you can’t run A/B tests or analyze results directly, but you can form hypotheses, ideate, and apply the same type of thinking. Disclaimer: This was just one presentation in a 10 year relationship. Thinking about new user experience, engagement metrics, and other important concepts.

Metrics 111
article thumbnail

Consumer startups are awesome, and here’s what I’m looking for at a16z (70 slide deck)

Andrew Chen

I presented all of this at the Andreessen Horowitz Summit in 2018, which gathers our portfolio companies, partners, LPs, and close friends. Another note is that this is closely related to, and complimentary, to this deck: The red flags and magic numbers that investors look for in your startup’s metrics. My investing thesis.

Media 100