How-To-Avoid-Losing-Visitors-After-The-First-Visit

The AHA moment – How We Avoided Losing Visitors After The First Visit

How do you get users to fall in love with your product on their first visit? How you do avoid losing visitors on their first visit? Short answer.. you get them to the AHA moment..

There’s a lot of talk and literature about finding the AHA moment. James Currier from Ooga Labs (10 years, 10 companies with at least 10 million users each) and a personal hero of mine recommends spending 50% of technical resources on your onboarding or on what he calls the “first user experience”.

You’ll never have more attention from visitors than in that first visit to your website.

It’s up to you to onboard them step by step until they reach what has been dubbed this “AHA moment” also known as the “WOW moment”.  Here are some well know examples of AHA moments. It’s only when they have reached that point that visitors will understand the value you offer, will fall in love with you and will be able to explain your value to others. 

visitors-reach-the-aha-moment

Sounds perfect right? 

The only problem is, it’s often really difficult to know what your AHA moment actually is. Sure you could rely on your assumptions and run with your gut feeling. But as a data obsessed growth hacker I’ve seen too often how our assumptions and gut feeling turned out to be wrong. In this article I’ll try to address how we did this for our team collaboration tool Twoodo . How we were able to discover our AHA moment even though we didn’t have many visitors and little hard data or metrics to rely on.

The Hard truth about Hard Data

Over the years I’ve had countless discussions with other co-founders and growth hackers about finding the AHA moment. I’ve always found that companies with large amounts of visitors and data have an easier time of finding that moment than companies who have very little to work with. If you’re a successful company with millions of daily users of tens of thousands of customers then you can tap into your hard data to find what your AHA moment is. I would recommend hire a rockstar data scientist, give him access to all your logs and ask him to run correlation analysis on each of your features to determine which website events will most highly predict an activated user or a super user.

Unfortunately that’s a luxury that some of us don’t have. So how do you find the AHA moment when you don’t have a data rocket scientist at your disposal or enough data to feed his genius with. 

So we did it by hand..

It doesn’t take 100000 users to find your AHA moment. However you do need to have a few who really love you. If you’re at a point where you have 30 or more users/customers who truly love your product, come back to it at the right frequency, who you know are totally addicted, I will argue that you can find your AHA moment. Here’s how:

1. Identify the users:

At Twoodo we’re Mixpanel addicts. Mixpanel is a user-centric events based analytics tools that can give you invaluable information on what your users are doing on your website (you can also check out Kissmetrics). Basically it shows you what people are doing once they’ve arrived on your site.

Using a simple filtering query on Mixpanel’s Explore tab we were able to identify some “power users”. In this case I’m searching for all our visitors who signed up to our website, did this less than 4 weeks ago and who have already made at least 200 posts on Twoodo. In our experience this is a clear sign of an activated user who understands the value and is being retained by it

finding-your-aha-moment-identify-users

I was also careful to exclude all users who had been invited to Twoodo by a friend or colleague as their perception of our value would be positively biased.

finding-your-aha-moment-identify-users-2

I won’t show the results as there are some email addresses in there but the results came back with 42 profiles.

finding-your-aha-moment-identify-users-super-users

I consider these users to be “very activated” and I now want to find out if they have anything in common with their first visit.

2. Find out what’s happening on a user’s first journey

In the early days we used to do a raw dump of our logs and started analyzing these user’s first Twoodo visit step by step. This is what it looked like..it wasn’t fun.

reading-logs-to-find-your-aha-moment

After a few days of reading these we started planning to parse the logs into excel files to make the process less painful but Mixpanel saved us from having to do that. Another problem with this method is that it only tracked server-side events and couldn’t track browser events. But the idea in both cases is the same:

Recreate a visitor’s first journey step by step.

It’s a long and painful task but if done correctly you will start to see a pattern. 

Thanks to tools like Mixpanel and Kissmetrics though the visualization of these events is much clearer. The events have color codes and drop down menus with all the event characteristics. In this example you can see the intensity of usage of an activated user’s first day. This is a screenshot of the visitor flow of a new user in his first minutes and hours. By looking into each event you can understand the visitor’s first user journey.

finding-your-aha-moment-look-at-a-users-first-journey-with-mixpanel

3. Re-create the journeys

So the next step is to extract the important steps and log them somewhere. After re-creating his journey I found this :

  1. He signed up from the web version (not mobile)
  2. He added his first and last name
  3. He uploaded a profile image
  4. He completed the walkthrough
  5. He created a company and uploaded a company logo
  6. He posted 17 messages
  7. 9 of these messages included a task
  8. He viewed the calendar view
  9. He viewed the task view
  10. He added tasks to his calendar
  11. He customized his theme
  12. He logged back in 6 times in 3 days after his 1st visit.

And there.. I have one customer activation journey of a user that got to the AHA moment!!

I then proceeded to do the same thing for the 42 other “super activated users”. I opened a google doc spreadsheet and ran all these events into dedicated columns. Each column = 1 event. Here’s what part of it looked like:

finding-your-aha-moment-spreadsheet

4. Run this on visitors who didn’t get the AHA moment

After running through all 42 profiles I started to find patterns on events that kept coming back up. We found 7 events that almost all our super users had in common. Some of these, like customizing the theme or inviting other people on the first visit, were contrary to our assumptions. We then had a big talk which included a debate over correlation vs. causation. 

This lead us to do the exact same steps but with 50 users who were not activated at all.

We searched for users who had signed up but never came back or visitors who had used us for few days never to come back again. The idea is to compare the ”super activated users” with the lost “non-activated users” and see what the main differences are. 

5. Spot the difference

So what had the super users done that the “never to be seen again” visitors hadn’t?

We quickly had a precise picture of events that had been taken by activated visitors and left out by non-activated visitors.

finding-your-aha-moment-activated-versus-non-activated-events

1. They all invited at least 2 people on their first visit even before testing the tool (this was contrary to our assumptions).

2. They input their first and last name.

3. They uploaded a profile picture.

4. They almost all uploaded a company logo.

5. They created at least 5 tasks on their first visit.

6. They came back to the app 7 days consecutively at least.

7. They viewed the task and/or calendar view.

6. Build it into your website

Based on this information we created a B version of our onboarding that would guide new visitors through this journey, step by step and removing all the fluff and friction. They basically HAD to go through these steps.

We put the “invite people to your company” much higher in the funnel.

aha-moment-illustrations

We made sure visitors would input their first and last name

twoodo-onboarding-2

We created a gamified step by step task list once they arrived on the platform

twoodo-onboarding

7. A/B Test

We then ran a careful AB test to verify that we weren’t making a huge mistake. We let the test run for 3 weeks.

onboarding-ab-tests

The results were quite astounding. With the B version we have an increase in activated visitors of 75%. Not only that but new users were inviting 112% more people to the platform than before. They were also posting 139% more messages and tasks on their first visit. We later also found that activated users were also being retained longer*. 

*Of course we were careful to run these stats through a statistical significance calculator. Luckily enough A and B has such a difference in conversions that we didn’t need to run the test too long (2.5 weeks) to reach a significant test.

Follow me!

David Arnoux

I'm David Arnoux, co-founder of Twoodo. I write about growth hacking, startups and lean methodology. Come say hi on Twitter or on Google+
Follow me!

  • https://www.freedcamp.com Igor Kryltsov

    ” In this case I’m searching for all our visitors who signed up to our website, did this less than 4 weeks ago and who have already made at least 200 posts on Twoodo. In our experience this is a clear sign of an activated user who understands the value and is being retained by it” – may I ask how did you come to this conclusion? What happens to these users in 8, 12 and 16 weeks?

    Why not to look at teams rather than individual users?

    I guess, if you started logging events just 4 weeks ago there is no way you can look at a wider time span? This is why logging all events (views and actions) somewhere is as crucial as developing a product. Right?

    • David A.

      Hi Igor, Great points :)

      We later confirmed by finding that users who make 200 posts or more within the first 4 week had almost all been retained 2, 3 months later and had invited activated their teams within those first weeks.

      Agree that we should have concentrated on teams rather than individuals. That is what we do now. However back in those days we had just pivoted away from a personal productivity tool to a teams-based tool so we didn’t have a clear way of tracking individual teams.. the data was being polluted by user accounts with multiple teams and other issues.

      And yes I believe logging and tracking all events is crucial for product development. Then it’s a question of how to analyze that data!

      • https://www.freedcamp.com Igor Kryltsov

        Thanks for following up :) We are in the space and try to answer those same questions. Honestly I see no good info about it. Probably because such knowledge represents some competitive advantage…

        It is also good to remember that those not activated users probably were confused or haven’t found what they were looking for. Not matter how hard you push them to a desired funnel – they will leave. Here you have only one chance to find out – ask them why and basically use your own vision how to improve your product or how to pivot marketing message to attract different kind of users – those who will get it.

        Have you tried to look deeper to see different patterns in those who activated – say personal use vs. company use vs. home project (probably for you these will be different)?

        • David A.

          Yes we’re working on that! I think the #1 aspect to work on after nailing activation is the HOOK model to increase retention :)

  • Mani Karthik

    Great article David. Loved how you studied the green segment.

    Curious – Which channels attributed most to the green segment? Organic/Social/Brand searches?

    Perhaps there is a big picture segmentation that is missing here. Or perhaps I missed it.