5 Lessons Learned in a Lean Startup

January 18, 2012

Note: This post originally appeared on GreenhornConnect.com on February 23, 2011. I’m organizing all my customer development posts from GHC on here for easy reference (see the Lean Startups tab).

In honor of both the Lean Startup Circle Meetup on Thursday and the Lean Startup Machine coming this weekend, I’d like to share a few lessons I’ve learned in the past year as I’ve served as Customer Development Manager at oneforty and been actively learning the Lean Startups methodology.

5 Lessons Learned in a Lean Startup

1) Don’t ask what people would pay for. They lie.

Yes that’s right. Even Honest Abe wouldn’t have told you what he’d really pay for if you showed him a web app and asked what he’d pay for on top of what you showed.

Customers are terrible at explaining their problems and understanding the root issue. As the saying goes, the one certainty for a patient seeing a psychiatrist is that what the patient says is cause of their problems is never the actual problem.

Even I have lied. I was talking with Chris Keller about his awesome tool Followup.cc, which is an email reminder system, and I said, “I would pay to be able export all of my reminders to my Google calendar.”  Chris wisely also looked at engagement and based much of his pricing system on number of reminders, but he also put the calendar export in his paid version.  I am now a paying customer of Followup.cc but have yet to actually use the Google calendar system.

Did I intend to lie? Of course not. But it just goes to show the mindset you can get in and how far from the truth it can be. Don’t ask people what they’d pay for.

2) Nothing beats getting a customer to actually pay for something.

There is no better validation for your business than getting a user to actually pay for something.  Despite the true value of your time, few people actually account for this. That means they are actually quite likely to be willing to use your free product, while having no intention of ever paying for it.

Paying also moves you beyond the realm of being a favor; friends, acquaintances or just nice guys, no one will pay for your product unless it really solves a pain or strongly interests them.

As an added bonus, once someone pays for something, they have expectations. That means that their feedback will be stronger, because they gave you their money and now expect that you will deliver on what they hoped they were buying. This feedback is priceless, as building something that satisfies them can be built into the repeatable process that goes into a sales funnel.

3) You have to learn the customer’s language.

You may call your product anything you want but if it and the language you use to describe it doesn’t resonate with your customer, you’re unlikely to move forward.  You need to understand your customer’s language and make your product speak that language.

The best way to do this is to look at what words your customer uses to search for the problem you’re solving and, of course, the customer development interview. Remember, your customers should be doing 70-80% of the talking in your interviews.

4) A customer’s stating a problem is more valuable than a customer agreeing with a problem you present.

One of the key tenants of Lean Startups is that you’re solving a customer’s pain.  Often the question is if what you are building is a so called “Vitamin,” which is nice to have, or you’ve created a “Pain Pill,” which they definitely need.

One indicator of which side of the Vitamin/Pain Pill coin your product is on is how the problem that your product solves is surfaced. If in the middle of your interview (before you pitch your solution) the customer talks specifically about the problem you’re trying to solve, you have a much stronger indicator of pain than if you ask them if they are experiencing pain in the area you believe is a problem.

Now, this does not mean that someone who doesn’t come right out and say your problem isn’t a potentially valuable customer. However, when you’re looking for those early adopters (aka- earlyvangelists) you should be thinking about who most desperately needs your solution and that is likely people who have the problem you’re trying to solve on top of mind.

5) Be precise in your Hypotheses.

So you think you have a product solution that is the greatest thing since sliced bread? Great. But who is it for and how does it solve a key pain for them?

One of the risks in creating your lean startup is that you forget to get specific on your hypothesis. Don’t say “this is for doctors”; say “this is for pediatricians in suburban environments that have small, private practices.”

The reason you need to be specific is to avoid false indicators. If you don’t make your hypothesis specific, than you are very likely to talk to a wide range of people. When talking to this wide range, you may not find the interest you would otherwise if you specifically went after a specific group.  You could end up talking to a bunch of chiropractors and surgeons and never realize that the reason there was no interest in your product wasn’t that it’s not a great idea solving a problem; no one was interested because you weren’t talking to the right people.

There’s a seemingly endless amount to learn about Lean Startups, so no matter what stage you’re at just remember: Stick with it, Be patient and Don’t be afraid to ask for help.

There’s a great community on Twitter (look for hashtags #LeanStartups and #CustDev), many awesome blogs (Eric Ries, Ash Maruya, Dan Martell, David Cancel and many others) and of course great events (Lean Startups Circle) to help.


How to Structure (and get the most out of) Customer Development Interviews

January 18, 2012

Note: This post originally appeared on GreenhornConnect.com on August 3rd, 2011. I’m organizing all my customer development posts from GHC on here for easy reference (see the Lean Startups tab).

Running a startup puts a ton of responsibilities on your plate. From marketing to sales, ghetto-HR to accounting, development to project management, you’re wearing a million hats.  We all know that Lean Startups methodology and customer development are important, but *actually practicing* it can be hard (if you’re not familiar run to CustDev.com *right now* and get Brant and Patrick‘s book The Entrepreneur’s Guide to Customer Development ASAP!).

As you commit yourself to “getting outside the building” to talk to your customers and truly quest for Product-Market Fit, it’s essential you make the most of those discussions. One of the hardest things for newcomers to customer development is structuring their questions for customer development, so I’d like share how I structure interviews to maximize their effectiveness.

How to Structure (and get the most out of) Customer Development Interviews

A few others have written about how they do interviews, so definitely check out Cindy Alvarez and Sachin Aggarwal’s thoughts on the subject. 

I structure my custdev interviews in 3 parts – People, Problems, and Your Solution. Depending on the person, this question flow generally takes me 30-45 minutes to go through. (Note: This structure is best suited to B2B customer development, but with a little creativity, you can definitely adapt this for B2C interviews)

1) People – Aka – Who Are You?

Before you get into anything about problems or your solution, you need to figure out who you’re actually talking to. This both warms up your interviewee with some softball questions and gives you an opportunity to build some rapport with them.

Some example questions you could ask:

  • What is your name and role at your company?
  • How do you fit into your company’s department structure? Overall in the company?
  • What is your budget like? Who has to approve your purchases?
  • How do you discover new products for work? Do you need any approval to try them?
  • Have you tried anything new recently?
  • What is a typical day like on your job?
  • How much time do you spend doing [task X]? (Task X being anything they mentioned in their typical day that stood out)

Do not shortchange this opening section of questions! You don’t need a novel on their daily life, but you *do need* enough to be able to understand their role within their company, who key players are and a general baseline of their sophistication. All of this will help you later pattern match who the user type that is most receptive to the problem you’re solving and the solution you offer.

2) Problems – Aka – What are your greatest pains?

This section is where you try to find out whether the person has the problem you believe you’re solving.  Your goal is to not lead them to your problem. The less you lead them while still hearing your problem being mentioned the more validation you have!

Some sample questions you could ask:

  • What are your top 3 challenges you face in your job?
  • What are your top 3 challenges you face in your job related to [industry X]? (Industry X being the one your startup is in)
  • If you could wave a magic wand and instantly have a solution to any of those problems…what would the solution be?
  • Dig deeper into their typical day on anything that sounds painful or expensive. (You can add some hyperbole here to get them to rant a bit by saying things like “that sounds inefficient…” or “that sounds expensive…”)
  • How have you dealt with or solved [Problem X]? (You’re looking to find out if they’ve hacked a solution together themselves. If they have…ask for a copy of it!)

People love to talk about themselves, so let them go nuts here and really rant about their problems (i.e.- Shut up and listen!).  Generally, people are terrible at proposing solutions, but you want to hear generally what they envision as solutions or see what they’ve cobbled together themselves.

Notice, you haven’t mentioned your solution or problem yet. If they don’t mention your problem specifically, then as you finish this section of questioning, you should directly ask them if what you think is a problem is a problem for them. Whether they agree it’s a problem or not, you want to then probe why it wasn’t one of their top problems.

3) Your Solution – Aka – See if your idea survives customer interaction

If in your discussions in part 2 your problem you think you’re solving comes up naturally from your interviewee you’re on the right track! Bonus points if the way they describe solving it with their “magic wand” remotely resembles what you’re doing.

No matter what happens in part 2 you should discuss with them what you thought the problem was and what your solution is. Getting validation that they wouldn’t be interested in the idea is just as helpful as finding out they love it; either they’re not a customer or you are learning what your customers want instead of it.

Some sample questions you could ask:

  • Walk them through the problems you believe your solution solves. Do they agree?
  • Does [your solution] solve any of their problems?
  • Would you be willing to pay for our solution? How much? (Don’t be afraid to probe for the pricing you know you want…”Would [X] be reasonable?”)
  • If they’re willing to pay your price and like the idea then…”Would you be willing to start right away?”

If all goes well and you really are solving a pain, then your customer should want access to the product right away. More likely, you’re going to learn a ton about what they do and do not want and your idea will begin evolving.

This basic structure can carry you a long way towards some great validated learning about your idea and the market’s desire for it.

A few last things to remember:

1) Take Good Notes or Record Everything!

- Once you’ve interviewed 8-10 people, you should be going back over all of your notes and look for patterns. This includes especially looking for patterns in the Part 1 section to see what all the people that agree you are solving their problem have in common. You should summarize your notes then and share with your team.

2) Have other team members sit in on some interviews

- A good customer development focused company will have everyone involved in the process. Performable, pre-HubSpot acquisition, had their engineers spending 30% of their time on the phone with customers. Nothing helps someone do their job better like understanding who they’re building/selling/marketing for.

3) Be conversational

- It shouldn’t feel like an interview! They should feel like they’re just having a conversation with a friend about their problems at work. The more comfortable they feel with you, the more they will open up.

4) Go off script

- The best stuff comes when you dig a little deeper on something that strikes a chord in the discussion.  The script is there to be your roadmap, but there’s no reason you can’t return to it after a 5 minute digression about a specific pain or discovery about how the company operates.

5) If they’ve made an MVP…ask to see it!

- Nothing gives you more insight to a customer than what they’ve hacked together themselves to solve a problem. The best thing you can do is ask to see it, which will give you an idea of what they’re hoping a solution will provide. These people are also the strongest candidates to be great, helpful early adopters of your product.

6) Always follow up

- It’s just common courtesy to thank people for their time and help, but it also opens the door to follow up with them in the future if your product changes and is a fit for them or to invite them to your beta.

7) End with an ask

- Always end your interviews by thanking them and asking them for something. It may be to get a copy of their MVP or even better, ask for an intro to someone they know that might be interested in what you’re working on. In my experience, these intros have an 80-90% success rate in becoming new customer development interviews, whereas cold emails only have a 10% success rate.

8) Be open to new problems! That’s how great products are born.

- As Steve Blank has said, “No idea survives first interaction with a customer.” Don’t be afraid to shift your focus from your first idea to what you’re actually hearing customers want.  If you probe in part 2 and find a burning problem…find out how they currently solve it and what they’d pay to solve it.

In the end, you want to find a “hair on fire” problem, not a “nice to have problem.”  Think about it this way: If my hair is on fire (literally), and you’re selling buckets of water, I’m definitely going to buy your product. But if I’m cold and wet, I’m not likely to buy your bucket of water right now, but would consider it in the future.

Find customer pain and a solution they desire and will pay for. Rinse. Repeat.

What advice do you have for entrepreneurs doing customer development interviews?


Don’t build that feature! How to use the 5 Why’s to learn what your customer really is saying

January 6, 2012

This post originally appeared on Greenhorn Connect here; I’m housing posts on my blog here as well for easy reference.

Whether you interview customers regularly, watch support requests on HelpScout or use a GetSatisfaction or UserVoice – like tool, your startup is inundated with feature requests from your customers.  It’s great to have them engaging, but can lead to the dreaded “feature creep” that leads to a bloated, unusable product. What’s a startup to do? The answer may surprise you in its simplicity: use the 5 Why’s.

Don’t build that feature! How to use the 5 Why’s to learn what your customer really is saying

In case you’re not familiar, the concept of 5 Why’s is that by asking a person a series of “why” questions, you can get to the real root cause of an issue. Commonly, the issue can be used to do analysis of technical failures as outlined in a great post by Eric Ries found here. However, this can be just as powerful when you apply it to discussions with customers about features.  The power comes from saving you from building things customers actually don’t want or need and surfacing what is really important.

This concept really crystallized for me when I had an experience talking to Chris Keller, the founder of email reminder tool, Followup.cc. I was an active user, but Chris hadn’t decided how to monetize yet. I told him I’d pay for Followup if he provided a calendar to see all my Followup reminders.

There’s just one problem – despite the fact that Chris built that feature not long after our discussion, I’ve never used the calendar even though I am a paying customer because of the core product.

Chris could have avoided building the feature if he had used the 5 Why’s. Here’s how it may have gone.

Me: I’d pay for Followup if you provided a calendar to see all my Followup reminders.

WHY #1: Chris: Why would that make you pay for it?

Me: Because I could then see all the Reminders I’ve set up.

WHY #2: Chris: Why do you want to see all the reminders you’ve set up?

Me: So that I know when I have reminders coming up.

WHY #3: Chris: Why do you want to know when you have reminders coming up?

Me: So I’m sure I know when I should expect a bunch of reminders.

WHY #4: Chris: Why do you need to know when you should expect reminders?

Me: (long pause) …So I’m sure I get all my reminders.

WHY #5: Chris: Why wouldn’t you get all your reminders?

Me: Good question. I guess I’m worried about it not always working.

Chris: Don’t worry. I’ve built Followup to be robust and reliable. Are you sure you need that calendar?

Me: Maybe not.

Your results may vary, but the point is, customers are terrible at coming up with solutions. What they are good at is sharing their problems, which you can solve. The key is to interact with them in a methodical way to get to the heart of what they really need.  Next time you hear from a customer that you need to build a new feature…ask them the 5 Why’s first!


West Coast Differences – Non Startup Edition

December 13, 2011

I just took a trip to the Valley for the first time. I’ve had a lot to say about it from the perspective of an entrepreneur (see on Greenhorn Connect here and at OnStartups here). I also noticed quite a few things that have nothing to do with startups that I found culturally interesting.

1) Everyone is nice

Boston can be a cold place, and no I’m not talking about the weather. In general, you just don’t find people being friendly walking down the street, and you definitely don’t see it on the road.

One event really tipified this for me: I had just made it out of a parking garage before close. Because of this I didn’t have time to set my GPS before hitting the road. There was no where to park so I pulled off blocking a driveway. As I was engrossed in entering my destination address into my Garmin, an SUV started honking at me; they needed in the driveway. I of course complied.

What happened next shocked me. The woman parked her car, got out and walked over to where I had pulled off slightly up the street. When I put down my window, she apologized for honking her horn at me. 

2) Everyone weighs 15 pounds less

It’s hard to believe until you see it. Everyone is just in slightly better shape than I see them in Boston. It’s a visual average I noticed after a few days.

I think the cause of this is pretty simple. Nice weather = more time outdoors = more exercise. What kills us (even a gym rat like me) are these brutal winters. It’s really hard to get enough cardio in under those circumstances which means every winter you’re putting on a little weight. Add that up over a winter or two and you quickly get those 15 pounds.

3) The Valley has safer drivers

I’ll be totally honest: after not driving for 7.5 years, I’m a pretty terrible driver. Luckily, people in the Valley drive slower on the highways (around 65 instead of 80) and well, they aren’t MassHoles. They actually use things like turn signals and let people over when they do signal. It was refreshing and the only reason I got back to Boston in one piece.

4) Parking is a breeze outside SF

There’s easy parking in Mountain View and Palo Alto. Even downtown. And it’s free. I was terrified when I forgot to bring quarters with me on my trip and was pleasantly surprised to find that I didn’t need them.

5) Their public transportation is good, but flawed too

We all have our gripes with the MBTA but it gets you where you need to go….usually. The SF system is the same. Their buses are slightly unreliable, but have some drawbacks: the stops often smell of urine and the back part of every bus is covered in graffiti. Meanwhile, the CalTrain is incredible. Like a well oiled machine, the trains fly through the Valley right on schedule.

The best part of their system is they’ve tied it all together on one master card (their version of the Charlie Card). The Clipper Card, as they call it, was the only thing I needed and was easy to pick up at a station.

6) They have a serious homeless population

I found out while I was there that SF has the largest homeless population in the country and for some ridiculous reason they give each of them $400 a year (as if the year round good weather wasn’t attractive enough for the homeless).  I think this is a likely contributor to the bus stop urine smell.

These are just a few of the random differences I noticed in comparing the cities of Boston and SF and the Valley vs. New England.  Have you been both places? What have you noticed as a difference?


Visiting the Valley Next Week

November 27, 2011

Late in the summer, I wrote about how I thought startups should be “Tricoastal.” What I meant was that you can benefit greatly from having a presence in Boston, New York City and Silicon Valley.   I’ve made a number of visits to New York City in the past 6 months, but have yet to make a real visit to the Valley. It’s finally time to change that.

December 3rd through 8th I’m going to be visiting Silicon Valley.

In order to make the most of it, I plan to spend a little time in 3 of the major hubs: San Francisco, Palo Alto and Mountain View.

If you’re reading this, I’d love to meet up and/or hear your advice on things I can’t miss during this visit. I really want to get a feel for what it’s like out here, what makes the Valley tick and as many of the places that make the Valley special as possible.  I’m also working on a lean product management tool, so if you know any product people I should meet, let me know!

I’ll be in San Francisco: Saturday evening, 12/3 to midday Monday 12/5

I’ll be in Palo Alto: midday Monday 12/5 to midday Wednesday 12/7

I’ll be in Mountain View: midday Wednesday 12/7 through Thursday 12/8

I have places to crash in Palo Alto and Mountain View, but I’m still looking for a place to crash in SF on Saturday and Sunday nights.  If you’ve got a couch, please let me know!

So, what do I need to check out while in town?


Follow

Get every new post delivered to your Inbox.