SlideShare a Scribd company logo
1 of 29
Download to read offline
LESSONS LEARNED
           Andres Glusman
  VP, Strategy & Community Meetup
Co-organizer: NYC Lean Startup Meetup

       AGILEUXNY - FEB 2012




                                        @glusman
Accidental Lean Startup

1)  Agile development with multiple pushes per day

2)  Extensive customer development
Customer Development
3)  Experiment then double down




                                                     @glusman
     2
On pace to do 600-800 usability sessions this year

             Will cost around $30,000
    (less than 1 outsourced usability project)




                                                     @glusman
Test 2-3 days a week (t, w, th)

    Setup tests prior to knowing what will be tested

Recruit participants from community and through recruiter
                (compensate for their time)

  Use gotomeeting to broadcast sessions to developers

                Use silverback to record

   Follow each session with discussion & notes/video


                                                        @glusman
MALKOVICH BIAS:
THE TENDENCY TO BELIEVE THAT EVERYONE
     USES TECHNOLOGY LIKE YOU DO


                                   @glusman
                                @glusman
Watching people use the stuff you
build, is the best way to confront
the Malkovich Bias




                                 @glusman
Shifts the conversation from
how I would use the website to
how this user uses the website



                             @glusman
“This Group
                                            meets the first
                                             Saturday of
“This Group                                 every month “
meets the first
 Saturday of
every month “




        “This Group
        meets the first   “This Group
         Saturday of      meets the first
        every month “      Saturday of
                          every month “




                                                              @glusman
Testing on our DIY iPhone Rig

                     Similar approach to
                     iPhone testing




                                      @glusman
Lean Startup

1)  Agile development with multiple pushes per day

2)  Extensive customer development

3)  Experiment then double down
Experiment then double down



                                                     @glusman
     10
11
     @glusman
12
     @glusman
13
     @glusman
Experimenting is more
than A/B Testing



                    @glusman
Long term experiments

     Community Coaching
     Every new Organizer on Meetup has a
     coach on the community team & gets
     personalized emails from their coach with
     advice they need based on their situation




15
                                                 @glusman
How’s work?




16
              @glusman
How’d we get here?



                     Only greeted
                     80% of new
                     Organizers




17
                                    @glusman
Results


     No change!

          Except….




18
                     @glusman
Implemented across the board




19
                               @glusman
Customer Development lessons learned
1.  Give team direct access to customers
2.  Look for boulders in the road
3.  Substitute frequency for precision
4.  Strip out costs wherever possible
     …but be willing to trade money for time
5.  Have discussions
6.  Launch & learn
7.  Accept that failure is most likely outcome
8.  Experiment then double down
                                                 @glusman
21
     @glusman
22
     @glusman
PROCESS



23
               @glusman
Just started doing it




                        @glusman
Snuggle up with failure




                          @glusman
WHAT WOULD YOU
DO IF YOU ASSUMED
YOU WOULD FAIL?




               @glusman
RUN INTO A BUZZ SAW AS FAST AS WE CAN




                                  @glusman
GO AFTER THE THINGS THAT
WILL CAUSE US TO FAIL AS
FAST AND OFTEN AS WE CAN




                           @glusman
Drop me a note


Andres Glusman
andres@meetup.com
@glusman




29
                    @glusman

More Related Content

Viewers also liked

Skill Building For Design Innovators
Skill Building For Design InnovatorsSkill Building For Design Innovators
Skill Building For Design InnovatorsSteve Portigal
 
Framing Behavior Design
Framing Behavior DesignFraming Behavior Design
Framing Behavior DesignChris Risdon
 
Lean Usability
Lean UsabilityLean Usability
Lean Usabilityglusman
 
Inspiring Creativity - EPIC 2011 - Lextant
Inspiring Creativity - EPIC 2011 - LextantInspiring Creativity - EPIC 2011 - Lextant
Inspiring Creativity - EPIC 2011 - LextantLextant
 
Introducing design thinking
Introducing design thinkingIntroducing design thinking
Introducing design thinkingZaana Jaclyn
 

Viewers also liked (8)

Lean Usability
Lean UsabilityLean Usability
Lean Usability
 
Skill Building For Design Innovators
Skill Building For Design InnovatorsSkill Building For Design Innovators
Skill Building For Design Innovators
 
Framing Behavior Design
Framing Behavior DesignFraming Behavior Design
Framing Behavior Design
 
The UX of Social Media
The UX of Social MediaThe UX of Social Media
The UX of Social Media
 
Lean Usability
Lean UsabilityLean Usability
Lean Usability
 
Inspiring Creativity - EPIC 2011 - Lextant
Inspiring Creativity - EPIC 2011 - LextantInspiring Creativity - EPIC 2011 - Lextant
Inspiring Creativity - EPIC 2011 - Lextant
 
Introducing design thinking
Introducing design thinkingIntroducing design thinking
Introducing design thinking
 
Parcours
ParcoursParcours
Parcours
 

Recently uploaded

Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Commit University
 
Story boards and shot lists for my a level piece
Story boards and shot lists for my a level pieceStory boards and shot lists for my a level piece
Story boards and shot lists for my a level piececharlottematthew16
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 3652toLead Limited
 
How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.Curtis Poe
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brandgvaughan
 
CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):comworks
 
Scanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsScanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsRizwan Syed
 
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsPixlogix Infotech
 
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage CostLeverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage CostZilliz
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Scott Keck-Warren
 
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Mattias Andersson
 
Powerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time ClashPowerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time Clashcharlottematthew16
 
Advanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionAdvanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionDilum Bandara
 
H2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo Day
H2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo DayH2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo Day
H2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo DaySri Ambati
 
Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Manik S Magar
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfAddepto
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebUiPathCommunity
 
Artificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxArtificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxhariprasad279825
 
SAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptxSAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptxNavinnSomaal
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsMark Billinghurst
 

Recently uploaded (20)

Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!
 
Story boards and shot lists for my a level piece
Story boards and shot lists for my a level pieceStory boards and shot lists for my a level piece
Story boards and shot lists for my a level piece
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365
 
How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brand
 
CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):
 
Scanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsScanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL Certs
 
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and Cons
 
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage CostLeverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024
 
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?
 
Powerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time ClashPowerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time Clash
 
Advanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionAdvanced Computer Architecture – An Introduction
Advanced Computer Architecture – An Introduction
 
H2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo Day
H2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo DayH2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo Day
H2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo Day
 
Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdf
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio Web
 
Artificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxArtificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptx
 
SAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptxSAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptx
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR Systems
 

AGILE UX NYC - Lessons Learn

  • 1. LESSONS LEARNED Andres Glusman VP, Strategy & Community Meetup Co-organizer: NYC Lean Startup Meetup AGILEUXNY - FEB 2012 @glusman
  • 2. Accidental Lean Startup 1)  Agile development with multiple pushes per day 2)  Extensive customer development Customer Development 3)  Experiment then double down @glusman 2
  • 3. On pace to do 600-800 usability sessions this year Will cost around $30,000 (less than 1 outsourced usability project) @glusman
  • 4. Test 2-3 days a week (t, w, th) Setup tests prior to knowing what will be tested Recruit participants from community and through recruiter (compensate for their time) Use gotomeeting to broadcast sessions to developers Use silverback to record Follow each session with discussion & notes/video @glusman
  • 5. MALKOVICH BIAS: THE TENDENCY TO BELIEVE THAT EVERYONE USES TECHNOLOGY LIKE YOU DO @glusman @glusman
  • 6. Watching people use the stuff you build, is the best way to confront the Malkovich Bias @glusman
  • 7. Shifts the conversation from how I would use the website to how this user uses the website @glusman
  • 8. “This Group meets the first Saturday of “This Group every month “ meets the first Saturday of every month “ “This Group meets the first “This Group Saturday of meets the first every month “ Saturday of every month “ @glusman
  • 9. Testing on our DIY iPhone Rig Similar approach to iPhone testing @glusman
  • 10. Lean Startup 1)  Agile development with multiple pushes per day 2)  Extensive customer development 3)  Experiment then double down Experiment then double down @glusman 10
  • 11. 11 @glusman
  • 12. 12 @glusman
  • 13. 13 @glusman
  • 14. Experimenting is more than A/B Testing @glusman
  • 15. Long term experiments Community Coaching Every new Organizer on Meetup has a coach on the community team & gets personalized emails from their coach with advice they need based on their situation 15 @glusman
  • 16. How’s work? 16 @glusman
  • 17. How’d we get here? Only greeted 80% of new Organizers 17 @glusman
  • 18. Results No change! Except…. 18 @glusman
  • 19. Implemented across the board 19 @glusman
  • 20. Customer Development lessons learned 1.  Give team direct access to customers 2.  Look for boulders in the road 3.  Substitute frequency for precision 4.  Strip out costs wherever possible …but be willing to trade money for time 5.  Have discussions 6.  Launch & learn 7.  Accept that failure is most likely outcome 8.  Experiment then double down @glusman
  • 21. 21 @glusman
  • 22. 22 @glusman
  • 23. PROCESS 23 @glusman
  • 24. Just started doing it @glusman
  • 25. Snuggle up with failure @glusman
  • 26. WHAT WOULD YOU DO IF YOU ASSUMED YOU WOULD FAIL? @glusman
  • 27. RUN INTO A BUZZ SAW AS FAST AS WE CAN @glusman
  • 28. GO AFTER THE THINGS THAT WILL CAUSE US TO FAIL AS FAST AND OFTEN AS WE CAN @glusman
  • 29. Drop me a note Andres Glusman andres@meetup.com @glusman 29 @glusman