The document discusses the "test pyramid" concept for balancing test suites from unit to end-to-end tests. It provides examples of different types of tests including unit tests, integration tests, UI/end-to-end tests. It also discusses challenges with different types of tests and strategies for addressing those challenges including dependency injection, mocks, and tools like Cucumber, Robolectric, and Pacto. The document seeks feedback on testing approaches and provides additional resources on testing best practices.

1. The
Test
Pyramid
Thiago Ghisi
@thiagoghisi
How to balance your test suite to
have a good feedback, from units
to end-to-end tests.

4. 2002
2007
2010

5. [
Tests, seriously? It’s a mobile app...
]

7. 108
Shared codebases

8. 144
Devs, QAs and Ops

9. January, 2009
Brian Marick
@marick
http://www.slideshare.net/jezhumble/creating-maintainable-automated-acceptance-tests

10. October, 2009
Mike Cohn
@mikewcohn
http://www.slideshare.net/jezhumble/creating-maintainable-automated-acceptance-tests

11. http://www.slideshare.net/jezhumble/creating-maintainable-automated-acceptance-tests

12. August, 2010
Jez Humble
@jezhumble

14. Feedback

15. [
Perfect!!! Let’s follow the test pyramid
guidelines…
]

19. easy. :-)
really hard to isolate
the dependencies. :-(
20% of code
coverage. :-(

20. Functional
Tests
•
UI/End-to-end testing [with full stack]
•
Tests user flow
•
BDD, ATDD
•
Feedback after a coffee
sounds perfect
business likes that ;)

21. Cucumber feature file

22. Honeydew steps

23. Cucumber
+
Honeydew
step definitions in Ruby
wraps UIAutomator
=
]
https://github.com/amplify-education/honeydew
☺

24. why
cucumber?
https://speakerdeck.com/nicholaspufal/why-bdd-is-misunderstood

25. [
Cool.. write as much user-like tests
as you can… PERFECT!!
]

26. UI test results history (1)

27. UI test results history (2)

28. UI test results history (3)

29. Slow
Flaky / Fragile
Costy

30. Feedback

31. the build monkey

32. http://watirmelon.com/tag/software-testing-pyramid/

33. Few UI tests

34. [
OK… let’s do it right now…
]

35. Unit Test
•
Verify small pieces individually
•
Run fast
• Stable
•
Run a lot of times during development
•
Feedback instantly

36. Unit tests results history

37. Feedback

38. Android? It’s Java, let’s TDD.

39. Android TDD
Android SDK classes are not trivial
huge API
eyes on docs
java.lang.RuntimeException: Stub!

40. test object
result()
assert(expected, obj.result())
Humm,
I’ve seen that..
The ‘2 + 2 = 4’
example!

41. the object u’re looking at
dependencies

42. getData()
saveSomething()

43. when(stub.getData()).thenReturn(data)
getData()
saveSomething()
verify(mock).saveSomething()

44. mock
fake double stub
dummy
http://martinfowler.com/articles/mocksArentStubs.html

45. Unit Tests
with
Dependency
injection
Roboguice
DI
Mocks
Robolectric
Android Shadows
jUnit
@Test

46. Lots of Unit tests

47. Where are you?
http://www.mountaingoatsoftware.com/blog/the-forgotten-layer-of-the-test-automation-pyramid

48. http://fabiopereira.me/blog/2012/03/18/introducing-depth-of-test-dot/

49. backend
external services
libs

50. API contracts validation
PACTO
https://github.com/thoughtworks/pacto
https://speakerdeck.com/marcosccm/evoluindo-ecossistemas-com-consumer-driven-contracts

51. Service/Integration
tests instead of
end-to-end tests

52. [
Annnnd.. the manual tests?
]

54. Session based
exploratory/usability
tests

55. http://blog.kalistick.com/Agile/harden-testing-pyramid/

56. http://watirmelon.com/2011/06/10/yet-another-software-testing-pyramid/

57. http://blog.softed.com/2013/08/26/1883/

58. Test automation
closer to
the user
Testing on the
level of the users incl. browser,
network,
databases,
external systems,
…
User
Journey
UI
Connection of UI
tests to a
persona like flow
through the
system
$$$
slower
fewer
Integration
Tests of multiple integrated method
Unit
Tests of single methods without dependencies
$
faster
more
closer to the
developer
https://my.thoughtworks.com/docs/DOC-21002

59. http://www.slideshare.net/nashjain/inverting-the-testing-pyramid

60. http://www.slideshare.net/guestc8adce/pivotal-labs-open-view-presentation-quality-assurance-and-developer-testing-presentation

61. http://blog.codeclimate.com/blog/2013/10/09/rails-testing-pyramid/

62. Feedback

63. Feedback

64. http://herdingcats.typepad.com/my_weblog/2011/02/a-radical-book.html

65. Thank you! ;)
Questions?
Feedback?
A beer?
THIAGO GHISI
@thiagoghisi
tghisi@thoughtworks.com