Как оптимизировать тестирование мобильных приложений
•Download as PPTX, PDF•
1 like•1,856 views
Доклад Таисии Рыбак на SQA Days-15. 18-19 апреля, 2014, Москва. www.sqadays.com
Recommended
Recommended
More Related Content
What's hot
What's hot (20)
Similar to Как оптимизировать тестирование мобильных приложений
Similar to Как оптимизировать тестирование мобильных приложений (20)
More from SQALab
More from SQALab (20)
Как оптимизировать тестирование мобильных приложений
- 1. © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP UFT Mobile Как оптимизировать тестирование мобильных приложений Taisiya.Rybak@hp.com
- 2. © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.2 Чего хотят разработчики мобильных приложений Интерфейс (UX) РейтингМонетизация
- 3. © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.3 Что хотят пользователи мобильных приложений? Простота Скорость Контекст
- 4. © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.4 Мобильный рынок растѐт http://thenextweb.com/insider/2013/11/12/idc-android-hit-81-0-smartphone-share-q3-2013-ios-fell-12-9-windows-phone-took-3-6-blackberry-1-7/
- 5. © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.5 Тренд: Одно приложение, два пути Время Качество v 1.0 v 2.0 ЖИТЬ или УМЕРЕТЬ Новая ОС Новые устройства Новые APIs …
- 6. © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. Мобильное тестирование бросает вызов. Особенности разработки.
- 7. © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.7 1 телефон – куча проблем Функциональное • Проверка функциональности • Smoke / Регрессионное • Оффлайновый доступ • Негативное тестирование Нефункциональное • Сила сигнала/Отказ/ Восстановление • Разные виды сетей • Тестирование периферии • Сервисы Совместимость (IOP) • Прерывания голос/ СМС • Уведомления • Отключение кабеля/батареи Утечки памяти • Использование памяти • Утечки памяти • Сбор мусора Нагрузочное • Использование ЦПУ • Использовние сети • Рендеринг страницы Удобство использования • Интерфейс • Конкурентный анализ • Экспертная оценка Тестирование установки • Установка приложения • Деинсталляция и переустановка • Обновление Безопасность • OWASP • Динамическое тестирование • Статический анализ кода • Шифрование Языковое • Проверка локалей • Изображения и текст • Валюты, временные зоны и т.п.
- 8. © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.8 Мобильная лаборатория
- 9. © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.9 Сколько стоит лаборатория ? 20 Устройств для разработки 20 Устройств для тестирования 30 000 $
- 10. © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.10 ИТОГИ ГОДА 40% 30 %
- 11. © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.11 Мобильные приложения бросают вызов Операционный кошмар Специфичные требования мобильных решений ПроизводительностьЧастота релизов
- 12. © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.12 Правда хотите ★★★★★? 1 260 Тесткейсы 4 Релиза в год 0,75h На тест 20 Устройств 15 600 Часов ручного тестирования На приложение в год
- 13. © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.13 Факторы успеха? Качество Работа АвтоматизацияПростота
- 14. © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. Автоматизация тестирования мобильных устройств
- 15. © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.15 HP UFT plug-in Нативная интеграция с HP ALM Реальные устройства Без привязки к устройству OCR (распознавание образов и изображений) Управление профилями Профили, полномочия, журналирование Глобальность Доступ повсюду Безопасность Полный аудиторский след Возможность стирания Удалѐнный доступ Continuous integration Корпоративное решение Конкурентные прогоны Нативные функции GPS, Голосовое управление,… Тестируем на реальных устройствах
- 16. © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. Демонстрация решения
- 17. © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.17 Выберите устройство из списка
- 18. © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.18 Библиотека виджетов Видео с экрана
- 19. © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.19 Полный список встроенных функций
- 20. © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.20 Выберите файл приложения для установки минуя магазин приложений
- 21. © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.21 Управляйте устройством удалѐнно с компьютера
- 22. © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.22 Используйте OCR для взаимодействия с устройством
- 23. © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.23 Используйте распознавание изображений для взаимодействия с устройством
- 24. © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. Демонстрация
- 25. © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. Архитектура решения
- 26. © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.28 Архитектура. 2 режима работы Cloud (выделенный) nativ e On-premiseUFT Mobile Cloud (разделяемый)
- 27. © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. ОБЛАКО UFT MOBILE
- 28. © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.31 “Экспресс облако” 2 конкурентных лицензии ПК с HP UFT Intranet HP 8300 Ultra slim ПК с HP UFT Mini DDM x2
- 29. © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.32 “Облако”. За сценой Реальные устройства HD-камера • 1частное облако на 4 конкурентных соединения • Телефоны и SIM-карты предоставляются • Выделенный безопасный доступ USB-порты
- 30. © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.33 “Экспресс облако” Mini DDM (сзади) Mini DDM (Спереди) Внешний вид
- 31. © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. Нагрузочное тестирование MOBILE
- 32. © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.35 Зачем нам это нужно • Возможность найти узкие места раньше пользователей • Оценка влияние мобильных компонент на всю систему • Эмулируем реальные сетевые условия Реалистичное мобильное нагрузочное тестирование P C L R Протокол для мрбльных приложений Сети Мониторинг Где взять столько устройств? HP Network Virtualization
- 33. © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.36 Зачем помнить о сетях? Не учитывая реальные условия в сети, тестировщики попадают в западню VS. Ёмкость > 500 пользователей Без учѐта реальных условий Ложное чувство защищѐнности Ёмкость < 200 пользователей С учѐтом реальных условий Реальные ожидания
- 34. © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. Спасибо Taisiya.Rybak@hp.com
Editor's Notes
- HP UFT Mobile is the most complete solution for cross-platform automated testing.HP UFT Mobile is a native mobile testing extension to UFT. It allows our customer to use the very familiar UFT (that used be QTP) and extend it to mobile devices. It allows our customers to utilize existing tests, assets & business logic for mobile testing. No need to learn a new environment, code and support the integration, and consolidate reports coming from different tools. Lots of attention and additional technical skills which ultimately consumes the most sensitive asset mobile app development teams have: time. It allowsyou to connect real physicaldevicesthat are sitting on the cloud, and perform real test automation with the ability to identifyobjects, manipulate the objects, performalmostanyoperations on the mobile devices as if theyweresittingnext to you.This means that you can focus on planning your tests while letting someone else manage the devices for them, negotiate contracts with carriers, clean them, and switch them when needed.Needless to say, if your testing teams are located in different sites, they can share the same devices, and test them concurrently.And of course, it allows full back-end integration with ALM/QC.First, there is great affinity between mobile development and Agile, which testers have to support. Agile's short cycle iterations provide fast feedback on product features, promote a customer-centric approach and enable continuous User Experience design. Of course, in Agile, the entire team is responsible for quality. Many of the testing activities are necessarily being performed earlier in the cycle in order to get feedback faster. Second, there is a need to test your app on multiple devices. It is impossible to conduct test on all devices in the marketplace. Some analysts advise to start by selecting just a few devices. The most important objective is to make sure the app delivers remarkable experience to the end users. <BUILD>Some of the biggest frustrations Agile teams have are when they run up against this “command and control” thinking, when bureaucracy that gets in their way, or when they perceive themselves as being slowed down by other “non-Agile” parts of the organization. These type of problems have actually given rise to trends like DevOps or even applying Agile techniques to disciplines outside of software development like marketing.<BUILD>One of the other challenges Agile teams face is striking the right balance between velocity and quality. One of the big things Agile measures is Velocity – essentially the rate at which functionality is delivered. Too much of a focus on velocity though, can have unintended effects. What we often see, especially with teams that are new to Agile, is an inclination to sacrifice quality in name of velocity. Of course, this results in a build-up of defects and more time performing fixes and maintenance, which paradoxically actually ends up slowing things down.<BUILD>In order to balancethisequation and satisfy the end user, itis important to put in place the right testingstrategywithbothmanual and automatedtesting. You will have to perform manual testing for unit and integration testing. However, the mobile handset characteristics (e.g. screen resolution and layout) makes manual testing difficult, and the velocity of the mobile market exacerbates the limitations of manual testing.The validation of the quality of frequent builds requires some degree of automation. Forrester even encourages mobile developers and testers to invest into continuous testing after a few sprints. It is impossible to conduct test on all devices in the marketplace. Some analysts advise to start by selecting just a few devices, but then, how to follow the trends in device turnover and new technology? And then, do you really want to own all the devices you test on? Is it really core to manage, allocate, track, secure, and refresh the devices?How to provide fast feedback on product features, promote a customer-centric approach and enable continuous User Experience design?
- * Windows phone 8 notavailableyet (for all vendors)RealityAutomationTest device managementALM integrationEnd to end lifecycle
- But the network can still be an issue with any performance testing strategy