开发Jira应用程序:如何设计可用性测试
可用性测试是设计任何产品或应用程序的关键步骤. For our team developing Clear Path , 设计可用性测试是这个过程中非常重要的一部分. 因为mg官方游戏中心的Jira应用程序是一个从头开始开发的新应用程序, there was even more of a need to understand the user experience and improvements that could be made based on user feedback. Before conducting the tests, designing the usability test is equally important to ensure you are receiving the information that would help make your product better.
When first designing our usability test script, there was discussion about whether to use a usability test or user acceptance test (UAT). 尽管这些类型的测试可以互换使用, they have differences that need to be considered. Being a new app, it was a question for our team on whether to do usability testing or user acceptance testing. 那么，这两种测试的区别是什么呢?
User Acceptance Testing vs. Usability Testing
User Acceptance Testing is performed to ensure that a product or application meets certain users' standards and requirements. 它的重点是验证产品是否按预期工作和功能, rather than examining the user experience. 用户验收测试在可用性测试之前完成, and aims to answer the question of “Did the application solve the problems it intended to solve?“设计用户验收测试需要目标受众中的用户, and gathering opinions of users that have some sort of contextual knowledge of the problems being solved. UAT is conducted using scenario-based testing, 用户在哪里必须完成许多任务才能完成场景. User Acceptance Testing’s name does describe the main goal behind it: is this an application that the user will accept?
Usability testing 是否关心用户的易用性和整体用户体验. 它旨在收集用户反馈并识别任何潜在的可用性问题. Often there is a script with different “tasks” for a user to complete to identify potential pain points and areas of improvement for the product or application. 可用性测试侧重于更具体、更小的任务. 假设用户体验设计师已经完成了用户验收测试, usability testing follows up with the question “How well did the application solve the problems it intended to?可用性测试衡量的是解决方案的质量, 即使用户验收测试认为它被用户“接受”. Usability testing is generally the type of testing used for UX designers and researchers. For some applications, it can be assumed that the users already accepted/used an application. This is why it is important to test how well the application is performing and the experience of the users.
Our Experience
正如您所看到的，这些类型的测试彼此非常相似. 有时它们甚至可以互换使用或相互串联使用. Our team had a couple of collaborative discussions on what we felt would be the best direction to go to understand the user experience the best. We decided to design a usability test, because we felt pretty good that Clear Path was solving common problems in Jira to differentiate it from other apps. We chose to focus on usability testing, because we wanted to measure effectiveness, efficiency, 以及mg官方游戏中心解决问题的方式带来的用户满意度. Because Clear Path is a SaaS product, we knew to achieve our goal of high user adoption and retention from our free trials we needed to ensure the product delighted our user base with its ease of use.
The Importance of Usability Testing
There are many reasons why usability testing matters and is so important for any project or application. 用户体验设计师经常被提醒“你不是用户”这句话。. This is an important phrase to remember, 因为即使一个设计对设计师来说很有意义, 这并不意味着用户将获得良好的体验. 这也是用户体验设计的全部目标, making sure that your application provides the best user experience to the widest range of users. It is also important for early issue detection. 想象一下，有人在校对你写的论文时发现了一个语法错误, even though you did not notice it. The same is true for usability testing. Often, we are too close to the design and a fresh pair of eyes can help us find things we would have never noticed.
Designing a Usability Test
这就引出了如何设计可用性测试的话题. There are many steps and best practices that need to be implemented to design a successful usability test. 用户体验设计师通常会首先创建一个包含测试目标的“脚本”, user tasks, 以及任何与考试目标相关的具体问题. 我将介绍设计可用性测试的一些步骤. This does not include conducting or post-test steps.
Planning the Usability Test
规划可用性测试是最重要的一步. The UX designer and any other team members involved in user testing want to make sure that the plan is detailed and in line with testing goals. For Clear Path, we primarily had a single developer , a product owner, and a UX designer. 这让mg官方游戏中心更容易组建团队并获得反馈.
确定测试目标是可用性测试计划中非常重要的一部分. This will help the team stay on track with the test, 确保他们从可用性测试中获得最大收益. mg官方游戏中心在《mg官方游戏中心》中使用的一些示例目标是:应用的痛点是什么, 或者应用程序的哪些部分可以改进? Although these goals can be more general, mg官方游戏中心的团队知道mg官方游戏中心认为用户会说的痛点是什么. 有了这个，mg官方游戏中心可以创建任务或问题，看看这对用户来说是否正确.
With planning also comes the logistics of the test. 在这一点上，回答了谁，什么，何时，何地，为什么? questions. For Clear Path, we found internal employees that could complete the tests at their work locations.
Creating the Prototype and Deciding Tasks
For Clear Path, we were on an aggressive schedule, mg官方游戏中心选择在开发MVP后进行可用性测试. 正因为如此，mg官方游戏中心不必担心创建Figma原型. However, you want to make sure that for any usability test there is a live or prototyped version of what you are testing so users can move through the test with more ease.
It is important to ask users general questions, such as “How do you feel about this page?” But it is important to have “tasks” for the user to complete that can help your team understand the user’s ease of use and usability issues within an application. It is important that these tasks are general enough, so they are not leading users, 但也要足够具体，让用户知道该去哪里.
For Clear Path, we have tasks such as “Show me how you would go about visualizing a release.” It is a broad task but shows us how a user would truly go about this and can reveal information that you might not have been aware of. 如果用户无法完成任务，您可以随时帮助他们, 这将揭示普通用户可能存在可用性问题.
When it comes to tasks, a big part of this is making sure the user does not feel “tested” on their own abilities or feel bad for not “successfully” completing a task. It is important to let the user know beforehand that we are testing the application, and not them. After the tasks, there are usually follow up questions that will wrap up the user’s overall experience and feelings about the application.
Finding the Right Users
对于Clear Path，mg官方游戏中心知道mg官方游戏中心的工具是为使用Jira的用户设计的. 在mg官方游戏中心的组织中，主要用户将是产品所有者. However, other technology and business roles also use Jira, so it is important to get a versatile pool of users.
在计划可用性测试时，你可能还没有开始招募用户. However, it is still important to have an idea of who the users could be and where you could find them. 最好找到至少5个用户来做可用性测试. The number 5 is statistically significant, 使用5个不同的用户，你的可用性问题会在哪里出现.
有时，您可能无法针对特定类型的用户进行规划, but generally it would be best to try and find people who have some contextual knowledge but also some with no background knowledge of your application. 这将提供一个整体的用户池，并允许更全面的结果.
Deciding How to Translate Results
甚至在可用性测试的设计部分, 重要的是要意识到结果将如何转化. Testing can either be quantitative or qualitative. 定量测试以数字和统计为基础. 定性测试更抽象，但同样重要. Both methods are valid, 但重要的是要意识到这一点，这样你才能从你的结果中得到最大的收获.
Important Things to Remember for Designing a Usability Test
Preparation Will Lead to a Successful Test
可用性测试的准备和计划将使测试更成功. The goals and objectives need to be clear, and this will lead to an understanding of the user experience and allow for the overall success of your product.
Collaboration is Key
对于任何UX项目，不仅仅是测试，协作是关键. 重要的是，团队成员，如产品负责人, UX team, 开发人员都可以在用户测试上进行协作. 这不仅有助于整个团队理解正在发生的事情, but each person can offer fresh perspectives on the design of the usability test and potential tasks to be included.
主要目标是理解用户体验
The main thing to remember when designing a usability test is that it is to better understand the user and the user’s experience. Being able to understand the users and get the most amount of feedback and experience with them will ultimately lead to a better product as well as a better user experience.
Contact Moser Consulting for more information.
