What’s it like to be a tester for IncluCity?

September 11, 2023 | Guest Blog, Our blog

In collaboration with the Calgary Immigration Partnership (CLIP) and the Calgary Public Library, Gateway organized an event at the Central Public Library on Wednesday, June 19, 2024, in commemoration of this year’s World Refugee Day.

The event aimed to celebrate the strength and courage of refugees who had been forced to flee their home countries due to conflict or persecution.

During the event, Sarah Meilleur, the CEO of Calgary Public Library, welcomed the audience, highlighting that the library is often one of the first destinations for immigrants and refugees upon their arrival. This is because the library provides them with free services, including a membership card, access to Wi-Fi, computers, and printing facilities. Sarah commended the immigrant-serving agencies for their collaborative efforts in supporting refugees on their settlement journeys.

The Calgary Local Immigration Partnership (CLIP) coordinator, Dejana Knih, read the opening remarks and address from the Mayor of Calgary, Mayor Gondek. In her speech, Mayor Gondek thanked refugees who have made Calgary their new home for their resilience and contributions to the city.

After the mayor’s address, there was a film screening of “Struggling to Adapt: One Syrian Refugee Family’s Story” by CBC The National. The film showcased the settlement journey of a Syrian family of nine, including seven children and their parents, who had fled Syria due to conflict and arrived in Lethbridge, Alberta as refugees. The audience got a glimpse of the challenges the family faced, how they slowly adjusted to their new life in Canada, and their journey of learning English to improve their job prospects.

There was a moment of reflection for the audience to absorb the story of this family, which represented the experience of many refugees.

Following the screening, a panel discussion with subject matter experts from local support organizations was held. The panel included Jill Edgington Kirby from the Calgary Catholic Immigration Society (CCIS), Elliot Dewhirst from the End of the Rainbow Foundation, Besrat Tesfamariam from Immigrant Services Calgary/Gateway, and Margaret Yu from Momentum. Dejana Knih, the CLIP Coordinator, moderated the panel discussion.

The panelists discussed the challenges faced by refugees, such as employers requiring Canadian work experience, social issues, and the struggle to afford a decent standard of living. They also offered suggestions on how to improve the lives of refugees, including supporting local refugee businesses, providing a non-judgmental environment, showing empathy, and volunteering to help them integrate into the Canadian system.

Partners from 10 immigrant-serving agencies had booths at the event to showcase free resources and programs that are available for refugees.

 

Gateway partner IncluCity is a team of technologists, designers, public employees, community organizers, entrepreneurs, policy analysts, and other engaged citizens with a vision: that Calgary can become a more accessible city for everyone.

They plan, design, and run testing sessions with an inclusive and representative group of Calgarians to improve the usability of services and solutions for teams in public, private, and non-profit sectors.

IncluCity generously allowed us to repost this blog—which was originally published June 12, 2023—to explain usability testing, a critical component of what they do.

Interested in becoming a tester with IncluCity? Check it out here!

____________________________________

Hello World!

My name is Gurmol, I’m a technical writer, data analyst, and most recently a volunteer at IncluCity Calgary, I’ve had the opportunity to be a usability tester.

My name is Uriel, I’m the project coordinator at IncluCity. I’m the one who gets to organize these tests, and was happy to help capture the process from a tester’s perspective, alongside Gurmol.

This blog will give you an inside look at life as a usability/software tester, not only at IncluCity but in general. There’s also a summary at the very bottom of the article if you get bored halfway through. Happy Reading!

But first… What is a usability test?

A usability test is a method of evaluating a tech-based product (like a website), service (like renting a book online), or process (like summer camp registration).

At IncluCity and many other organizations, UX researchers use usability testing to identify areas that users find challenging, allowing them to improve the overall user experience.

IncluCity frequently shares ‘usability moments’—stories about technology products that either excel or need improvement.

For instance, the Apple watch’s features that let users access messages and sign into devices quickly are positive examples of usability.

Conversely, a job application page that doesn’t allow copying and pasting information can be quite frustrating.

There are plenty of examples of well- and poorly-designed technology processes, services, and products… Do any examples come to mind for you?

Figure 1: We can see the different components of the core elements of usability testing and the interactions between them.

How does usability testing improve technology?

Usability tests aim to enhance user experience. These tests, which often resemble 1-on-1 interviews, gather insights from diverse end users. The feedback is then compiled and analyzed to offer the client recommendations for improvements.

Are there different types of usability testing?

Yes, usability testing is just one form of user testing. Depending on a variety of factors, Research methods can adjust to the research goals, the phase of development, the resources one has to conduct research, and the diversity of individuals identified as testers. IncluCity mostly relies on qualitative usability testing methods to ensure the quality of users’ experience is improved.

What are some common misconceptions about usability testing?

A common misconception is that the tester’s knowledge is being assessed. This is not the case! Usability tests evaluate the product, not the person testing the product. In other words, anyone can participate, regardless of prior knowledge. The more diverse the participants, the better the results.

Who’s involved in testing?

The test facilitator (from IncluCity) leads the session, observing your behaviors, impressions, and overall satisfaction as you complete tasks and answer questions. A notetaker records notable comments, while an observing third person might also be present.

In both cases the facilitators are generally very nice and the tests are structured and all they want is to understand what you are thinking as you are doing the test live. There’s no right or wrong answers, you get to speak freely (when does that ever happen?). There’s nothing to be afraid of, even though we still refer to them as “tests” or “interviews”.

Figure 2: Showcases the relationship between the facilitator, the test participant, and tasks and how they work in a cycle.

What do people traditionally do in a usability test?

As a tester, you’ll work through tasks while vocalizing your thoughts. Thinking out loud is the process of sharing your thoughts out loud with the facilitator as your completing a task. The facilitator will guide you while watching for your impressions. If a task is notably challenging, don’t worry—you’ve helped identify a usability flaw, which is a success!

What should you expect in a usability test?

In a typical test, you’ll know what to expect ahead of time. Tests last about 30 to 60 minutes and can be in-person or virtual. During the test, you’ll complete tasks while verbalizing your thought process. Once completed, you’ll have the option to receive payment in various forms.

Why should you consider being a tester?

Your unique perspective is crucial to ensure that technology is inclusive. By participating, you’re essentially casting your vote for different design features. Plus, you’ll receive a reward for your efforts, and feel good knowing you’ve contributed to improving access and inclusion in tech design.

To sum it up, usability testing is a mutually beneficial process. You get a reward, and the client organization gains valuable insights on how to better design tech products.

Figure 3: These are the benefits of usability testing.

References:

Usability testing 101. (n.d.). Nielsen Norman Group. https://www.nngroup.com/articles/usability-testing-101/

Too Long; Didn’t Read (TL;DR):

  • Usability tests assess the general usability; preferences, leanings, challenges, and difficulties of the users towards a software product or service.
  • The user isn’t being tested, the product is being scrutinized by the user, in order to make it better in future versions.
  • The test facilitator and the tester work together to identify the good, the bad, and the ugly of the tested materials.

Benefits of being a tester:

  • Testers are paid via an electronic transfer of funds, an email e-transfer, Calgary dollars or other types of local funding sources should you complete a test with IncluCity.
  • Learning Experience: Exposure to novel technologies, and the unique experience of doing a usability test which requires testers to complete tasks and verbalize thoughts, are all learning experiences that will improve the tester’s digital skills.
  • Impact: We need your insights and unique perspective to ensure that technology is made for everyone. Users will get to see the direct outcomes of their involvement once the tech product has been updated.

Sign Up for Gateway Updates

Sign up to receive the latest announcements, updates and news about Gateway.