Usability Testing / Amon Carter Museum of American Art

Usability Testing / Amon Carter Museum of American Art

Usability Testing /
Amon Carter Museum of Art

This five-month project focused on user research and usability testing aimed at enhancing the usability of the Amon Carter Museum of Art website. Collaborating with a team of three other UX designers, we conducted eight moderated user tests on the educator resources and collection pages. Based on our findings, we provided design recommendations to improve usability and the overall user experience of the website.

This five-month project focused on user research and usability testing aimed at enhancing the usability of the Amon Carter Museum of Art website. Collaborating with a team of three other UX designers, we conducted eight moderated user tests on the educator resources and collection pages. Based on our findings, we provided design recommendations to improve usability and the overall user experience of the website.

This five-month project focused on user research and usability testing aimed at enhancing the usability of the Amon Carter Museum of Art website. Collaborating with a team of three other UX designers, we conducted eight moderated user tests on the educator resources and collection pages. Based on our findings, we provided design recommendations to improve usability and the overall user experience of the website.

Project Overview

Project Overview

The Carter museum website boasts an impressive collection, but it is difficult to find and sort through.

We identified several usability issues and provided the following design recommendations to enhance the usability and user experience for visitors of the Amon Carter Museum of Art website

The Carter museum website boasts an impressive collection, but it is difficult to find and sort through.

We identified several usability issues and provided the following design recommendations to enhance the usability and user experience for visitors of the Amon Carter Museum of Art website

The Carter museum website boasts an impressive collection, but it is difficult to find and sort through.

We identified several usability issues and provided the following design recommendations to enhance the usability and user experience for visitors of the Amon Carter Museum of Art website

Recommendation 1

Redesign of the Navigation bar to display drop down menu items for more efficient navigation to sub-pages.

Redesign of the Navigation bar to display drop down menu items for more efficient navigation to sub-pages.

Redesign of the Navigation bar to display drop down menu items for more efficient navigation to sub-pages.

Recommendation 2

Emphasizing key info. on the Educator resources page and relocating non-visit-related information to the Collections page.

Emphasizing key info. on the Educator resources page and relocating non-visit-related information to the Collections page.

Emphasizing key info. on the Educator resources page and relocating non-visit information to the Collections page.

Recommendation 3

Relocate filter options and add tagging to improve search experience in the collections page.

Relocate filter options and add tagging to improve search experience in the collections page.

Relocate filter options and add tagging to improve search experience in the collections page.

Recommendation 4

Re-organize artwork detail pages to promote discoverability of it's educator resources section.

Re-organize artwork detail pages to promote discoverability of it's educator resources section.

Re-organize artwork detail pages to promote discoverability of it's educator resources section.

User testing process

User testing process

How did we evaluate the website?

How did we evaluate the website?

How did we evaluate the website?

The goal was to identify areas of usability improvement and to evaluate if the website content was consistent with the user’s mental models. As per the wishes of the client, we focused our study on two sections of the website:
1. Educator Resources
2. Online collection

The goal was to identify areas of usability improvement and to evaluate if the website content was consistent with the user’s mental models. As per the wishes of the client, we focused our study on two sections of the website:
1. Educator Resources
2. Online collection

The goal was to identify areas of usability improvement and to evaluate if the website content was consistent with the user’s mental models. As per the wishes of the client, we focused our study on two sections of the website:
1. Educator Resources
2. Online collection

  1. Recruited suitable participants
  1. Recruited suitable participants

We recruited participants with prior experience in using museum websites for research/educational purposes.

We recruited participants with prior experience in using museum websites for research/educational purposes.

We recruited participants with prior experience in using museum websites for research/educational purposes.

  1. Set up the moderated study
  1. Set up the moderated study

We came up with a list of tasks and questions for the moderated user studies for both sections of interest.

We came up with a list of tasks and questions for the moderated user studies for both sections of interest.

We came up with a list of tasks and questions for the moderated user studies for both sections of interest.

  1. Analyzed findings and trends
  1. Analyzed findings and trends

Results and findings were aggregated to understand themes and key usability issues on the website.

Results and findings were aggregated to understand themes and key usability issues on the website.

Results and findings were aggregated to understand themes and key usability issues on the website.

Step 1

Step 1

Recruiting Participants for our User Study

Recruiting Participants for our User Study

Recruiting Participants for our User Study

As the focus of the study was on the educator resources and collections section, we decided to recruit participants who had prior experience using museum websites for research/educational purposes. After our user screening, we ended up testing with eight participants (remotely - over zoom).

As the focus of the study was on the educator resources and collections section, we decided to recruit participants who had prior experience using museum websites for research/educational purposes. After our user screening, we ended up testing with eight participants (remotely - over zoom).

As the focus of the study was on the educator resources and collections section, we decided to recruit participants who had prior experience using museum websites for research/educational purposes. After our user screening, we ended up testing with eight participants (remotely - over zoom).

Finding the ideal participant

Finding the ideal participant

Finding the ideal participant
  • Educators, students, researchers or academics

  • Some experience visiting museum websites for educational or research purposes

  • Enjoys or appreciates art/museums

  • Educators, students, researchers or academics

  • Some experience visiting museum websites for educational or research purposes

  • Enjoys or appreciates art/museums

  • Educators, students, researchers or academics

  • Some experience visiting museum websites for educational or research purposes

  • Enjoys or appreciates art/museums

Reaching out to recruit participants

Reaching out to recruit participants

Reaching out to recruit participants
  • Pratt School of Information Network

  • Pratt Institute History of Art and Design Department

  • Personal networks (mainly for educators)

  • Offered them gift cards to take part in our session

  • Pratt School of Information Network

  • Pratt Institute History of Art and Design Department

  • Personal networks (mainly for educators)

  • Offered them gift cards to take part in our session

  • Pratt School of Information Network

  • Pratt Institute History of Art and Design Department

  • Personal networks (mainly for educators)

  • Offered them gift cards to take part in our session

Final user demographics

Final user demographics

Final user demographics
  • 04 Art Historians

  • 03 Educators (k-12)

  • 01 Art Conservator

  • All from North America

  • 04 Art Historians

  • 03 Educators (k-12)

  • 01 Art Conservator

  • All from North America

  • 04 Art Historians

  • 03 Educators (k-12)

  • 01 Art Conservator

  • All from North America

Step 2

Step 2

Setting up the Study

Setting up the Study

Setting up the Study

We formulated tasks and subsequent questions designed to effectively assess both the educator resources and collections page. Participants were instructed to execute these tasks using the Carter Museum website, all while articulating their thoughts to provide insights into their cognitive processes, expectations, and reactions.

We formulated tasks and subsequent questions designed to effectively assess both the educator resources and collections page. Participants were instructed to execute these tasks using the Carter Museum website, all while articulating their thoughts to provide insights into their cognitive processes, expectations, and reactions.

We formulated tasks and subsequent questions designed to effectively assess both the educator resources and collections page. Participants were instructed to execute these tasks using the Carter Museum website, all while articulating their thoughts to provide insights into their cognitive processes, expectations, and reactions.

Focused on Educator Resources

Focused on Educator Resources

Speaking to educators, we tried to formulate questions that showcased the relevancy and ease of use (or lack of) of the educator related content on the website

Speaking to educators, we tried to formulate questions that showcased the relevancy and ease of use (or lack of) of the educator related content on the website

Speaking to educators, we tried to formulate questions that showcased the relevancy and ease of use (or lack of) of the educator related content

Focused on Collection Search

Focused on Collection Search

Used mostly by researchers and art historians, we wanted to see if they were able to efficiently find relevant collections and sort through them

Used mostly by researchers and art historians, we wanted to see if they were able to efficiently find relevant collections and sort through them

Follow up questions and opinions

Follow up questions and opinions

These aimed to understand their experience and opinions on the website as compared to their expectations and other museum websites

These aimed to understand their experience and opinions on the website as compared to their expectations and other museum websites

Step 3

Step 3

Analyzing findings

Analyzing findings

Analyzing findings

After concluding our user testing sessions, we aggregated our findings from all 8 sessions into one spreadsheet. We used affinity mapping to understand themes and common issues brought up by our participants. We then grouped them together on the criteria of what type of design recommendation will be required.

After concluding our user testing sessions, we aggregated our findings from all 8 sessions into one spreadsheet. We used affinity mapping to understand themes and common issues brought up by our participants. We then grouped them together on the criteria of what type of design recommendation will be required.

After concluding our user testing sessions, we aggregated our findings from all 8 sessions into one spreadsheet. We used affinity mapping to understand themes and common issues brought up by our participants. We then grouped them together on the criteria of what type of design recommendation will be required.

What works well

What works well

What works well

Educators loved the teaching resources

Educators loved the teaching resources

Educators loved the teaching resources

Educators felt that additional teaching resources that accompanies artworks were very helpful, and were relevant to their classes.

Educators felt that additional teaching resources that accompanies artworks were very helpful, and were relevant to their classes.

Educators felt that additional teaching resources that accompanies artworks were very helpful, and were relevant to their classes.

Filters and search were intuitive to use

Filters and search were intuitive to use

Filters and search were intuitive to use

Users were able to understand how to use the different filters available and search effectively without any help.

Users were able to understand how to use the different filters available and search effectively without any help.

Users were able to understand how to use the different filters available and search effectively without any help.

Users were impressed by the Collection

Users were impressed by the Collection

Users were impressed by the Collection

Most users appreciated the extensive collection that the Carter museum has and were impressed by the organization/tagging.

Most users appreciated the extensive collection that the Carter museum has and were impressed by the organization/tagging.

Most users appreciated the extensive collection that the Carter museum has and were impressed by the organization/tagging.

What can be improved

What can be improved

What can be improved

Most users could not find educator resources right away

Most users could not find educator resources right away

Most users could not find educator resources right away

The majority of participants (5/8) did not find the For Educators tab on the Visit page on their own. Most went to the Research and/or Collection pages instead.

The majority of participants (5/8) did not find the For Educators tab on the Visit page on their own. Most went to the Research and/or Collection pages instead.

The majority of participants (5/8) did not find the For Educators tab on the Visit page on their own. Most went to the Research and/or Collection pages instead.

Users suggested addition of certain filters to improve search

Users suggested addition of certain filters to improve search

Users suggested addition of certain filters to improve search

Users suggested addition of filters like "Place of origin" and "Movement" to help improve search experience for specific items.

Users suggested addition of filters like "Place of origin" and "Movement" to help improve search experience for specific items.

Users suggested addition of filters like "Place of origin" and "Movement" to help improve search experience for specific items.

Content hierarchy and placement made users miss important information

Content hierarchy and placement made users miss important information

Content hierarchy and placement made users miss important information

In many pages, like the "For educators" page, important information like educator resources was missed as it was at the end of the page.

In many pages, like the "For educators" page, important information like educator resources was missed as it was at the end of the page.

In many pages, like the "For educators" page, important information like educator resources was missed as it was at the end of the page.

Findings & Recommendations

Findings & Recommendations

Findings & Recommendations

Finding #1

Finding #1

We realized that users had difficulty in locating the "For Educators" resources from the home page

We realized that users had difficulty in locating the "For Educators" resources from the home page

We realized that users had difficulty in locating the "For Educators" resources from the home page

5 out of 8 participants could not locate the For Educator page under the Visit tab. Most users went to some combination of the Research and Collection pages instead.

5 out of 8 participants could not locate the For Educator page under the Visit tab. Most users went to some combination of the Research and Collection pages instead.

5 out of 8 participants could not locate the For Educator page under the Visit tab. Most users went to some combination of the Research and Collection pages instead.

Users said none of the nav-bar menu items seemed relevant. Lack of drop down's made it inefficient to search for sub-pages or content.

Users said none of the nav-bar menu items seemed relevant. Lack of drop down's made it inefficient to search for sub-pages or content.

Users said none of the nav-bar menu items seemed relevant. Lack of drop down's made it inefficient to search for sub-pages or content.

"I hovered over the top menu because a lot of sites have a dropdown and it makes it easier to visualize where I'm going and for what." — Participant #2

Recommendation #1

Recommendation #1

Redesigned navigation bar to include drop-down's for better navigation

Redesigned navigation bar to include drop-down's for better navigation

Redesigned navigation bar to include drop-down's for better navigation

This feature enables users to access sub-pages and content without the need to navigate directly to each page.This solution not only enhances efficiency by saving time but also empowers users to make informed decisions when seeking a particular page.

This feature enables users to access sub-pages and content without the need to navigate directly to each page.This solution not only enhances efficiency by saving time but also empowers users to make informed decisions when seeking a particular page.

This feature enables users to access sub-pages and content without the need to navigate directly to each page.This solution not only enhances efficiency by saving time but also empowers users to make informed decisions when seeking a particular page.

Finding #2

Finding #2

We realized that users were missing important information on the "For Educators" page

We realized that users were missing important information on the "For Educators" page

We realized that users were missing important information on the "For Educators" page

The subscribe to the newsletter as the first section threw most users off. Users were confused as to what information the page contains.

The subscribe to the newsletter as the first section threw most users off. Users were confused as to what information the page contains.

The subscribe to the newsletter as the first section threw most users off. Users were confused as to what information the page contains.

Users missed the educator resources section as it was at the end of the page. Lack of suitable signifiers and dependence on scrolling to access the content.

Users missed the educator resources section as it was at the end of the page. Lack of suitable signifiers and dependence on scrolling to access the content.

Users missed the educator resources section as it was at the end of the page. Lack of suitable signifiers and dependence on scrolling to access the content.

"I would expect this [subscribe button] to be at the bottom rather than at the top right away.... I don't know what I'm subscribing to."—Participant #2

Recommendation #2

Recommendation #2

Re-organized content on the For educators page to highlight important information

Re-organized content on the For educators page to highlight important information

Re-organized content on the For educators page to highlight important information

This involved pushing the most important information (visit related information for educators) to the top of the page, moving the newsletter and subscription sections to the bottom of the page.
Additionally, we moved all non visit related educator content to the Collection's page where it was more relevant as it was content relating to artwork.

This involved pushing the most important information (visit related information for educators) to the top of the page, moving the newsletter and subscription sections to the bottom of the page.
Additionally, we moved all non visit related educator content to the Collection's page where it was more relevant as it was content relating to artwork.

This involved pushing the most important information (visit related information for educators) to the top of the page, moving the newsletter and subscription sections to the bottom of the page.
Additionally, we moved all non visit related educator content to the Collection's page where it was more relevant as it was content relating to artwork.

Let’s Collaborate!
DESIGNER | INNOVATOR | STRATEGIST |
Let’s Collaborate!
DESIGNER | INNOVATOR | STRATEGIST |

Finding #3

Finding #3

Users were not able to search for specific items in the collection effectively

Users were not able to search for specific items in the collection effectively

Users were not able to search for specific items in the collection effectively

Users requested additional filter options: origin, art movement/style, and number of works within the Artists tab.

Users requested additional filter options: origin, art movement/style, and number of works within the Artists tab.

Users requested additional filter options: origin, art movement/style, and number of works within the Artists tab.

The checkboxes for On View and Has Educator Resources were missed by 4/8 users.

The checkboxes for On View and Has Educator Resources were missed by 4/8 users.

The checkboxes for On View and Has Educator Resources were missed by 4/8 users.

"The things I look for in filters and specifically use, because all my research is in collections, is artist, date made, place of origin, and material."—Participant #1

Recommendation #3

Recommendation #3

Relocate and improve filter options for improved search experience

Relocate and improve filter options for improved search experience

Relocate and improve filter options for improved search experience

Adding filter options like "Place of origin", "Movement" etc. will allow users to narrow down onto specific items more efficiently. Additionally we relocated the on-view and has educator resource filters to a more prominent location for better discoverability.

Adding filter options like "Place of origin", "Movement" etc. will allow users to narrow down onto specific items more efficiently. Additionally we relocated the on-view and has educator resource filters to a more prominent location for better discoverability.

Adding filter options like "Place of origin", "Movement" etc. will allow users to narrow down onto specific items more efficiently. Additionally we relocated the on-view and has educator resource filters to a more prominent location for better discoverability.

Finding #4

Finding #4

Artwork detail pages lacked some useful features, and discoverability of educator resources could be improved

Artwork detail pages lacked some useful features, and discoverability of educator resources could be improved

Artwork detail pages lacked some useful features, and discoverability of educator resources could be improved

Researchers expressed the need for options to zoom and download images. Related content and artworks section were confusing to users as well.

Researchers expressed the need for options to zoom and download images. Related content and artworks section were confusing to users as well.

Researchers expressed the need for options to zoom and download images. Related content and artworks section were confusing to users as well.

Majority of the users missed the educator resources attached. Change in color in the background, as well as the scrolling required led to poor discoverability.

Majority of the users missed the educator resources attached. Change in color in the background, as well as the scrolling required led to poor discoverability.

Majority of the users missed the educator resources attached. Change in color in the background, as well as the scrolling required led to poor discoverability.

"I'm curious about how they choose related artworks. I would immediately start with abstract [user was looking at an O'Keeffe] and the same year of creation. But I would start with related art styles as opposed to anything else."—Participant #1

Recommendation #4

Recommendation #4

Adding helpful features and re-organizing content on the Artwork detail page

Adding helpful features and re-organizing content on the Artwork detail page

Adding helpful features and re-organizing content on the Artwork detail page

Adding requested features like zoom, sharing and downloading as well as prioritizing educator resources over related content will help in better discoverability for educator related content for a specific artwork.

Adding requested features like zoom, sharing and downloading as well as prioritizing educator resources over related content will help in better discoverability for educator related content for a specific artwork.

Adding requested features like zoom, sharing and downloading as well as prioritizing educator resources over related content will help in better discoverability for educator related content for a specific artwork.

Conclusion

Conclusion

The recommendations made were greatly appreciated by the Carter Museum team, and were in line with their expectations of understanding user behaviors as they interacted with their website. Both the educator resources and the online collection were found beneficial to users, and with a few minor usability adjustments, they are poised to significantly enhance the overall user experience on the website.

The recommendations made were greatly appreciated by the Carter Museum team, and were in line with their expectations of understanding user behaviors as they interacted with their website. Both the educator resources and the online collection were found beneficial to users, and with a few minor usability adjustments, they are poised to significantly enhance the overall user experience on the website.

The recommendations made were greatly appreciated by the Carter Museum team, and were in line with their expectations of understanding user behaviors as they interacted with their website. Both the educator resources and the online collection were found beneficial to users, and with a few minor usability adjustments, they are poised to significantly enhance the overall user experience on the website.

Positives & Strengths

Positives & Strengths
Positives & Strengths

Users expressed their strong appreciation towards the intuitive and easy to use website interface of the Carter museum.

Users expressed their strong appreciation towards the intuitive and easy to use website interface of the Carter museum.

Users expressed their strong appreciation towards the intuitive and easy to use website interface of the Carter museum.

Next Steps

Next Steps
Next Steps

Updating the metadata of the items in the collection according to the filters can further help in better refined searches for users

Updating the metadata of the items in the collection according to the filters can further help in better refined searches for users

Updating the metadata of the items in the collection according to the filters can further help in better refined searches for users

My takeaway

My takeaway
My takeaway

When dealing with a content heavy websites, users will miss out on important content unless it is strategically prioritized.

When dealing with a content heavy websites, users will miss out on important content unless it is strategically prioritized.

When dealing with a content heavy websites, users will miss out on important content unless it is strategically prioritized.

Let’s Collaborate!
DESIGNER | INNOVATOR | STRATEGIST |
Let’s
Collaborate!

©

Shreedhar Verma 2025

Let’s
Collaborate!

DESIGNER | INNOVATOR | STRATEGIST |