Assessment Tests

7 Feb 2005 - 10:14am
9 years ago
8 replies
325 reads
Tubman, Wahne
2004

Does anyone know where I can find a sample of an assessment test which some
employers use to test prospective candidates usability skills or aptitude?

Comments

7 Feb 2005 - 10:30am
Tubman, Wahne
2004

Does anyone know where I can find a sample of an assessment test which some
employers use to test prospective candidates usability skills or aptitude?

7 Feb 2005 - 10:56am
Lada Gorlenko
2004

TW> Does anyone know where I can find a sample of an assessment test which some
TW> employers use to test prospective candidates usability skills or aptitude?

Wahne,

This is not an assessment test, but a list of interview preparation
questions for usability professionals, which I personally found very
useful. Chauncey Wilson, the moderator of STC Usability SIG has
compiled and kindly shared this list with his community.

STC Usability SIG is generally a very good resource for
usability-related issues: http://www.stcsig.org/usability/

Lada

-------------------------------------------------------------------
1. What 2-3 usability design books would you recommend to colleagues?
2. Why are you looking for a new position?
3. What do you like most/least about your current job?
4. What are some of the ethical issues that can arise in a usability/UI
design position? Have you experienced any of these personally? What did you
do to resolve the ethical issue?
5. Describe how you have marketed usability/Design in your current position?
How would you market usability if you were the first usability/UI design
person in a company?
6. Describe a project that didn't go well for you in your current position
and tell us what you might do differently?
7. What 2-3 usability evaluation methods are you most experienced with?
8. What usability/UI design methods would you like to know more about or are
least experienced with?
9. Have you taught any courses or seminars in usability or UI design? What
topics did you emphasize in the course?
10. What are the advantages and disadvantages of having a GUI or Web style
guide? If you have worked on a style guide, describe your method for
developing it.
11. How have you addressed issues of UI consistency across products in your
current position? (if yes, please describe how you did and the success and
failures that you had).
12. About how many usability tests have your run?
13. What courses or seminars have you taken on usability or design?
14. Have you been involved in gathering requirements in your current or past
positions? How did you go about gathering requirements? What would you do
differently?
15. Can you describe a specific design problem that you work on and some of
the issues or problems that you had to solve?
16. What are some of the differences in designing for the Web versus a
Windows (or other platform) GUI application?
17. What percent of time to you spend in evaluation versus design in your
current position?
18. What role can QA play in improving the usability or UI design of a
product?
19. If you were going to visit a beta customer and were asked to take an
engineer along, how would you prep the engineer for the visit?
20. What have/can you do to make usability lab testing as realistic as
possible?
21. How much experience do you have recruiting external customers for
evaluation or design activities?
22. Could you describe how some usability/UI design activities would fit into
the development process?
23. How do you define when a product is "usable enough"?
24. Here are a few screen shots from an application. What problems do you see
here (usually give a person about 15 minutes and then go over the screen shot
- don't make it too hard).
25. How have you reported the results of a lab or field study to the
appropriate parties?
26. What tools do you use to prototype screens, windows, or Web pages?
27. What do you like most about the usability field? Least?
28. How would you test the usability of online or paper documentation?
29. What do you know about the products that this company makes? (check to
see if the person did any research before coming to the interview)
30. What steps have you taken to convince a recalcitrant developer to listen
to your advice?
31. What are some design techniques for preventing errors rather than
displaying some kind of error message?
32. How would you present the results of a usability test to a senior VP? A
development group?
33. Can you give a few examples of cognitive principles that should influence
design?
34. How do you get answers to usability or design questions that you have in
the absence of another colleague in the area?
35. Pose some human factors problems to the person to get at some general
problem solving capabilities. I once interviewed with a firm where they asked
me to re-design the faucets for a bathtub. Not your typical UI design
problem, but it brought up issues of control-display compatibility, feedback,
errors, safety, efficiency, etc. Several of the good HF textbooks have a
number of examples that could be adapted for this?
36. What are some general internationalization/localization problems and
solutions?
37. What are some visual design principles that you would try to follow when
designing Web pages or windows? (I'm thinking about things like balance,
symmetry, consistency, clutter, minimalism, etc. - there are a lot of things
that would be OK here).
38. How do you decide what tasks should be part of a usability test? (I'm
looking for things like - most frequent tasks, focus on a new critical
feature, low-use, but extremely critical task that is catastrophic if done
incorrectly, again there are a number of answers).
39. You are going to work at a company where everyone says that "we have a
really distinct culture here." How would you go about figuring out what that
statement means and how it will affect your usability/design work? How did
you find out about the culture at your current company?
40. Describe your worst experience as a [fill in current position]. How did
you deal with it?
41. How do you analyze qualitative field data in a way that is useful for
informing developers how to make design changes?
42. A participant in a lab study has been struggling on the same task for a
long time. What would you say to get them to move on to the next question?
43. Show the person a 15 minute segment of a usability test and ask him/her to
list the problems that they see during the segment. (Make sure that you have
permission to sue that segment from the participant). Review the tape with
the participant.
44. Ask the person to do the Heuristic Review at the end of Jakob Nielsen's
Usability Engineering book. Jakob has an answer list and this gets at a large
number of design issues.
45. You have time to interview or test 5 users. What criteria would you use
to choose the 5 people?
46. What are the advantages and disadvantages of Contextual Inquiry (only ask
if they have listed this on their resume)?
47. How have/would you conduct a competitive analysis of two applications or
web sites (assuming that there are no legal prohibitions)?
48. The lack of good requirements is often cited as the major flaw in
producing useful products on time and within budget? What methods would you
use to gather requirements?
49. Describe how the physical environment can have an impact on the design of
a GUI application.
50. Here is a list of user attributes. Tell me how these attributes would
affect design (for example, 10 percent of users are colorblind, the users are
elderly, the users are disabled).
51. What are some general guidelines for making applications or Web pages
accessible to users with visual, hearing, or motor disabilities?
52. Given that a usability person often delivers "bad news" how do you (or
your management) keep good relations with the group that you are delivering
the bad news to?

7 Feb 2005 - 11:01am
Aby Rao
2004

Is there one for Interaction Design or UI Designer too? Any resources
like links, documents will be appreciated.

thanks

Aby

-----Original Message-----
From:
discuss-interactiondesigners.com-bounces at lists.interactiondesigners.com
[mailto:discuss-interactiondesigners.com-bounces at lists.interactiondesign
ers.com] On Behalf Of Lada Gorlenko
Sent: Monday, February 07, 2005 10:57 AM
To: discuss-interactiondesigners.com at lists.interactiondesigners.com
Subject: Re: [ID Discuss] Assessment Tests

[Please voluntarily trim replies to include only relevant quoted
material.]

TW> Does anyone know where I can find a sample of an assessment test
which some
TW> employers use to test prospective candidates usability skills or
aptitude?

Wahne,

This is not an assessment test, but a list of interview preparation
questions for usability professionals, which I personally found very
useful. Chauncey Wilson, the moderator of STC Usability SIG has
compiled and kindly shared this list with his community.

STC Usability SIG is generally a very good resource for
usability-related issues: http://www.stcsig.org/usability/

Lada

-------------------------------------------------------------------
1. What 2-3 usability design books would you recommend to colleagues?
2. Why are you looking for a new position?
3. What do you like most/least about your current job?
4. What are some of the ethical issues that can arise in a usability/UI
design position? Have you experienced any of these personally? What did
you
do to resolve the ethical issue?
5. Describe how you have marketed usability/Design in your current
position?
How would you market usability if you were the first usability/UI design
person in a company?
6. Describe a project that didn't go well for you in your current
position
and tell us what you might do differently?
7. What 2-3 usability evaluation methods are you most experienced with?
8. What usability/UI design methods would you like to know more about
or are
least experienced with?
9. Have you taught any courses or seminars in usability or UI design?
What
topics did you emphasize in the course?
10. What are the advantages and disadvantages of having a GUI or Web
style
guide? If you have worked on a style guide, describe your method for
developing it.
11. How have you addressed issues of UI consistency across products in
your
current position? (if yes, please describe how you did and the success
and
failures that you had).
12. About how many usability tests have your run?
13. What courses or seminars have you taken on usability or design?
14. Have you been involved in gathering requirements in your current or
past
positions? How did you go about gathering requirements? What would you
do
differently?
15. Can you describe a specific design problem that you work on and some
of
the issues or problems that you had to solve?
16. What are some of the differences in designing for the Web versus a
Windows (or other platform) GUI application?
17. What percent of time to you spend in evaluation versus design in
your
current position?
18. What role can QA play in improving the usability or UI design of a
product?
19. If you were going to visit a beta customer and were asked to take an
engineer along, how would you prep the engineer for the visit?
20. What have/can you do to make usability lab testing as realistic as
possible?
21. How much experience do you have recruiting external customers for
evaluation or design activities?
22. Could you describe how some usability/UI design activities would fit
into
the development process?
23. How do you define when a product is "usable enough"?
24. Here are a few screen shots from an application. What problems do
you see
here (usually give a person about 15 minutes and then go over the screen
shot
- don't make it too hard).
25. How have you reported the results of a lab or field study to the
appropriate parties?
26. What tools do you use to prototype screens, windows, or Web pages?
27. What do you like most about the usability field? Least?
28. How would you test the usability of online or paper documentation?
29. What do you know about the products that this company makes? (check
to
see if the person did any research before coming to the interview)
30. What steps have you taken to convince a recalcitrant developer to
listen
to your advice?
31. What are some design techniques for preventing errors rather than
displaying some kind of error message?
32. How would you present the results of a usability test to a senior
VP? A
development group?
33. Can you give a few examples of cognitive principles that should
influence
design?
34. How do you get answers to usability or design questions that you
have in
the absence of another colleague in the area?
35. Pose some human factors problems to the person to get at some
general
problem solving capabilities. I once interviewed with a firm where they
asked
me to re-design the faucets for a bathtub. Not your typical UI design
problem, but it brought up issues of control-display compatibility,
feedback,
errors, safety, efficiency, etc. Several of the good HF textbooks have a
number of examples that could be adapted for this?
36. What are some general internationalization/localization problems and
solutions?
37. What are some visual design principles that you would try to follow
when
designing Web pages or windows? (I'm thinking about things like
balance,
symmetry, consistency, clutter, minimalism, etc. - there are a lot of
things
that would be OK here).
38. How do you decide what tasks should be part of a usability test?
(I'm
looking for things like - most frequent tasks, focus on a new critical
feature, low-use, but extremely critical task that is catastrophic if
done
incorrectly, again there are a number of answers).
39. You are going to work at a company where everyone says that "we have
a
really distinct culture here." How would you go about figuring out what
that
statement means and how it will affect your usability/design work? How
did
you find out about the culture at your current company?
40. Describe your worst experience as a [fill in current position]. How
did
you deal with it?
41. How do you analyze qualitative field data in a way that is useful
for
informing developers how to make design changes?
42. A participant in a lab study has been struggling on the same task
for a
long time. What would you say to get them to move on to the next
question?
43. Show the person a 15 minute segment of a usability test and ask
him/her to
list the problems that they see during the segment. (Make sure that you
have
permission to sue that segment from the participant). Review the tape
with
the participant.
44. Ask the person to do the Heuristic Review at the end of Jakob
Nielsen's
Usability Engineering book. Jakob has an answer list and this gets at a
large
number of design issues.
45. You have time to interview or test 5 users. What criteria would you
use
to choose the 5 people?
46. What are the advantages and disadvantages of Contextual Inquiry
(only ask
if they have listed this on their resume)?
47. How have/would you conduct a competitive analysis of two
applications or
web sites (assuming that there are no legal prohibitions)?
48. The lack of good requirements is often cited as the major flaw in
producing useful products on time and within budget? What methods would
you
use to gather requirements?
49. Describe how the physical environment can have an impact on the
design of
a GUI application.
50. Here is a list of user attributes. Tell me how these attributes
would
affect design (for example, 10 percent of users are colorblind, the
users are
elderly, the users are disabled).
51. What are some general guidelines for making applications or Web
pages
accessible to users with visual, hearing, or motor disabilities?
52. Given that a usability person often delivers "bad news" how do you
(or
your management) keep good relations with the group that you are
delivering
the bad news to?

_______________________________________________
Welcome to the Interaction Design Group!
To post to this list ....... discuss at ixdg.org
(Un)Subscription Options ... http://discuss.ixdg.org/
Announcements List ......... http://subscribe-announce.ixdg.org/
Questions .................. lists at ixdg.org
Home ....................... http://ixdg.org/

7 Feb 2005 - 11:33am
Robert Reimann
2003

Cooper's test is once again up on their site:

http://www.cooper.com/content/company/Interaction_Designer_Test.pdf

They have tests for other roles as well.

Robert.

-----Original Message-----
From:
discuss-interactiondesigners.com-bounces at lists.interactiondesigners.com
[mailto:discuss-interactiondesigners.com-bounces at lists.interactiondesign
ers.com] On Behalf Of Aby Rao
Sent: Monday, February 07, 2005 11:01 AM
To: Lada Gorlenko
Cc: discuss-interactiondesigners.com at lists.interactiondesigners.com
Subject: RE: [ID Discuss] Assessment Tests

[Please voluntarily trim replies to include only relevant quoted
material.]

Is there one for Interaction Design or UI Designer too? Any resources
like links, documents will be appreciated.

thanks

Aby

7 Feb 2005 - 1:15pm
WOFFORD BRAVMAN...
2005

Robert Reimann said:

>Cooper's test is once again up on their site:
>
>http://www.cooper.com/content/company/Interaction_Designer_Test.pdf

This is an excellent test. I see that they list the qualities they are
looking for in test results. Obviously, they don't want to give
everything away, but do they offer more specifics on criteria for
judging responses? For example, I'm curious how they determine that you
have an understanding of the people for whom you are designing.

Thanks!

Melony Wofford Bravmann
Business Manager
User Interface Design
Sales Productivity Systems
SBC Services IT
925-823-2252

7 Feb 2005 - 2:41pm
Troy Brophy
2005

> Cooper's test is once again up on their site:
> They have tests for other roles as well.

I would appreciate some advice/guidance from the list.

I've just formed a software company with a partner. He's the
architect/engineer, I'm the interface designer/documentation writer.

At his suggestion, I've started reading Cooper's About Face 2.0. (I found
and joined this list when I realized that I've a lot to learn in a short
time.)

I live just a few miles from "Cooper U," in San Francisco. They offer a
practicum and classes for interaction designers. The upcoming 4-day
practicum is $1,950. This money would have to come out of my (very) meager
savings account, as we don't intend to seek a small business loan.

What I'd hope to learn from the collective wisdom of this list is:

- Do any of you recommend these courses, given their expense?
- For a very small company with no research budget to speak of, is Cooper's
interview/testing method practicable?
- How did the members of this list learn the skills that they use today?

Thank you in advance for any direction,

Troy Brophy

7 Feb 2005 - 5:40pm
Alain D. M. G. ...
2003

--- Troy Brophy <troy at bitspark.com> a écrit :

> - How did the members of this list learn the skills that they use
> today?
>

- Reading.
- Taking a university course (3-4 months, 3 hours per week) on
quantitative research techniques, which includes interviewing and
several kinds of observation techiques
- Reading again
- Practicing interviewing techniques in circumstances where your
reputation as a consultant will not suffer
- Reading yet again
- Just observing people about anywhere doing any task "in the wild" ,
and taking notes in my diary, to stay in shape
- Reading always, and of course bothering many librarians in many types
of libraires on order to find and get at my needed readings

The costliest item was that single university course yet dollar for
dollar (and hour for hour I should also note, since my time was
valuable) it was the best value because it gave me exposure to a really
wide variety of observation and interview techniques and contact with
practitioners (we worked in teams for our session long practicums)from
an incredible variety of domains (people doing their MBAs in the
neighboring business school, physicians starting new avenues of
research, psychology students doing their PhDs) at several levels.

Alain Vaillancourt

__________________________________________________________
Lèche-vitrine ou lèche-écran ?
magasinage.yahoo.ca

7 Feb 2005 - 5:46pm
Alain D. M. G. ...
2003

--- "Alain D. M. G. Vaillancourt" <ndgmtlcd at yahoo.com> a écrit :

> --- Troy Brophy <troy at bitspark.com> a écrit :
>
> > - How did the members of this list learn the skills that they use
> > today?

> - Taking a university course (3-4 months, 3 hours per week) on
> quantitative research techniques,

Sorry, my error! I should have written QUALITATITVE research
techniques. There was always the possibility of doing quantitative
analysis from some of our results, but we stressed qualitative methods
since they are all too often ignored or dealt with in a summary
orinformal manner.

Alain Vaillancourt

__________________________________________________________
Lèche-vitrine ou lèche-écran ?
magasinage.yahoo.ca

Syndicate content Get the feed