Evaluating awareness [was: Measuring awareness....]

16 Mar 2004 - 5:57pm
10 years ago
1 reply
532 reads
Todd Warfel
2003

Guys, I'm not looking for a system. I'm looking for methods to evaluate
these systems. I have some ideas, but as I stated earlier, I'm looking
for methods to evaluate...
[...]
I've done some preliminary research into CMC evaluation, effective
computing evaluation, and situational awareness evaluation.

A few high-level questions we want to answer:
• Is it meaningful?
• Does it have an impact on the awareness (moreso than w/o the system)?
• How many levels are appropriate for communicating awareness (e.g.
here; here, but busy; not here)?
• Is the system tunable enough to provide meaning (users will be able
to "tune" the display and tweak it's output)?
• Does it have an impact on the relationship? What kind?
• Does the system make you feel obligated to interact with the person
(e.g. the display communicates that they're there, but maybe sad, so
you feel obligated to take them to lunch)?

We're going to do some baseline measurements to gather info on current
interaction and awareness. We have some ideas for this, but any input
you could provide would be useful and appreciated. Also, we'd like to
take measurements during intervals of the installation (e.g. bi-weekly)
and once the system is removed for a period of time (e.g. 2-4 weeks).
Then we'll reinstall it and measure again to see what the impact is.

Thoughts?

On Mar 16, 2004, at 5:35 PM, Casey Jones wrote:

> It might not be the system you're looking for, Todd, but their process
> could be helpful to you since it included discussions on the issues of
> awareness and avoiding intrusion, although distributed environments
> were more of a focus than co-location.
>
> ..casey

Cheers!

Todd R. Warfel
User Experience Architect
MessageFirst | making products easier to use
--------------------------------------
Contact Info
voice: (607) 339-9640
email: twarfel at messagefirst.com
web: www.messagefirst.com
aim: twarfel at mac.com
--------------------------------------
In theory, theory and practice are the same.
In practice, they are not.
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: text/enriched
Size: 2283 bytes
Desc: not available
Url : http://lists.interactiondesigners.com/private.cgi/discuss-interactiondesigners.com/attachments/20040316/459066ad/attachment.bin

Comments

16 Mar 2004 - 7:12pm
Donna Maurer
2003

Have a look at some of the technology probe work. Here's a couple of refs:

http://interliving.kth.se/papers.html
http://www-ihm.lri.fr/insitu/projets/probes.en.html
http://www.cs.umd.edu/hcil/interliving/chi02/hutchinson.htm

I can't get on to the ACM digital library right now, but there should be
some relevant papers from the last few years at CHI.

Donna

At 09:57 AM 3/17/2004, you wrote:
>Guys, I'm not looking for a system. I'm looking for methods to evaluate
>these systems. I have some ideas, but as I stated earlier, I'm looking for
>methods to evaluate...
>[...]
>I've done some preliminary research into CMC evaluation, effective
>computing evaluation, and situational awareness evaluation.

-------------------------------------------------
Donna Maurer
Usability Specialist
Step Two Designs Pty Ltd

Knowledge Management / Content Management / Intranets

http://www.steptwo.com.au/
donna at steptwo.com.au

Syndicate content Get the feed