New Study: Celltop Usability Worse Than Wap

12 Jul 2007 - 5:43pm
7 years ago
2 replies
571 reads
Scott Weiss
2005

For Immediate Release
New Study: Celltop Usability Worse Than WAP

July, 2007: New York City: Usable Products Company's recently-completed
report, "Celltop Usability," found that Celltop was harder to use than WAP.
Alltel's Celltop is a mobile widget solution, which Usable Products studied
alongside Axcess Web, a WAP portal, on LG's AX8600 mobile telephone.

According to Scott Weiss, President of Usable Products Company, "Mobile
widgets are 'Web 2.0' for phones." Mobile widgets are highly interactive,
Internet-aware applications. Celltop is a mobile widget solution launched by
Alltel in January 2007, with the promise of increased usability. A case
study from the designers of Celltop states that "Celltop . was created
specifically to communicate the Alltel brand attributes of reliability,
simplicity, and service."

"Unfortunately, Celltop is less usable than WAP," stated Weiss. "Only 7 out
of 10 usability test participants were able to successfully check the
weather in Miami, Florida using Celltop, while all 10 were successful using
Axcess Web, a WAP portal. Furthermore, of those who succeeded, Celltop took
36 seconds (27%) longer than WAP." Half of the participants started with
Celltop; the other half started with Axcess Web.

Participants checked the phone's call log using Celltop and the phone's
native user interface, with similar results: 70% were successful using
Celltop, while 100% were successful using the phone's native user interface
(UI). Celltop required 161% more time to check the call log than the phone's
native UI. Participants needed a full minute to check the call log with
Celltop, and only 23 seconds using the native UI.

"Celltop is visually appealing, but its ease of use is inferior to LG's
native UI," stated Weiss. "Despite poor usability, participants preferred
Celltop overall, 6 to 4. However, not for checking the weather or the call
log-in those cases, participants favored WAP and the phone's native user
interface 7 to 3 over Celltop." Usability tasks included finding and
launching Celltop, checking the weather, sports scores, stock quotes, the
call log, adding the News cell, and reordering cells. 10 one-hour usability
interviews were conducted in Spring, 2007.

The report, "Celltop Usability," delivered in print and on CD ROM, is
available for immediate sale from http://usableproducts.com It spans 50
pages, starting with background on 7 mobile widget solutions. The report
contains 17 charts, dozens of high resolution photographs, 10 demonstration
videos of Celltop in action, and 15 usability video clips.

###

Scott Weiss (sweiss at usableproducts.com) is a mobile usability leader. His
book, "Handheld Usability" (Wiley: 2002), is the pioneering text on mobile
design, prototyping, and usability testing. His team at Usable Products
Company (usableproducts.com) is dedicated to mobile phone and handheld
consumer electronics user interface design and usability benchmarking.

Comments

12 Jul 2007 - 9:12pm
Barbara Ballard
2005

On 7/12/07, Scott Weiss <sweiss at usableproducts.com> wrote:
> For Immediate Release
> New Study: Celltop Usability Worse Than WAP
>
> July, 2007: New York City: Usable Products Company's recently-completed
> report, "Celltop Usability," found that Celltop was harder to use than WAP.
> Alltel's Celltop is a mobile widget solution, which Usable Products studied
> alongside Axcess Web, a WAP portal, on LG's AX8600 mobile telephone.
>

Scott, I was wondering whether the participants had ever used a mobile
phone before. That is, were they equally novice at the two compared
software? And was the 1 hour session for both interfaces, or just
one?

--
Barbara Ballard
barbara at littlespringsdesign.com 1-785-838-3003

13 Jul 2007 - 7:02am
Scott Weiss
2005

Barbara,

Great questions! Details of the recruit and study format are
available (for free) at
http://usableproducts.com/publications/celltop.shtml -- the
thumbnail shots from the Background and Respondents pages zoom up
to be readable. Here's the summary:

- Respondents owned a mobile phone which they had chosen
themselves and paid at least $50 per month on their phone bill.
- Respondents had accessed the wireless web at least once over the
past year.

Ages:
<20: 3
21-30: 3
31-40: 2
41-50: 2

- One hour spanned both UIs on the same AX8600 handset.
- Half started with Axcess Web, half started with Celltop.
- All respondents followed the same task sequence, since it was
logical. We often randomize tasks, but it didn't make sense in
this study.

While my press release covers a nice overview, there is a lot more
to the report: We include charts of predicted vs. perceived
values; we asked respondents to predict ease of use and purchase
likelihood before and after the time spent with Celltop.

Best,
-scott

Scott Weiss
President, Usable Products Company
http://usableproducts.com
+1.212.929.8599

On Thu Jul 12 19:12:51 PDT 2007, Barbara Ballard
<bballa01 at gmail.com> wrote:

Scott, I was wondering whether the participants had ever used a
mobile phone before. That is, were they equally novice at the two
compared software? And was the 1 hour session for both
interfaces, or just one?

Syndicate content Get the feed