[Heartlogic-dev] Re: internal representation of scores

[Joshua N Pritikin]

On Mon, 2005-05-23 at 22:07 -0500, William L. Jarrold wrote:
> On Fri, 20 May 2005, Joshua N Pritikin wrote:
> >> (I tried loging out and login in
> >> again and then hit the "rate it" button as per a prior email but
> >> it just said, "You are done. Please try again later.").
> >
> > OK, I added a button for that on the front page.  Even so, you should be
> > able to repeat the ratings again if you log out.
> 
> Awesome.
> 
> Okaqy I tried to test this...
> 
> I went to the website and noticed two new problems...
> 
> Problem 1:
> 
> First I was to rate the goals with the first story....
> 
> Jack believes that Jill wants something about a pale of water for 
> herself.
> 
> Jack believes that Jill wants to avoid something about a pale of
> water for herself.
> 
> Jack believes that Jill feels indifferent about a pale of water
> for herself.
> 
> ...and then it asked mme about the very same goals.  In other words it
> repeated the same triad of items.  It should not do this.

Well .. maybe we need to redesign how the items are selected.  If you
look at the data below, what happened was that items #21-23 were the
last unrated items.  Then a new guest account was created and items
#21-23 were the first items selected for the "new" guest.

The items are selected in order of standard deviation so maybe this kind
of problem won't happen if our data is more sane.  Even so, I guess it
could still happen.

select e1.expert_login as user,e2.expert_login as study,construal_id,
extract(day from rating_ctime) from rating join expert as e1 on
(rating_expert_id = e1.expert_id) join expert as e2 on
(construal_expert_id = e2.expert_id) order by rating_ctime desc;

        user         |    study     | item         | date_part
---------------------+--------------+--------------+-----------
 ohl1                | .public      |           22 |        24
 ohl1                | .public      |           23 |        24
 ohl1                | .public      |           21 |        24
 ohl1                | .public      |           17 |        24
 ohl1                | .public      |           18 |        24
 ohl1                | .public      |           19 |        24
 .guest-200505240242 | .Rumination1 |            6 |        24
 .guest-200505240242 | .Rumination1 |            7 |        24
 .guest-200505240242 | .Rumination1 |            8 |        24
 .guest-200505240242 | .Rumination1 |            5 |        24
 .guest-200505240242 | .Rumination1 |           12 |        24
 .guest-200505240242 | .Rumination1 |           10 |        24
 .guest-200505240242 | .Rumination1 |            9 |        24
 .guest-200505240242 | .Rumination1 |            4 |        24
 .guest-200505240242 | .Rumination1 |            2 |        24
 .guest-200505240242 | .Rumination1 |           11 |        24
 .guest-200505240242 | .Rumination1 |            3 |        24
 .guest-200505240242 | .public      |           23 |        24
 .guest-200505240242 | .public      |           22 |        24
 .guest-200505240242 | .public      |           21 |        24
 .guest-200505201605 | .public      |           23 |        24
 .guest-200505201605 | .public      |           22 |        24
 .guest-200505201605 | .public      |           21 |        24

> Problem 2:
> 
> After I got the above repetition I kept filling out items.  It then
> told me I was done.  I logged out.  I logged in again.  It told me I
> was done.  (Duh, I should have recalled what you said, i.e. "I added a
> button for that on the front page."). I logged out, I looged in again.
> I hit the "reset ratings" button.  It then let me fill out two story
> items but then told I was done.  It should not do this - it should let
> me do *all* the items, including the rumintation items.

Yes, you are correct.  The reason you didn't get to rate all the items
is another implementation detail which might be wrong.  I artificially
limited the number of ratings per item to 12.  I never thought we would
hit this during testing, but we did.

ohl=> select c_stat_ratings from c_stat;
 c_stat_ratings
----------------
             10
              8
              7
              8
              8
              8
             10
             12
             12
             11
             11
              6
             12
             13
             12
             12
             12
             12

I'll remove this limit for now (increase to 200) but we should probably
design a better solution.

-- 
If you are an American then support http://fairtax.org
 (Permanently replace 50,000+ pages of tax law with about 200 pages.)

signature.asc
Description: This is a digitally signed message part