Talk About Network

Google


Register and Login
Nick
Password
Register create new account Sign up is FREE and you can post replies, new topics, bookmark posts and more!
Recover lost password


Data Bases > Pgsql Sql > Re: Removing re...
Latest [ Topics | Posts ] Archive Post A New Topic Post a Reply
<< Topic < Post Post 2 of 5 Topic 3375 of 3799
Post > Topic >>

Re: Removing redundant itemsets

by craig@[EMAIL PROTECTED] (Craig Ringer) Mar 31, 2008 at 06:53 PM

Allan Kamau wrote:
> Hi all,
> I have a list of purchases (market basket) and I would like to select
> non redundant longest possible patterns by eliminating
> (creating/populating other table to contain only non redandant itemsets)
> purchases having item lists which are fully included in at least one
> other purchase.

Here's a possibly slow and surely ugly solution (I think it's right,
though I haven't done more than passing testing):



CREATE VIEW togo_as_arr AS
  SELECT a.tid,
    ARRAY(SELECT item FROM togo b WHERE b.tid = a.tid ORDER BY item)
    AS items
  FROM togo a GROUP BY tid;

SELECT arr_a.tid AS redundant_tid, arr_b.tid AS contained_by
FROM togo_as_arr arr_a CROSS JOIN togo_as_arr arr_b
WHERE arr_a.tid <> arr_b.tid AND arr_a.items <@[EMAIL PROTECTED]
 arr_b.items;



(the view isn't necessary, but does improve the readability of the query).

It groups the purchases up with item lists as arrays, then finds any
purchases with items arrays wholly contained by other item arrays from
other purchases.

I'm *sure* there's a smarter way to do this that avoids the use of
arrays, but I don't seem to be able to come up with one right now. It's
interesting, though, so I might keep fiddling.

--
Craig Ringer

-- 
Sent via pgsql-sql mailing list (pgsql-sql@[EMAIL PROTECTED]
)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-sql
 




 5 Posts in Topic:
Removing redundant itemsets
allank@[EMAIL PROTECTED]   2008-03-31 10:16:17 
Re: Removing redundant itemsets
craig@[EMAIL PROTECTED]   2008-03-31 18:53:28 
Re: Removing redundant itemsets
craig@[EMAIL PROTECTED]   2008-03-31 19:29:22 
Re: Removing redundant itemsets
craig@[EMAIL PROTECTED]   2008-03-31 19:48:34 
Re: Removing redundant itemsets
allank@[EMAIL PROTECTED]   2008-03-31 11:58:50 

Post A Reply:
  Go here to Signup

AddThis Feed Button


About - Advertising - Contact - Frequently Asked Questions - Privacy Policy - Terms of Use - Signup

Contact
tan12V112 Mon Dec 1 22:03:15 CST 2008.