Talk About Network

Google


Register and Login
Nick
Password
Register create new account Sign up is FREE and you can post replies, new topics, bookmark posts and more!
Recover lost password


Data Bases > Pgsql Performance > Creating large ...
Latest [ Topics | Posts ] Archive Post A New Topic Post a Reply
<< Topic < Post Post 1 of 6 Topic 3981 of 4156
Post > Topic >>

Creating large database of MD5 hash values

by jonathan.l.stewart@[EMAIL PROTECTED] ("Jon Stewart") Apr 10, 2008 at 10:48 AM

Hello,

I am creating a large database of MD5 hash values. I am a relative
newb with PostgreSQL (or any database for that matter). The schema and
operation will be quite simple -- only a few tables, probably no
stored procedures -- but I may easily end up with several hundred
million rows of hash values, possible even get into the billions. The
hash values will be organized into logical sets, with a many-many
relation****p. I have some questions before I set out on this endeavor,
however, and would appreciate any and all feedback, including SWAGs,
WAGs, and outright lies. :-) I am trying to batch up operations as
much as possible, so I will largely be doing comparisons of whole
sets, with bulk COPY im****ting. I hope to avoid single hash value
lookup as much as possible.

1. Which datatype should I use to represent the hash value? UUIDs are
also 16 bytes...
2. Does it make sense to denormalize the hash set relation****ps?
3. Should I index?
4. What other data structure options would it make sense for me to choose?

Thanks in advance,


Jon

-- 
Sent via pgsql-performance mailing list (pgsql-performance@[EMAIL PROTECTED]
)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-performance
 




 6 Posts in Topic:
Creating large database of MD5 hash values
jonathan.l.stewart@[EMAIL  2008-04-10 10:48:59 
Re: Creating large database of MD5 hash values
dmagick@[EMAIL PROTECTED]  2008-04-11 15:11:34 
Re: Creating large database of MD5 hash values
fweimer@[EMAIL PROTECTED]  2008-04-11 16:05:00 
Re: Creating large database of MD5 hash values
alvherre@[EMAIL PROTECTED  2008-04-11 10:25:44 
Re: Creating large database of MD5 hash values
jonathan.l.stewart@[EMAIL  2008-04-11 11:28:55 
Re: Creating large database of MD5 hash values
fweimer@[EMAIL PROTECTED]  2008-04-11 19:04:00 

Post A Reply:
  Go here to Signup

AddThis Feed Button


About - Advertising - Contact - Frequently Asked Questions - Privacy Policy - Terms of Use - Signup

Contact
tan13V112 Sun Jul 6 19:58:51 CDT 2008.