Talk About Network

Google


Register and Login
Nick
Password
Register create new account Sign up is FREE and you can post replies, new topics, bookmark posts and more!
Recover lost password


Data Bases > Pgsql Performance > Re: Creating la...
Latest [ Topics | Posts ] Archive Post A New Topic Post a Reply
<< Topic < Post Post 4 of 6 Topic 3981 of 4355
Post > Topic >>

Re: Creating large database of MD5 hash values

by alvherre@[EMAIL PROTECTED] (Alvaro Herrera) Apr 11, 2008 at 10:25 AM

Jon Stewart escribió:
> Hello,
> 
> I am creating a large database of MD5 hash values. I am a relative
> newb with PostgreSQL (or any database for that matter). The schema and
> operation will be quite simple -- only a few tables, probably no
> stored procedures -- but I may easily end up with several hundred
> million rows of hash values, possible even get into the billions. The
> hash values will be organized into logical sets, with a many-many
> relation****p. I have some questions before I set out on this endeavor,
> however, and would appreciate any and all feedback, including SWAGs,
> WAGs, and outright lies. :-) I am trying to batch up operations as
> much as possible, so I will largely be doing comparisons of whole
> sets, with bulk COPY im****ting. I hope to avoid single hash value
> lookup as much as possible.

If MD5 values will be your primary data and you'll be storing millions
of them, it would be wise to create your own datatype and operators with
the most compact and efficient representation possible.

-- 
Alvaro Herrera                               
http://www.CommandPrompt.com/
PostgreSQL Replication, Consulting, Custom Development, 24x7 sup****t

-- 
Sent via pgsql-performance mailing list (pgsql-performance@[EMAIL PROTECTED]
)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-performance
 




 6 Posts in Topic:
Creating large database of MD5 hash values
jonathan.l.stewart@[EMAIL  2008-04-10 10:48:59 
Re: Creating large database of MD5 hash values
dmagick@[EMAIL PROTECTED]  2008-04-11 15:11:34 
Re: Creating large database of MD5 hash values
fweimer@[EMAIL PROTECTED]  2008-04-11 16:05:00 
Re: Creating large database of MD5 hash values
alvherre@[EMAIL PROTECTED  2008-04-11 10:25:44 
Re: Creating large database of MD5 hash values
jonathan.l.stewart@[EMAIL  2008-04-11 11:28:55 
Re: Creating large database of MD5 hash values
fweimer@[EMAIL PROTECTED]  2008-04-11 19:04:00 

Post A Reply:
  Go here to Signup

AddThis Feed Button


About - Advertising - Contact - Frequently Asked Questions - Privacy Policy - Terms of Use - Signup

Contact
tan12V112 Mon Oct 13 2:18:25 CDT 2008.