Talk About Network

Google


Register and Login
Nick
Password
Register create new account Sign up is FREE and you can post replies, new topics, bookmark posts and more!
Recover lost password


Data Bases > Pgsql Hackers > XIDs and big bo...
Latest [ Topics | Posts ] Archive Post A New Topic Post a Reply
<< Topic < Post Post 1 of 9 Topic 9343 of 9812
Post > Topic >>

XIDs and big boxes again ...

by postgres@[EMAIL PROTECTED] (Hans-Juergen Schoenig) May 11, 2008 at 12:05 PM

hello everybody,

i know that we have discussed this issue already. my view of the problem 
has changed in the past couple of weeks, however. maybe other people had 
similar experiences.
i have been working on a special purpose application which basically 
looks like that:

    - 150.000 tables (for several reasons heavily constraint excluded): 
small changes made once in a while
    - XX medium sized tables which are heavily changed.
    - size: > 5 TB

my DB is facing around 600mio transaction a month. 85% of those contain 
at least some small modification so I cannot save on XIDs.
my problem is that I cannot VACUUM FREEZE my 150k tables where most of 
the data is as I have a couple of thousand transactions a day modifying 
this data.
but, i also have troubles to prevent myself from transaction wraparound 
as it is pretty boring to vacuum that much data under heavy load - with 
some useful vacuum delay it just takes too long.
i basically have to vacuum the entire database too often to get spare
XIDs.

i suggest to introduce a --with-long-xids flag which would give me 62 / 
64 bit XIDs per vacuum on the entire database.
this should be fairly easy to implement.
i am not too concerned about the size of the tuple header here - if we 
waste 500 gb of storage here i am totally fine.

any chances to get a properly written fix like that in?
maybe somebody else has similar problems? hannu krosing maybe? :-P

    hans

-- 
Cybertec Schönig & Schönig GmbH
PostgreSQL Solutions and Sup****t
Gröhrmühlgasse 26, A-2700 Wiener Neustadt
Tel: +43/1/205 10 35 / 340
www.postgresql-sup****t.de, www.postgresql-sup****t.com


-- 
Sent via pgsql-hackers mailing list (pgsql-hackers@[EMAIL PROTECTED]
)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-hackers
 




 9 Posts in Topic:
XIDs and big boxes again ...
postgres@[EMAIL PROTECTED  2008-05-11 12:05:44 
Re: XIDs and big boxes again ...
stark@[EMAIL PROTECTED]   2008-05-11 12:22:57 
Re: XIDs and big boxes again ...
tgl@[EMAIL PROTECTED] (T  2008-05-11 12:46:51 
Re: XIDs and big boxes again ...
postgres@[EMAIL PROTECTED  2008-05-11 18:50:42 
Re: XIDs and big boxes again ...
tgl@[EMAIL PROTECTED] (T  2008-05-11 13:01:49 
Re: XIDs and big boxes again ...
jd@[EMAIL PROTECTED] (&q  2008-05-11 10:10:40 
Re: XIDs and big boxes again ...
postgres@[EMAIL PROTECTED  2008-05-12 09:05:54 
Re: XIDs and big boxes again ...
stark@[EMAIL PROTECTED]   2008-05-12 09:37:24 
Re: XIDs and big boxes again ...
matthew@[EMAIL PROTECTED]  2008-05-12 13:55:45 

Post A Reply:
  Go here to Signup

AddThis Feed Button


About - Advertising - Contact - Frequently Asked Questions - Privacy Policy - Terms of Use - Signup

Contact
tan13V112 Thu Jul 24 13:20:34 CDT 2008.