Talk About Network

Google


Register and Login
Nick
Password
Register create new account Sign up is FREE and you can post replies, new topics, bookmark posts and more!
Recover lost password


Data Bases > Pgsql General > High inserting ...
Latest [ Topics | Posts ] Archive Post A New Topic Post a Reply
<< Topic < Post Post 1 of 7 Topic 15970 of 17437
Post > Topic >>

High inserting by syslog

by douglas@[EMAIL PROTECTED] ("Valter Douglas =?utf-8?q?Lisb=C3=B4a?= J Jul 3, 2008 at 12:05 PM

Hello all, I have a perl script thats load a entire day squid log to a=20
postgres table. I run it at midnight by cronjob and turns off the indexes=
=20
before do it (turning it on after). The script works fine, but I want
to=20
change this to a diferent approach.

I'd like to insert on the fly the log lines, so long it be generated to
hav=
e=20
the data on-line. But the table has some indexes and the load of lines is=
=20
about 300.000/day, so the average inserting is 3,48/sec. I think this
could=
=20
overload the database server (i did not test yet), so if I want to create
a=
=20
no indexed table to receive the on-line inserting and do a job moving all=
=20
lines to the main indexed table at midnight.

My question is, Does exists a better solution, or this tatic is a good way
=
to=20
do this?

--=20
Valter Douglas Lisb=C3=B4a Jr.
S=C3=B3cio-Diretor
Trenix - IT Solutions
"Nossas Id=C3=A9ias, suas Solu=C3=A7=C3=B5es!"
www.trenix.com.br
contato@[EMAIL PROTECTED]
 +55 19 3402.2957
Cel. +55 19 9183.4244

--=20
Sent via pgsql-general mailing list (pgsql-general@[EMAIL PROTECTED]
)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-general
 




 7 Posts in Topic:
High inserting by syslog
douglas@[EMAIL PROTECTED]  2008-07-03 12:05:15 
Re: High inserting by syslog
jd@[EMAIL PROTECTED] (&q  2008-07-03 09:03:49 
Re: High inserting by syslog
douglas@[EMAIL PROTECTED]  2008-07-03 13:23:24 
Re: High inserting by syslog
dev@[EMAIL PROTECTED] (R  2008-07-03 17:08:26 
Re: High inserting by syslog
ahodgson@[EMAIL PROTECTED  2008-07-03 09:27:26 
Re: High inserting by syslog
scrawford@[EMAIL PROTECTE  2008-07-03 09:32:53 
Re: High inserting by syslog
Rainer Gerhards <rgerh  2008-07-04 01:41:37 

Post A Reply:
  Go here to Signup

AddThis Feed Button


About - Advertising - Contact - Frequently Asked Questions - Privacy Policy - Terms of Use - Signup

Contact
tan12V112 Sat Nov 22 16:49:28 CST 2008.