Talk About Network

Google


Register and Login
Nick
Password
Register create new account Sign up is FREE and you can post replies, new topics, bookmark posts and more!
Recover lost password


Data Bases > Pgsql General > Re: COPY Perfor...
Latest [ Topics | Posts ] Archive Post A New Topic Post a Reply
<< Topic < Post Post 9 of 9 Topic 15455 of 16965
Post > Topic >>

Re: COPY Performance

by scott.marlowe@[EMAIL PROTECTED] ("Scott Marlowe") May 5, 2008 at 09:08 AM

On Mon, May 5, 2008 at 9:03 AM, Scott Marlowe <scott.marlowe@[EMAIL PROTECTED]
>
wrote:
> On Sun, May 4, 2008 at 5:11 PM, Hans Zaunere <lists@[EMAIL PROTECTED]
> wrote:
>  > Hello,
>  >
>  >  We're using a statement like this to dump between 500K and >5
million rows.
>  >
>  >  COPY(SELECT SomeID FROM SomeTable WHERE SomeColumn > '0')
>  >   TO '/dev/shm/SomeFile.csv'
>
>  Wait, are you really creating a .csv file in shared memory?  Can such
>  a thing even work?
>
>  If you're not creating a file in /dev/shm, where is it being built?
>  On the main OS drive?  the battery backed cached RAID array?

OK, looked it up.  you're making your .csv file in a ramdisk?  If it
gets big it's gonna make the machine start swapping.  i'd suggest
storing only small things in a ram disk really.  Other than that, I'm
not sure what the problem is.

-- 
Sent via pgsql-general mailing list (pgsql-general@[EMAIL PROTECTED]
)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-general
 




 9 Posts in Topic:
COPY Performance
lists@[EMAIL PROTECTED]   2008-05-04 19:11:35 
Re: COPY Performance
tgl@[EMAIL PROTECTED] (T  2008-05-04 19:41:01 
Re: COPY Performance
lists@[EMAIL PROTECTED]   2008-05-05 08:18:07 
Re: COPY Performance
scott.marlowe@[EMAIL PROT  2008-05-04 18:11:15 
Re: COPY Performance
lists@[EMAIL PROTECTED]   2008-05-05 08:11:44 
Re: COPY Performance
scott.marlowe@[EMAIL PROT  2008-05-05 09:01:21 
Re: COPY Performance
lists@[EMAIL PROTECTED]   2008-05-05 16:14:08 
Re: COPY Performance
scott.marlowe@[EMAIL PROT  2008-05-05 09:03:15 
Re: COPY Performance
scott.marlowe@[EMAIL PROT  2008-05-05 09:08:05 

Post A Reply:
  Go here to Signup

AddThis Feed Button


About - Advertising - Contact - Frequently Asked Questions - Privacy Policy - Terms of Use - Signup

Contact
tan12V112 Mon Oct 13 7:17:55 CDT 2008.