Talk About Network

Google


Register and Login
Nick
Password
Register create new account Sign up is FREE and you can post replies, new topics, bookmark posts and more!
Recover lost password


Data Bases > Pgsql Novice > Re: Concurrent ...
Latest [ Topics | Posts ] Archive Post A New Topic Post a Reply
<< Topic < Post Post 2 of 5 Topic 3157 of 3255
Post > Topic >>

Re: Concurrent COPY commands

by ahodgson@[EMAIL PROTECTED] (Alan Hodgson) Jul 2, 2008 at 10:02 AM

On Wednesday 02 July 2008, Phillip Sitbon <phillip@[EMAIL PROTECTED]
> wrote:
> Hello,
>
> I am running some queries that use multiple connections to issue COPY
> commands which bring data into the same table via different files (FIFOs
> to be precise). This is being done on a SMP machine and I am noticing
> that none of the postgres worker processes operate in parallel, even
> though there is data available to all of them. The performance is nearly
> exactly the same as it is for issuing a single COPY command.
> Is this 
> normal behavior, even with all of the separate transactions still in
> progress? Would I be better off doing multithreaded bulk inserts from my
> C program rather than sending the data to FIFOs?

Sounds like you're I/O bound - I doubt any other concurrency mechanism
will 
change that much.

>
> The machine I am using has 16GB of memory and 8 cores, so I've tried to
> optimize the configuration accordingly but I am a little lost in some
> places.

Ah, but what does your RAID controller and drives look like?


-- 
Alan

-- 
Sent via pgsql-novice mailing list (pgsql-novice@[EMAIL PROTECTED]
)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-novice
 




 5 Posts in Topic:
Concurrent COPY commands
phillip@[EMAIL PROTECTED]  2008-07-02 09:44:21 
Re: Concurrent COPY commands
ahodgson@[EMAIL PROTECTED  2008-07-02 10:02:48 
Re: Concurrent COPY commands
phillip@[EMAIL PROTECTED]  2008-07-09 09:35:15 
Re: Concurrent COPY commands
ahodgson@[EMAIL PROTECTED  2008-07-09 09:45:37 
Re: Concurrent COPY commands
phillip@[EMAIL PROTECTED]  2008-07-09 10:07:13 

Post A Reply:
  Go here to Signup

AddThis Feed Button


About - Advertising - Contact - Frequently Asked Questions - Privacy Policy - Terms of Use - Signup

Contact
tan12V112 Sat Oct 11 13:01:33 CDT 2008.