Talk About Network

Google


Register and Login
Nick
Password
Register create new account Sign up is FREE and you can post replies, new topics, bookmark posts and more!
Recover lost password


Data Bases > Pgsql Performance > Re: Background ...
Latest [ Topics | Posts ] Archive Post A New Topic Post a Reply
<< Topic < Post Post 9 of 12 Topic 3995 of 4206
Post > Topic >>

Re: Background writer underemphasized ...

by gsmith@[EMAIL PROTECTED] (Greg Smith) Apr 19, 2008 at 03:29 PM

On Sat, 19 Apr 2008, James Mansion wrote:

> But isn't it the case that while using background writer might result in

> *slightly* more data to write (since data that is updated several times 
> might actually be sent several times), the total amount of data in both 
> cases is much the same?

Really depends on your workload, how many wasted writes there are.  It 
might be significant, it might only be slight.

> And if the buffer backed up in the BGW case, wouldn't it also back up 
> (more?) if the writes are deferred?  And in fact by sending earlier, the

> real bottleneck (the disks) could have been getting on with it and 
> staring their IO earlier?

If you write a giant block of writes, those tend to be sorted by the OS 
and possibly the controller to reduce total seeks.  That's a pretty 
efficient write and it can clear relatively fast.

But if you're been trickling writes in an unstructured form and in low 
volume, there can be a stack of them that aren't sorted well blocking the 
queue from clearing.  With a series of small writes, it's not that 
difficult to end up in a situation where a controller cache is filled with

writes containing a larger seek component than you'd have gotten had you 
written in larger blocks that took advantage of more OS-level elevator 
sorting.  There's actually a pending patch to try and improve this 
situation in regards to checkpoint writes in the queue.

Seeks are so slow compared to more sequential writes that you really can 
end up in the counterintuitive situation that you finish faster by 
avoiding early writes, even in cases when the disk is the bottleneck.

--
* Greg Smith gsmith@[EMAIL PROTECTED]
 http://www.gregsmith.com
Baltimore, MD

-- 
Sent via pgsql-performance mailing list (pgsql-performance@[EMAIL PROTECTED]
)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-performance
 




 12 Posts in Topic:
Background writer underemphasized ...
mjy@[EMAIL PROTECTED] (M  2008-04-16 17:22:50 
Re: Background writer underemphasized ...
Chris Browne <cbbrowne  2008-04-16 13:47:59 
Re: Background writer underemphasized ...
wmoran@[EMAIL PROTECTED]   2008-04-16 14:43:35 
Re: Background writer underemphasized ...
gsmith@[EMAIL PROTECTED]   2008-04-16 15:55:51 
Re: Background writer underemphasized ...
gsmith@[EMAIL PROTECTED]   2008-04-16 15:45:22 
Re: Background writer underemphasized ...
mjy@[EMAIL PROTECTED] (M  2008-04-17 20:46:05 
Re: Background writer underemphasized ...
gsmith@[EMAIL PROTECTED]   2008-04-19 05:22:46 
Re: Background writer underemphasized ...
james@[EMAIL PROTECTED]   2008-04-19 16:06:05 
Re: Background writer underemphasized ...
gsmith@[EMAIL PROTECTED]   2008-04-19 15:29:38 
Re: Background writer underemphasized ...
james@[EMAIL PROTECTED]   2008-04-20 15:41:13 
Re: Background writer underemphasized ...
gsmith@[EMAIL PROTECTED]   2008-04-23 01:11:01 
Re: Background writer underemphasized ...
wmoran@[EMAIL PROTECTED]   2008-04-16 16:07:24 

Post A Reply:
  Go here to Signup

AddThis Feed Button


About - Advertising - Contact - Frequently Asked Questions - Privacy Policy - Terms of Use - Signup

Contact
tan12V112 Thu Aug 21 18:48:40 CDT 2008.