Talk About Network

Google


Register and Login
Nick
Password
Register create new account Sign up is FREE and you can post replies, new topics, bookmark posts and more!
Recover lost password


Data Bases > Pgsql Performance > Backup causing ...
Latest [ Topics | Posts ] Archive Post A New Topic Post a Reply
<< Topic < Post Post 1 of 11 Topic 4047 of 4159
Post > Topic >>

Backup causing poor performance - suggestions

by lance@[EMAIL PROTECTED] ("Campbell, Lance") May 5, 2008 at 09:59 AM

This is a multi-part message in MIME format.

------_=_NextPart_001_01C8AEC0.AED6D14B
Content-Type: text/plain;
	charset="us-ascii"
Content-Transfer-Encoding: quoted-printable

PostgreSQL: 8.2.4

=20

We currently backup all of our database tables per schema using pg_dump
every half hour.  We have been noticing that the database performance
has been very poor during the backup process.  How can I improve the
performance?

=20

Server Specs:

Dedicated DB server

Database takes up 8.0 Gig of disk space

2 Xeon 5160 dual cores 3.0=20

16 G of memory

Two disks in raid 1 are used for the OS, database and backups.  SAS
10,000 RPM drives.

OS: Linux AS 4.x 64 bit

shared_buffers =3D 1 GB

work_mem =3D 20MB

max_fsm_pages =3D 524288

random_page_cost=3D1.0

effective_cache_size=3D16GB

max_connections=3D150

=20

All other settings are the default settings. =20

=20

I have tried doing backups to a second set of disks but the performance
only improved somewhat.

=20

Does anyone have advice on how to improve my performance during backup?
Would adding two quad core processors improve performance?

=20

Thanks,

=20

=20

Lance Campbell

Project Manager/Software Architect

Web Services at Public Affairs

University of Illinois

217.333.0382

http://webservices.uiuc.edu

=20


------_=_NextPart_001_01C8AEC0.AED6D14B
Content-Type: text/html;
	charset="us-ascii"
Content-Transfer-Encoding: quoted-printable

<html xmlns:o=3D"urn:schemas-microsoft-com:office:office" =
xmlns:w=3D"urn:schemas-microsoft-com:office:word" =
xmlns:st1=3D"urn:schemas-microsoft-com:office:smarttags" =
xmlns=3D"http://www.w3.org/TR/REC-html40">

<head>
<meta http-equiv=3DContent-Type content=3D"text/html; =
charset=3Dus-ascii">
<meta name=3DGenerator content=3D"Microsoft Word 11 (filtered medium)">
<o:SmartTagType =
namespaceuri=3D"urn:schemas-microsoft-com:office:smarttags"
 name=3D"PlaceName"/>
<o:SmartTagType =
namespaceuri=3D"urn:schemas-microsoft-com:office:smarttags"
 name=3D"PlaceType"/>
<o:SmartTagType =
namespaceuri=3D"urn:schemas-microsoft-com:office:smarttags"
 name=3D"place"/>
<!--[if !mso]>
<style>
st1\:*{behavior:url(#default#ieooui) }
</style>
<![endif]-->
<style>
<!--
 /* Style Definitions */
 p.MsoNormal, li.MsoNormal, div.MsoNormal
	{margin:0in;
	margin-bottom:.0001pt;
	font-size:12.0pt;
	font-family:"Times New Roman";}
a:link, span.MsoHyperlink
	{color:blue;
	text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
	{color:purple;
	text-decoration:underline;}
span.EmailStyle17
	{mso-style-type:personal-compose;
	font-family:Arial;
	color:windowtext;}
@[EMAIL PROTECTED]
 Section1
	{size:8.5in 11.0in;
	margin:1.0in 1.25in 1.0in 1.25in;}
div.Section1
	{page:Section1;}
-->
</style>

</head>

<body lang=3DEN-US link=3Dblue vlink=3Dpurple>

<div class=3DSection1>

<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>PostgreSQL: 8.2.4<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'><o:p>&nbsp;</o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>We currently backup all of our database tables per =
schema
using pg_dump every half hour.&nbsp; We have been noticing that the =
database
performance has been very poor during the backup process.&nbsp; How can =
I
improve the performance?<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'><o:p>&nbsp;</o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Server Specs:<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Dedicated DB server<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Database takes up 8.0 Gig of disk =
space<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>2 Xeon 5160 dual cores 3.0 =
<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>16 G of memory<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Two disks in raid 1 are used for the OS, database and
backups.&nbsp; SAS 10,000 RPM drives.<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>OS: Linux AS 4.x 64 bit<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>shared_buffers =3D 1 GB<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>work_mem =3D 20MB<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>max_fsm_pages =3D 524288<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>random_page_cost=3D1.0<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>effective_cache_size=3D16GB<o:p></o:p></span></font></=
p>

<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>max_connections=3D150<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'><o:p>&nbsp;</o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>All other settings are the default settings.&nbsp; =
<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'><o:p>&nbsp;</o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>I have tried doing backups to a second set of disks =
but the
performance only improved somewhat.<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'><o:p>&nbsp;</o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Does anyone have advice on how to improve my =
performance
during backup?&nbsp; Would adding two quad core processors improve =
performance?<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'><o:p>&nbsp;</o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Thanks,<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'><o:p>&nbsp;</o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'><o:p>&nbsp;</o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Lance Campbell</span></font><o:p></o:p></p>

<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Project Manager/Software =
Architect</span></font><o:p></o:p></p>

<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Web Services&nbsp;at Public =
Affairs</span></font><o:p></o:p></p>

<p class=3DMsoNormal><st1:place w:st=3D"on"><st1:PlaceType =
w:st=3D"on"><font size=3D2
  face=3DArial><span =
style=3D'font-size:10.0pt;font-family:Arial'>University</span></font></st=
1:PlaceType><font
 size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;font-family:Arial'> of <st1:PlaceName
 =
w:st=3D"on">Illinois</st1:PlaceName></span></font></st1:place><o:p></o:p>=
</p>

<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>217.333.0382</span></font><o:p></o:p></p>

<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>http://webservices.uiuc.edu</span></font><o:p></o:p></=
p>

<p class=3DMsoNormal><font size=3D3 face=3D"Times New Roman"><span =
style=3D'font-size:
12.0pt'><o:p>&nbsp;</o:p></span></font></p>

</div>

</body>

</html>

------_=_NextPart_001_01C8AEC0.AED6D14B--
 




 11 Posts in Topic:
Backup causing poor performance - suggestions
lance@[EMAIL PROTECTED]   2008-05-05 09:59:57 
Re: Backup causing poor performance - suggestions
scott.marlowe@[EMAIL PROT  2008-05-05 09:05:32 
Re: Backup causing poor performance - suggestions
lance@[EMAIL PROTECTED]   2008-05-05 10:10:22 
Re: Backup causing poor performance - suggestions
scott.marlowe@[EMAIL PROT  2008-05-05 09:54:15 
Re: Backup causing poor performance - suggestions
craig_james@[EMAIL PROTEC  2008-05-05 09:10:16 
Re: Backup causing poor performance - suggestions
scott.marlowe@[EMAIL PROT  2008-05-05 11:05:03 
Re: Backup causing poor performance - suggestions
simon@[EMAIL PROTECTED]   2008-05-05 18:43:52 
Re: Backup causing poor performance - suggestions
scott.marlowe@[EMAIL PROT  2008-05-05 13:44:16 
Re: Backup causing poor performance - suggestions
gsmith@[EMAIL PROTECTED]   2008-05-05 16:03:58 
Re: Backup causing poor performance - suggestions
gsmith@[EMAIL PROTECTED]   2008-05-05 16:11:27 
Re: Backup causing poor performance - suggestions
scott.marlowe@[EMAIL PROT  2008-05-05 15:50:30 

Post A Reply:
  Go here to Signup

AddThis Feed Button


About - Advertising - Contact - Frequently Asked Questions - Privacy Policy - Terms of Use - Signup

Contact
tan13V112 Wed Jul 9 0:00:30 CDT 2008.