Talk About Network

Google


Register and Login
Nick
Password
Register create new account Sign up is FREE and you can post replies, new topics, bookmark posts and more!
Recover lost password


Data Bases > Pgsql Performance > Re: Best practi...
Latest [ Topics | Posts ] Archive Post A New Topic Post a Reply
<< Topic < Post Post 8 of 10 Topic 4021 of 4424
Post > Topic >>

Re: Best practice to load a huge table from ORACLE to PG

by malosso@[EMAIL PROTECTED] ("Adonias Malosso") Apr 28, 2008 at 06:37 PM

------=_Part_5855_26718264.1209418666552
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable
Content-Disposition: inline

Jonah,

Thank you for the answer. Good to know about this enterprise DB feature.

I=B4ll follow using pgloader.

Regards.

Adonias Malosso

On Sat, Apr 26, 2008 at 10:14 PM, Jonah H. Harris <jonah.harris@[EMAIL PROTECTED]
>
wrote:

> On Sat, Apr 26, 2008 at 9:25 AM, Adonias Malosso <malosso@[EMAIL PROTECTED]
>
> wrote:
> > I=B4d like to know what=B4s the best practice to LOAD a 70 milion
rows,=
 101
> > columns table
> > from ORACLE to PGSQL.
>
> The fastest and easiest method would be to dump the data from Oracle
> into CSV/delimited format using something like ociuldr
> (http://www.anysql.net/en/ociuldr.html)
and load it back into PG using
> pg_bulkload (which is a helluva lot faster than COPY).  Of course, you
> could try other things as well... such as setting up generic
> connectivity to PG and inserting the data to a PG table over the
> database link.
>
> Similarly, while I hate to see shameless self-plugs in the community,
> the *fastest* method you could use is dblink_ora_copy, contained in
> EnterpriseDB's PG+ Advanced Server; it uses an optimized OCI
> connection to COPY the data directly from Oracle into Postgres, which
> also saves you the intermediate step of dumping the data.
>
> --
> Jonah H. Harris, Sr. Software Architect | phone: 732.331.1324
> EnterpriseDB Cor****ation | fax: 732.331.1301
> 499 Thornall Street, 2nd Floor | jonah.harris@[EMAIL PROTECTED]
> Edison, NJ 08837 | http://www.enterprisedb.com/
>

------=_Part_5855_26718264.1209418666552
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable
Content-Disposition: inline

<div>Jonah,</div>
<div>&nbsp;</div>
<div>Thank you for the answer. Good to know about this enterprise DB
featur=
e.</div>
<div>&nbsp;</div>
<div>I=B4ll follow using pgloader.</div>
<div>&nbsp;</div>
<div>Regards.</div>
<div>&nbsp;</div>
<div>Adonias Malosso<br><br></div>
<div class=3D"gmail_quote">On Sat, Apr 26, 2008 at 10:14 PM, Jonah H.
Harri=
s &lt;<a
href=3D"mailto:jonah.harris@[EMAIL PROTECTED]
">jonah.harris@[EMAIL PROTECTED]
>&=
gt; wrote:<br>
<blockquote class=3D"gmail_quote" style=3D"PADDING-LEFT: 1ex; MARGIN: 0px
0=
px 0px 0.8ex; BORDER-LEFT: #ccc 1px solid">
<div class=3D"Ih2E3d">On Sat, Apr 26, 2008 at 9:25 AM, Adonias Malosso
&lt;=
<a href=3D"mailto:malosso@[EMAIL PROTECTED]
">malosso@[EMAIL PROTECTED]
>&gt;
wrote:<br>&g=
t; I=B4d like to know what=B4s the best practice to LOAD a 70 milion rows,
=
101<br>
&gt; columns table<br>&gt; from ORACLE to PGSQL.<br><br></div>The fastest
a=
nd easiest method would be to dump the data from Oracle<br>into
CSV/delimit=
ed format using something like ociuldr<br>(<a
href=3D"http://www.anysql.net=
/en/ociuldr.html"
target=3D"_blank">http://www.anysql.net/en/ociuldr.html</=
a>) and load it back into PG using<br>
pg_bulkload (which is a helluva lot faster than COPY). &nbsp;Of course,
you=
<br>could try other things as well... such as setting up
generic<br>connect=
ivity to PG and inserting the data to a PG table over the<br>database
link.=
<br>
<br>Similarly, while I hate to see shameless self-plugs in the
community,<b=
r>the *fastest* method you could use is dblink_ora_copy, contained
in<br>En=
terpriseDB&#39;s PG+ Advanced Server; it uses an optimized
OCI<br>connectio=
n to COPY the data directly from Oracle into Postgres, which<br>
also saves you the intermediate step of dumping the data.<br><font
color=3D=
"#888888"><br>--<br>Jonah H. Harris, Sr. Software Architect | phone:
732.33=
1.1324<br>EnterpriseDB Cor****ation | fax: 732.331.1301<br>499 Thornall
Stre=
et, 2nd Floor | <a
href=3D"mailto:jonah.harris@[EMAIL PROTECTED]
">jonah.harr=
is@[EMAIL PROTECTED]
><br>
Edison, NJ 08837 | <a href=3D"http://www.enterprisedb.com/"
target=3D"_blan=
k">http://www.enterprisedb.com/</a><br></font></blockquote></div><br>

------=_Part_5855_26718264.1209418666552--
 




 10 Posts in Topic:
Best practice to load a huge table from ORACLE to PG
malosso@[EMAIL PROTECTED]  2008-04-26 10:25:22 
Re: Best practice to load a huge table from ORACLE to PG
jd@[EMAIL PROTECTED] (&q  2008-04-26 08:10:24 
Re: Best practice to load a huge table from ORACLE to PG
llonergan@[EMAIL PROTECTE  2008-04-26 09:13:34 
Re: Best practice to load a huge table from ORACLE to PG
jonah.harris@[EMAIL PROTE  2008-04-26 21:14:53 
Re: Best practice to load a huge table from ORACLE to PG
gsmith@[EMAIL PROTECTED]   2008-04-27 09:01:46 
Re: Best practice to load a huge table from ORACLE to PG
dfontaine@[EMAIL PROTECTE  2008-04-28 09:49:37 
Re: Best practice to load a huge table from ORACLE to PG
tino@[EMAIL PROTECTED] (  2008-04-28 21:59:02 
Re: Best practice to load a huge table from ORACLE to PG
malosso@[EMAIL PROTECTED]  2008-04-28 18:37:46 
Re: Best practice to load a huge table from ORACLE to PG
jonah.harris@[EMAIL PROTE  2008-04-28 23:31:11 
Re: Best practice to load a huge table from ORACLE to PG
Dorren <database.repli  2008-04-29 00:09:29 

Post A Reply:
  Go here to Signup

AddThis Feed Button


About - Advertising - Contact - Frequently Asked Questions - Privacy Policy - Terms of Use - Signup

Contact
tan12V112 Mon Dec 1 9:04:43 CST 2008.