[Search for users] [Overall Top Noters] [List of all Conferences] [Download this site]

Conference orarep::nomahs::dec_data_distributor

Title:The Replication Option for Rdb
Notice:Product renamed to Replication Option for Rdb
Moderator:BROKE::PROTEAU
Created:Wed Mar 02 1994
Last Modified:Wed Jun 04 1997
Last Successful Update:Fri Jun 06 1997
Number of topics:287
Total number of notes:1231

212.0. "COSI-F-EXQUOTA transfering 2 million records" by ORAREP::BASICO::ISMAN1 () Thu May 23 1996 08:05


  Hi all,


    We're trying to transfer about 2 million records from a VAX system running
  VMS 6.1, RDB 6.0-1 and DDAL 6.0 to another AXP one running the same versions.

    The transfer is a REPLICATION one and nearly at the end of the process it
  stops with the following error

*******************************************************************************

Transfer database = HAL_USER1:[DDAL]DDAL$TR_DB
Transfer name     = GEARS_TO_DEV
Transfer option   = I (Initial replication transfer)

09:17:13  %DDAL-I-READTRDEF, reading the transfer definition from the transfer d
atabase
09:17:16  %DDAL-I-ATTACHSDB, attaching to source database _DSA5:[MRD.DAT]MRD.RDB
09:17:18  %DDAL-I-STOTRADEF, storing transfer definition in _DSA5:[MRD.DAT]MRD.R
DB
09:17:19  %DDAL-I-ALREDYSTO, transfer definition already stored in source databa
se
09:17:19  %DDAL-I-ATTACHTDB, attaching to target database IB001"NEAR_ADM"::NEAR$
MRD_DAT:MRD_DEV
09:17:24  %DDAL-I-STADATTRM, starting data transfer/modification

09:17:24  %DDAL-I-LOARELDAT, loading data for relation RDB$VINTAGE

09:17:30  %DDAL-I-DEFINEREL, defining relation GEARS_96
09:17:31  %DDAL-I-LOARELDAT, loading data for relation GEARS_96

12:04:54  %DDAL-I-RELATSTAT,                RELATION GEARS_96
          %DDAL-I-RECFRMSRC,    1946033 records copied from _DSA5:[MRD.DAT]MRD.R
DB

          %DDAL-I-RECTOTARG,    1946033 records copied into IB001"NEAR_ADM"::NEA
R$MRD_DAT:MRD_DEV

12:04:54  %DDAL-I-DEFINEIDX, defining index DDAL$DBKEY_INDEX1_12
----- 23-MAY-1996 12:09:53.20 ----- Error           -------------------------
%DDAL-E-ERRACCDSTDB, error occurred accessing the destination database
-DDAL-E-SUPP, %COSI-F-UNEXPERR, unexpected system error
-DDAL-E-SUPP, -COSI-F-EXQUOTA, exceeded quota

$ LOGOUT
  HUERTAS      job terminated at 23-MAY-1996 12:09:58.41

  Accounting information:
  Buffered I/O count:          245258         Peak working set size:   26698
  Direct I/O count:             87703         Peak page file size:     34660
  Page faults:                  26575         Mounted volumes:             0
  Charged CPU time:           0 00:36:05.44   Elapsed time:     0 02:52:51.10


*******************************************************************************


   We think that there is no problem with disk quotas and the NEAR_ADM uaf 
 quotas are the following:


	Maxjobs:         0  Fillm:       300  Bytlm:        90000
	Maxacctjobs:     0  Shrfillm:      0  Pbytlm:           0
	Maxdetach:       0  BIOlm:     10000  JTquota:       4096
	Prclm:          10  DIOlm:      2000  WSdef:         4096
	Prio:            4  ASTlm:       250  WSquo:         8096
	Queprio:         4  TQElm:       300  WSextent:     16384
	CPU:        (none)  Enqlm:     10000  Pgflquo:     200000



   Could anyone tell us what may be happening? Any suggestions, comments,...


   Thanks in advance for your help


   Marta
T.RTitleUserPersonal
Name
DateLines
212.1an experiment to tryBROKE::PROTEAUJean-Claude ProteauThu May 23 1996 10:0217
    
    I suggest you try an experiment to determine if the problem involves
    Data Distributor or if the problem occurs without it.
    
    You already have the target database, MRD_DEV on the remote system,
    IB001.  Table GEARS_96 exists and has 1946033 rows of data in it.
    
    The error occurred while Data Distributor was trying to add a unique
    index on GEARS_96(DDAL$DBKEY).  I'd like you to try to create such an
    index by using interactive SQL rather than Data Distributor.  Log into
    your local system, attach to the remote MRD_DEV database on IB001 using
    the proxy account NEAR_ADM.  Try creating the index remotely, just as
    Data Distributor did.  If you get an "exceeded quota" error, it means
    that the problem is between you and Rdb and that Data Distributor is
    not really the issue.
    
    Claude
212.2Thanks, we'll check itORAREP::BASICO::ISMAN1Thu May 23 1996 11:0220


   Claude,



      We'll check what you suggest in .1 tomorrow or during this weekend,
   because we've already deleted the GEARS_96 table in the remote database
   and we're loading it using two transfers (one million records for each),
   when we've checked thhis, we'll put here the resoults.


   Thank you very much indeed for your quick response.

   Regards,


   Marta

212.3Two transfers?BROKE::PROTEAUJean-Claude ProteauThu May 23 1996 13:2011
    
    Marta,
    
    How are you loading the one target table, GEARS_96, using two
    transfers?  You couldn't actually have tried to do this because it
    won't work using replication transfers.  I'll explain why not if you ask.
    
    Why are you trying to load the one table using two transfers?  Are
    you trying to get around some quota or performance problem?
    
    Claude
212.4Try ENQLM or PGFLQUOsvrav1.au.oracle.com::MBRADLEYI was dropped on my head as a baby. What's your excuse?Thu May 23 1996 21:107
If I had to guess, I would say that the remote server process was running 
out of PGFLQUO or ENQLM. These are typicaly the most common causes of 
EXQUOTA errors.

Cheers,

Mark.
212.5It seems to be DDAL and not RDBORAREP::BASICO::ISMAN1Fri May 24 1996 09:1835

   Claude,


     You're absolutely right, we can't use two replication transfers to load
   the table.

	Neverthless we've done what you mentioned in .1, we've redefined
   a replication transfer to load the GEARS_96 table and we've got the same
   error when the DDAL tried to create the index, so we've tried to create
   it from the local machine and we've got no problems, so it seems to be 
   DDAL and no RDB. So now we've got the table and the index in the target 
   database, but 

	- what could happen if we start the transfer once again?(as it finished
	  with an error status); 

	- would it begin from the beginning or would it only try to transfer 
	  the updated records (the normal behavior in replication transfers)?

	- if the transfer begins from the beginning, is there any workaround
	  so that the next time it starts it only transfers the updated rows?
	  could we change something in the local and/or remote databases?
	  or in the DDAL database ?


    Awaiting for your comments, and thanks a lot for your help.


   Regards,


     Marta 

212.6Maybe this workaround will doBROKE::PROTEAUJean-Claude ProteauFri May 24 1996 11:1556
Marta,

I need some clarification to be sure I correctly understand your comments.

>	Neverthless we've done what you mentioned in .1, we've redefined
>   a replication transfer to load the GEARS_96 table and we've got the same
>   error when the DDAL tried to create the index, so we've tried to create
>   it from the local machine and we've got no problems, so it seems to be 

When you say, "we've tried to create it from the local machine," do you mean
that you did a remote index creation and that worked alright?  That is, the
local machine is the one on which Data Distributor is installed and the remote
machine is the one with the target database.  You used the same attach string
and remote account to get to the target database via SQL, right?

>   DDAL and no RDB. So now we've got the table and the index in the target 
>   database, but
>
>	- what could happen if we start the transfer once again?(as it finished
>	  with an error status); 

The transfer will try to do the same thing over again.  That is, because it
remembers that the transfer failed, it will drop the target indexes, delete
the data in the target tables, retransfer the data, and try to create the
indexes.  Therefore it will fail again.

>	- would it begin from the beginning or would it only try to transfer 
>	  the updated records (the normal behavior in replication transfers)?

From the beginning.  Data Distributor has no way of knowing that you corrected
the problem manually.

>	- if the transfer begins from the beginning, is there any workaround
>	  so that the next time it starts it only transfers the updated rows?
>	  could we change something in the local and/or remote databases?
>	  or in the DDAL database ?

Hm, maybe you could change the status code in the transfer database so that it
thinks the transfer succeeded.  The information is in the following table and
columns: DDAL$TRANSFERS_STATUS(DDAL$TRANSFER_NAME, DDAL$TRANSFER_STATE,
DDAL$LAST_COMPLETION_STATUS, DDAL$LAST_TRANSFER_TIME).  For the given transfer,
you'll probably see a state value of 4, meaning suspended.  Change that to 5,
unscheduled.  The last_transfer_time will probably have a value of 0 (or null).
Store some non-0 datetime value in that column.  Data Distributor uses that
to determine that the initial replication transfer has been done and that the
next time the transfger is run it should do a replication update.  I'm not
sure if the last_completion_status column needs to be changed.  I believe it
contains a VMS status code, one of the codes from the DDAL$MESSAGE.EXE file.
If you can check the value in this column for some other transfer that was
successful, put that same value in this column for the transfer you're trying to
get to work.

I don't guarantee that this will all work because I haven't tried it, but this
will probably get you by.
    
    Claude
212.7ORAREP::BASICO::ISMAN1Tue May 28 1996 05:2016

  Claude,


     Thank you very much for your help, we haven't checked the workaround
  you suggestted us yet, as we've changed our minds and perhaps we don't need 
  to transfer the whole table. But in case we have to transfer it, we'll check 
  it and send you the resoults.

  Once again, thank you very much for your help

  Regards,


     Marta.
212.8It has worked !!!!ORAREP::BASICO::ISMAN1Wed May 29 1996 12:1417


   Claude,


     We've modify the DDAL$TRANSFER_STATUS relation in the DDAL database, as
   you mentioned in your last reply, the we've start once again the replica-
   tion transfer, and it has worked (it has run as un update replication trans-
   fer and not an initial one).

   Thank you very much indeed for all your help.

   Best regards,


      Marta.
212.9:-)BROKE::PROTEAUJean-Claude ProteauWed May 29 1996 12:556
    
    Marta,
    
    You're welcome.  I'm glad that it worked out well for you.
    
    Claude