OGG-02198 Incompatible record (logical EOF) in trail file

OGG-02198 Incompatible record (logical EOF) in trail file

Symptoms:
2019-10-17 14:48:43 ERROR OGG-02171 Error reading LCR from data source. Status 509, data source type 0.
Source Context :
SourceModule : [gglib.ggtrail.TrailDataSource]
SourceID : [/scratch/aime/adestore/views/aime_adc4150505/oggcore/OpenSys/src/gglib/ggtrail/TrailDataSource.cpp]
SourceMethod : [checkLogicalEOF]
SourceLine : [3829]
ThreadBacktrace : [15] elements
: [/ogg/app/oracle/ogg4bd/12.3.2.1.0/libgglog.so(CMessageContext::AddThreadContext()+0x1e) [0x7f9a8d6230ae]]
: [/ogg/app/oracle/ogg4bd/12.3.2.1.0/libgglog.so(CMessageFactory::CreateMessage(CSourceContext*, unsigned int, …)+0x6ac) [0x7f9a8d6139b
c]]
: [/ogg/app/oracle/ogg4bd/12.3.2.1.0/libgglog.so(_MSG_String_Int32(CSourceContext*, int, char const*, int, CMessageFactory::MessageDispos
ition)+0x3e) [0x7f9a8d6024fe]]
: [/ogg/app/oracle/ogg4bd/12.3.2.1.0/replicat(ggs::gglib::ggtrail::TrailDataSource::checkLogicalEOF()+0x126) [0x892aa6]]
: [/ogg/app/oracle/ogg4bd/12.3.2.1.0/replicat(ggs::gglib::ggtrail::TrailDataSource::readNextTrailRecord(ggs::gglib::gglcr::CommonLCR**, l
ong*, int&, int&, bool, bool)+0x17cd) [0x898b2d]]
: [/ogg/app/oracle/ogg4bd/12.3.2.1.0/replicat(ggs::er::ReplicatTrailDataSource::readLCR(ggs::gglib::gglcr::CommonLCR**, long&, bool&)+0x4
5) [0x61df25]]
: [/ogg/app/oracle/ogg4bd/12.3.2.1.0/replicat(ggs::er::ReplicatContext::processReplicatLoop()+0x5f9) [0x62ceb9]]
: [/ogg/app/oracle/ogg4bd/12.3.2.1.0/replicat(ggs::er::ReplicatContext::run()+0x45) [0x60ff85]]
: [/ogg/app/oracle/ogg4bd/12.3.2.1.0/replicat() [0x6e4aaf]]
: [/ogg/app/oracle/ogg4bd/12.3.2.1.0/replicat(ggs::gglib::MultiThreading::MainThread::ExecMain()+0x5e) [0x7e27ce]]
: [/ogg/app/oracle/ogg4bd/12.3.2.1.0/replicat(ggs::gglib::MultiThreading::Thread::RunThread(ggs::gglib::MultiThreading::Thread::ThreadArg
s*)+0x173) [0x7e6b93]]
: [/ogg/app/oracle/ogg4bd/12.3.2.1.0/replicat(ggs::gglib::MultiThreading::MainThread::Run(int, char**)+0x140) [0x7e7400]]
: [/ogg/app/oracle/ogg4bd/12.3.2.1.0/replicat(main+0x3b) [0x6e784b]]
: [/lib64/libc.so.6(__libc_start_main+0xf5) [0x7f9a85cb23d5]]
: [/ogg/app/oracle/ogg4bd/12.3.2.1.0/replicat() [0x550271]]
2019-10-17 14:48:43 ERROR OGG-02198 Incompatible record (logical EOF) in trail file /ogg/app/oracle/ogg4bd/12.3.2.1.0/dirdat/IN000000, rba 125,091,794.

Debug:
GGSCI (linuxvm01) 5> info RPT01 detail

REPLICAT RPT01 Initialized 2019-10-17 15:35 Status STOPPED
Checkpoint Lag 00:00:00 (updated 16:05:24 ago)
Log Read Checkpoint File /ogg/app/oracle/ogg4bd/12.3.2.1.0/dirdat/IN000000
First Record RBA 0
Extract Source Begin End

/ogg/app/oracle/ogg4bd/12.3.2.1.0/dirdat/IN000000 * Initialized * First Record
/ogg/app/oracle/ogg4bd/12.3.2.1.0/dirdat/IN000000 * Initialized * 2019-10-17 15:32
/ogg/app/oracle/ogg4bd/12.3.2.1.0/dirdat/IN000000 * Initialized * First Record
/ogg/app/oracle/ogg4bd/12.3.2.1.0/dirdat/IN000000 * Initialized * 2019-10-17 15:05
/ogg/app/oracle/ogg4bd/12.3.2.1.0/dirdat/IN000000 * Initialized * First Record
/ogg/app/oracle/ogg4bd/12.3.2.1.0/dirdat/IN000006 * Initialized * 2019-10-17 11:41
/ogg/app/oracle/ogg4bd/12.3.2.1.0/dirdat/IN000000 * Initialized * 2019-10-17 11:41
/ogg/app/oracle/ogg4bd/12.3.2.1.0/dirdat/IN000000 * Initialized * First Record
/ogg/app/oracle/ogg4bd/12.3.2.1.0/dirdat/IN000006 * Initialized * 2019-09-26 09:50
/ogg/app/oracle/ogg4bd/12.3.2.1.0/dirdat/IN000000000 * Initialized * First Record
/ogg/app/oracle/ogg4bd/12.3.2.1.0/dirdat/IN000000000 * Initialized * First Record
Current directory /ogg/app/oracle/ogg4bd/12.3.2.1.0
Report file /ogg/app/oracle/ogg4bd/12.3.2.1.0/dirrpt/RPT01.rpt
Parameter file /ogg/app/oracle/ogg4bd/12.3.2.1.0/dirprm/RPT01.prm
Checkpoint file /ogg/app/oracle/ogg4bd/12.3.2.1.0/dirchk/RPT01.cpr
Checkpoint table OGG.CKPTAB
Process file /ogg/app/oracle/ogg4bd/12.3.2.1.0/dirpcs/RPT01.pcr
Error log /ogg/app/oracle/ogg4bd/12.3.2.1.0/ggserr.log

125091794
144286949
176406875

Logdump 441 >open IN000000
Current LogTrail is /ogg/app/oracle/ogg4bd/12.3.2.1.0/dirdat/IN000000
Logdump 442 >ghdr on
Logdump 443 >count
LogTrail /ogg/app/oracle/ogg4bd/12.3.2.1.0/dirdat/IN000000 has 303728 records
Total Data Bytes 188330053
Avg Bytes/Record 620
Insert 303718
Metadata Records 9
Others 1
After Images 303718

Average of 303727 Transactions
Bytes/Trans ….. 668
Records/Trans … 1
Files/Trans ….. 1

Logdump 444 >pos 125091794
Reading forward from RBA 125091794
Logdump 445 >n
Bad record found at RBA 125091794, format 5.50 Header token)
0004 1f00 | ….
Logdump 446 >n
Bad record found at RBA 125091794, format 5.50 Header token)
0004 1f00 | ….
Logdump 447 >n
Bad record found at RBA 125091794, format 5.50 Header token)
0004 1f00 | ….
Logdump 589 >sfh prev
___________________________________________________________________
Hdr-Ind : E (x45) Partition : . (x0c)
UndoFlag : . (x00) BeforeAfter: A (x41)
RecLength : 751 (x02ef) IO Time : 2019/10/17 15:32:18.207.771
IOType : 5 (x05) OrigNode : 255 (xff)
TransInd : . (x03) FormatType : R (x52)
SyskeyLen : 0 (x00) Incomplete : . (x00)
AuditRBA : 0 AuditPos : 0
Continued : N (x00) RecCount : 1 (x01)

2019/10/17 15:32:18.207.771 Insert Len 751 RBA 125091272
Name: ORCLPDB1.SOURCE.TAB01 (TDR Index: 8)
After Image: Partition 12 s
0000 0c00 0000 0800 0043 004d 0041 0055 0100 0a00 | ………C.M.A.U….
0000 0000 0000 0002 50a8 0200 0a00 0000 0000 0000 | ……..P………..
0000 000e 0300 0600 0000 0200 0033 0400 0a00 0000 | ………….3……
0000 002e d8b5 128d 0500 0c00 0000 0800 0049 0053 | ……………..I.S
0041 0052 0600 0c00 0000 0800 0049 0053 0041 0052 | .A.R………I.S.A.R
0700 0800 0000 0400 0034 0031 0800 0a00 0000 0000 | ………4.1……..
0000 0000 0014 0900 0800 0000 0400 0050 005a 0a00 | ……………P.Z..
Logdump 590 >count
** Count begins at RBA 125091272
LogTrail /ogg/app/oracle/ogg4bd/12.3.2.1.0/dirdat/IN000000 has 98422 records
Total Data Bytes 73914800
Avg Bytes/Record 750
Insert 98422
After Images 98422

Average of 98422 Transactions
Bytes/Trans ….. 798
Records/Trans … 1
Files/Trans ….. 1

Logdump 592 >n
___________________________________________________________________
Hdr-Ind : E (x45) Partition : . (x0c)
UndoFlag : . (x00) BeforeAfter: A (x41)
RecLength : 751 (x02ef) IO Time : 2019/10/17 15:32:18.207.771
IOType : 5 (x05) OrigNode : 255 (xff)
TransInd : . (x03) FormatType : R (x52)
SyskeyLen : 0 (x00) Incomplete : . (x00)
AuditRBA : 0 AuditPos : 0
Continued : N (x00) RecCount : 1 (x01)

2019/10/17 15:32:18.207.771 Insert Len 751 RBA 125092075
Name: ORCLPDB1.SOURCE.TAB01 (TDR Index: 8)
After Image: Partition 12 s
0000 0c00 0000 0800 0043 004d 0041 0055 0100 0a00 | ………C.M.A.U….
0000 0000 0000 0002 570b 0200 0a00 0000 0000 0000 | ……..W………..
0000 0012 0300 0600 0000 0200 0030 0400 0a00 0000 | ………….0……
0000 002e d8b5 12a0 0500 0c00 0000 0800 0049 0053 | ……………..I.S
0041 0052 0600 0c00 0000 0800 0049 0053 0041 0052 | .A.R………I.S.A.R
0700 0800 0000 0400 0034 0031 0800 0a00 0000 0000 | ………4.1……..
0000 0000 0014 0900 0800 0000 0400 0050 005a 0a00 | ……………P.Z..

Solution:
GGSCI (linuxvm01) 6> alter replicat RPT01 extseqno 0 extrba 125091272

2019-10-18 07:42:29 INFO OGG-06594 Replicat RPT01 has been altered. Even the start up position might be updated, duplicate suppression remains active in next startup. To override duplicate suppression, start RPT01 with NOFILTERDUPTRANSACTIONS option.

REPLICAT altered.

GGSCI (linuxvm01) 7> start RPT01
GGSCI (linuxvm01) 11> info all

Program Status Group Lag at Chkpt Time Since Chkpt

MANAGER RUNNING
REPLICAT STOPPED IMOBRCAH 00:00:00 1725:35:15
REPLICAT RUNNING RMOBRCAH 00:00:00 00:00:07
REPLICAT ABENDED UBCNRCIH 04:19:54 254:01:41
REPLICAT RUNNING UCASRCIH 00:00:00 00:00:00
REPLICAT RUNNING RPT01 16:10:44 00:00:00
REPLICAT STOPPED UMOBRCAH 00:00:00 1770:57:42

GGSCI (linuxvm01) 12> info RPT01

REPLICAT RPT01 Last Started 2019-10-18 07:42 Status RUNNING
Checkpoint Lag 16:11:04 (updated 00:00:00 ago)
Process ID 19034
Log Read Checkpoint File /ogg/app/oracle/ogg4bd/12.3.2.1.0/dirdat/IN000001
2019-10-17 15:32:18.207771 RBA 73543084

Reference:
How to Recover from an OGG-01028 Incompatible Record If the Trail Is Not Corrupt (Doc ID 1507462.1)
Recovery Steps for: Replicat Process Abended, ERROR OGG-01028 Incompatible record (logical EOF) in “trail file name”, rba ### (Doc ID 1601617.1)

Leave a Reply

Your email address will not be published. Required fields are marked *