Skip to content
By using AWS re:Post, you agree to the AWS re:Post Terms of Use
AWS re:Postre:Post
About re:Post

WHY I AM GETTING FEW RECORDS ONLY IN AWS.M2.CARDDEMO.TRANREPT WHILE RUNNING MONTHY TRANSACTION FILE

0

WHY I AM GETTING FEW RECORDS ONLY IN AWS.M2.CARDDEMO.TRANREPT WHILE RUNNING MONTHY TRANSACTION FILE

2025-06-06_01-31-12-582 | [JOB] TRANREPT-TRANREPT - Started 2025-06-06_01-31-12-596 | [STEP] STEP01R - Started 2025-06-05T23:31:12.601Z WARN 4560 --- [ Thread-27] c.n.b.g.i.s.c.b.FileConfigurationBuilder : Update of GDGSUpportConfiguration from catalog is not implemented. 2025-06-06_01-31-12-611 | [EXEC GROOVY FILE] D:\PhotonUser\AppData\Local\Temp\2\blu_age_rt_temp_dir\TRANREPT-TRANREPT_STEP01R_REPROC_2025-06-06_01-31-12-606.groovy - Started 2025-06-06_01-31-12-915 | [PROC] REPROC - Started 2025-06-06_01-31-12-928 | [STEP] PRC001 - Started 2025-06-05T23:31:12.935Z INFO 4560 --- [ Thread-27] c.n.b.g.i.s.FileConfigurationUtils : PRC001.FILEIN : BluesamFileConfiguration [bluesamId=, dataset=AWS.M2.CARDDEMO.TRANSACT.VSAM.KSDS, cacheCompression=false, warmUp=true, isAnsiCarriageControl=false, disposition=SHR, normal termination=KEEP, abnormal termination=KEEP] 2025-06-05T23:31:12.935Z INFO 4560 --- [ Thread-27] c.n.b.g.i.s.FileConfigurationUtils : PRC001.FILEOUT : GDGSupportConfiguration [relativeGeneration=1, name=AWS.M2.CARDDEMO.TRANSACT.BKUP, ownerPath=., cacheCompression=false, warmUp=true, storageProvider=filesystem, recordSize=350, jobContext=com.netfective.bluage.gapwalk.rt.job.support.DefaultJobContext@168fd2ec, rdw=false, bdw=false, isFixed=false, isLF=false, isCRLF=false, isMicroFocusCompatible=false, order=LIFO] 2025-06-05T23:31:12.936Z INFO 4560 --- [ Thread-27] c.n.b.g.r.c.i.ExecutionControllerImpl : Executing program: IDCAMS 2025-06-05T23:31:12.936Z INFO 4560 --- [ Thread-27] c.n.b.g.rt.db.stats.DatabaseStatistics : DATABASE STATISTIC DISABLED 2025-06-05T23:31:12.945Z INFO 4560 --- [ Thread-27] c.n.b.g.io.support.basic.BuilderHelper : Using path =[.\AWS.M2.CARDDEMO.TRANSACT.BKUP.G0081V00] for FileSystem GDG named AWS.M2.CARDDEMO.TRANSACT.BKUP generation 81 2025-06-05T23:31:12.945Z INFO 4560 --- [ Thread-27] c.n.b.g.r.job.support.DefaultJobContext : Stored [.\AWS.M2.CARDDEMO.TRANSACT.BKUP.G0081V00] for key (AWS.M2.CARDDEMO.TRANSACT.BKUP,1) 2025-06-05T23:31:12.958Z INFO 4560 --- [ Thread-27] c.n.b.gapwalk.io.support.FileFactory : Created new file [D:\PhotonUser\Workshop\working-directory..\AWS.M2.CARDDEMO.TRANSACT.BKUP.G0081V00] 2025-06-05T23:31:12.959Z INFO 4560 --- [ Thread-27] c.n.b.gapwalk.utility.idcams.IdcamsPgm : IDCAMS REPRO : REPRO INFILE(FILEIN) OUTFILE(FILEOUT) 2025-06-05T23:31:13.115Z INFO 4560 --- [ Thread-27] c.n.b.g.r.sort.service.AdaptableSort : External sort threshold is 2069609940 bytes 2025-06-05T23:31:13.116Z INFO 4560 --- [ Thread-27] c.n.b.g.u.s.s.e.io.DataSetRecordReader : Open dataSet AWS.M2.CARDDEMO.TRANSACT.VSAM.KSDS status = OK 2025-06-05T23:31:13.122Z INFO 4560 --- [ Thread-27] c.n.b.g.u.s.s.e.ExternalSortTasklet : fcOut:GDGSupportConfiguration [relativeGeneration=1, name=AWS.M2.CARDDEMO.TRANSACT.BKUP, ownerPath=., cacheCompression=false, warmUp=true, storageProvider=filesystem, recordSize=350, jobContext=com.netfective.bluage.gapwalk.rt.job.support.DefaultJobContext@168fd2ec, rdw=false, bdw=false, isFixed=false, isLF=false, isCRLF=false, isMicroFocusCompatible=false, order=LIFO] 2025-06-05T23:31:13.125Z INFO 4560 --- [ Thread-27] c.n.b.g.r.job.support.DefaultJobContext : Returning stored dataset path from job context for key (AWS.M2.CARDDEMO.TRANSACT.BKUP,1) 2025-06-05T23:31:13.125Z INFO 4560 --- [ Thread-27] c.n.b.g.io.support.basic.BuilderHelper : Retrieved path from jobContext : .\AWS.M2.CARDDEMO.TRANSACT.BKUP.G0081V00 2025-06-05T23:31:13.126Z INFO 4560 --- [ Thread-27] c.n.b.gapwalk.utility.common.FileUtils : .\AWS.M2.CARDDEMO.TRANSACT.BKUP.G0081V00 - Existing file! - no file creation. 2025-06-05T23:31:13.134Z INFO 4560 --- [ Thread-27] c.n.b.g.r.job.support.DefaultJobContext : Returning stored dataset path from job context for key (AWS.M2.CARDDEMO.TRANSACT.BKUP,1) 2025-06-05T23:31:13.134Z INFO 4560 --- [ Thread-27] c.n.b.g.io.support.basic.BuilderHelper : Retrieved path from jobContext : .\AWS.M2.CARDDEMO.TRANSACT.BKUP.G0081V00 2025-06-05T23:31:13.134Z INFO 4560 --- [ Thread-27] c.n.b.gapwalk.utility.common.FileUtils : .\AWS.M2.CARDDEMO.TRANSACT.BKUP.G0081V00 - Existing file! - no file creation. 2025-06-05T23:31:13.134Z INFO 4560 --- [ Thread-27] c.n.b.g.u.s.s.e.ExternalSortTasklet : Sort output file length = 109900 bytes 2025-06-05T23:31:13.134Z INFO 4560 --- [ Thread-27] c.n.b.gapwalk.utility.idcams.IdcamsPgm : IDCAMS REPRO : Number of records processed: 314 2025-06-05T23:31:13.135Z INFO 4560 --- [ Thread-27] c.n.b.g.r.job.support.DefaultJobContext : Returning stored dataset path from job context for key (AWS.M2.CARDDEMO.TRANSACT.BKUP,1) 2025-06-05T23:31:13.136Z INFO 4560 --- [ Thread-27] c.n.b.g.io.support.basic.BuilderHelper : Retrieved path from jobContext : .\AWS.M2.CARDDEMO.TRANSACT.BKUP.G0081V00 2025-06-05T23:31:13.138Z INFO 4560 --- [ Thread-27] c.n.b.g.i.c.i.AbstractDatasetCatalogImpl : Register Dataset - GDG computed absolute generation 81 2025-06-05T23:31:13.138Z INFO 4560 --- [ Thread-27] c.n.b.g.i.c.i.AbstractDatasetCatalogImpl : Adding a generation to the registered dataset file AWS.M2.CARDDEMO.TRANSACT.BKUP 2025-06-05T23:31:13.141Z INFO 4560 --- [ Thread-27] c.n.b.g.r.job.support.DefaultJobContext : Returning stored dataset path from job context for key (AWS.M2.CARDDEMO.TRANSACT.BKUP,1) 2025-06-05T23:31:13.141Z INFO 4560 --- [ Thread-27] c.n.b.g.io.support.basic.BuilderHelper : Retrieved path from jobContext : .\AWS.M2.CARDDEMO.TRANSACT.BKUP.G0081V00 2025-06-05T23:31:13.142Z INFO 4560 --- [ Thread-27] c.n.b.g.r.job.support.DefaultJobContext : Returning stored dataset path from job context for key (AWS.M2.CARDDEMO.TRANSACT.BKUP,1) 2025-06-05T23:31:13.142Z INFO 4560 --- [ Thread-27] c.n.b.g.io.support.basic.BuilderHelper : Retrieved path from jobContext : .\AWS.M2.CARDDEMO.TRANSACT.BKUP.G0081V00 2025-06-05T23:31:13.142Z INFO 4560 --- [ Thread-27] b.g.r.i.s.i.DefaultGDGEventsQueueHandler : [902803213] - Stacked GDG Event :GDGEvent [provider=filesystem, fsPath=./.\AWS.M2.CARDDEMO.TRANSACT.BKUP.G0081V00, gdgName=AWS.M2.CARDDEMO.TRANSACT.BKUP, type=NEW_GENERATION, relativeGeneration=1, absoluteGeneration=81, ] for [Thread-27] 2025-06-05T23:31:13.142Z INFO 4560 --- [ Thread-27] c.n.b.gapwalk.io.support.FileFactory : FileUtils : stack new generation event 2025-06-06_01-31-13-144 | Program return code is 0 2025-06-06_01-31-13-146 | [STEP] PRC001 - Ended 2025-06-06_01-31-13-151 | [PROC] REPROC - Ended 2025-06-06_01-31-13-153 | [EXEC GROOVY FILE] D:\PhotonUser\AppData\Local\Temp\2\blu_age_rt_temp_dir\TRANREPT-TRANREPT_STEP01R_REPROC_2025-06-06_01-31-12-606.groovy - Ended 2025-06-06_01-31-13-154 | [STEP] STEP01R - Ended 2025-06-06_01-31-13-162 | [STEP] STEP05R - Started 2025-06-05T23:31:13.166Z WARN 4560 --- [ Thread-27] c.n.b.g.i.s.c.b.FileConfigurationBuilder : Update of GDGSUpportConfiguration from catalog is not implemented. 2025-06-05T23:31:13.170Z WARN 4560 --- [ Thread-27] c.n.b.g.i.s.c.b.FileConfigurationBuilder : Update of GDGSUpportConfiguration from catalog is not implemented. 2025-06-05T23:31:13.171Z INFO 4560 --- [ Thread-27] c.n.b.g.r.c.i.ExecutionControllerImpl : Executing program: SORT 2025-06-05T23:31:13.171Z INFO 4560 --- [ Thread-27] c.n.b.g.rt.db.stats.DatabaseStatistics : DATABASE STATISTIC DISABLED 2025-06-05T23:31:13.177Z INFO 4560 --- [ Thread-27] c.n.b.g.io.support.basic.BuilderHelper : Using path =[.\AWS.M2.CARDDEMO.TRANSACT.DALY.G0032V00] for FileSystem GDG named AWS.M2.CARDDEMO.TRANSACT.DALY generation 32 2025-06-05T23:31:13.177Z INFO 4560 --- [ Thread-27] c.n.b.g.r.job.support.DefaultJobContext : Stored [.\AWS.M2.CARDDEMO.TRANSACT.DALY.G0032V00] for key (AWS.M2.CARDDEMO.TRANSACT.DALY,1) 2025-06-05T23:31:13.180Z INFO 4560 --- [ Thread-27] c.n.b.gapwalk.io.support.FileFactory : Created new file [D:\PhotonUser\Workshop\working-directory..\AWS.M2.CARDDEMO.TRANSACT.DALY.G0032V00] 2025-06-05T23:31:13.185Z INFO 4560 --- [ Thread-27] c.n.b.g.r.job.support.DefaultJobContext : Returning stored dataset path from job context for key (AWS.M2.CARDDEMO.TRANSACT.BKUP,1) 2025-06-05T23:31:13.185Z INFO 4560 --- [ Thread-27] c.n.b.g.io.support.basic.BuilderHelper : Retrieved path from jobContext : .\AWS.M2.CARDDEMO.TRANSACT.BKUP.G0081V00 2025-06-05T23:31:13.366Z INFO 4560 --- [ Thread-27] c.n.b.g.r.sort.service.AdaptableSort : External sort threshold is 2069537536 bytes 2025-06-05T23:31:13.367Z INFO 4560 --- [ Thread-27] c.n.b.g.r.job.support.DefaultJobContext : Returning stored dataset path from job context for key (AWS.M2.CARDDEMO.TRANSACT.BKUP,1) 2025-06-05T23:31:13.367Z INFO 4560 --- [ Thread-27] c.n.b.g.io.support.basic.BuilderHelper : Retrieved path from jobContext : .\AWS.M2.CARDDEMO.TRANSACT.BKUP.G0081V00 2025-06-05T23:31:13.367Z INFO 4560 --- [ Thread-27] c.n.b.gapwalk.io.utils.CommonDDUtils : Record length read from the catalog for GDG dataset AWS.M2.CARDDEMO.TRANSACT.BKUP Generation 81 : 350 2025-06-05T23:31:13.369Z INFO 4560 --- [ Thread-27] c.n.b.g.r.job.support.DefaultJobContext : Returning stored dataset path from job context for key (AWS.M2.CARDDEMO.TRANSACT.BKUP,1) 2025-06-05T23:31:13.369Z INFO 4560 --- [ Thread-27] c.n.b.g.io.support.basic.BuilderHelper : Retrieved path from jobContext : .\AWS.M2.CARDDEMO.TRANSACT.BKUP.G0081V00 2025-06-05T23:31:13.369Z INFO 4560 --- [ Thread-27] c.n.b.gapwalk.utility.common.FileUtils : .\AWS.M2.CARDDEMO.TRANSACT.BKUP.G0081V00 - Existing file! - no file creation. 2025-06-05T23:31:13.375Z INFO 4560 --- [ Thread-27] c.n.b.g.u.s.s.e.ExternalSortTasklet : fcOut:GDGSupportConfiguration [relativeGeneration=1, name=AWS.M2.CARDDEMO.TRANSACT.DALY, ownerPath=., cacheCompression=false, warmUp=true, storageProvider=filesystem, recordSize=350, jobContext=com.netfective.bluage.gapwalk.rt.job.support.DefaultJobContext@168fd2ec, rdw=false, bdw=false, isFixed=false, isLF=false, isCRLF=false, isMicroFocusCompatible=false, order=LIFO] 2025-06-05T23:31:13.377Z INFO 4560 --- [ Thread-27] c.n.b.g.r.job.support.DefaultJobContext : Returning stored dataset path from job context for key (AWS.M2.CARDDEMO.TRANSACT.DALY,1) 2025-06-05T23:31:13.377Z INFO 4560 --- [ Thread-27] c.n.b.g.io.support.basic.BuilderHelper : Retrieved path from jobContext : .\AWS.M2.CARDDEMO.TRANSACT.DALY.G0032V00 2025-06-05T23:31:13.377Z INFO 4560 --- [ Thread-27] c.n.b.gapwalk.utility.common.FileUtils : .\AWS.M2.CARDDEMO.TRANSACT.DALY.G0032V00 - Existing file! - no file creation. 2025-06-05T23:31:13.386Z INFO 4560 --- [ Thread-27] c.n.b.g.r.job.support.DefaultJobContext : Returning stored dataset path from job context for key (AWS.M2.CARDDEMO.TRANSACT.DALY,1) 2025-06-05T23:31:13.386Z INFO 4560 --- [ Thread-27] c.n.b.g.io.support.basic.BuilderHelper : Retrieved path from jobContext : .\AWS.M2.CARDDEMO.TRANSACT.DALY.G0032V00 2025-06-05T23:31:13.386Z INFO 4560 --- [ Thread-27] c.n.b.gapwalk.utility.common.FileUtils : .\AWS.M2.CARDDEMO.TRANSACT.DALY.G0032V00 - Existing file! - no file creation. 2025-06-05T23:31:13.387Z INFO 4560 --- [ Thread-27] c.n.b.g.u.s.s.e.ExternalSortTasklet : Sort output file length = 109900 bytes 2025-06-05T23:31:13.388Z INFO 4560 --- [ Thread-27] c.n.b.g.r.job.support.DefaultJobContext : Returning stored dataset path from job context for key (AWS.M2.CARDDEMO.TRANSACT.DALY,1) 2025-06-05T23:31:13.388Z INFO 4560 --- [ Thread-27] c.n.b.g.io.support.basic.BuilderHelper : Retrieved path from jobContext : .\AWS.M2.CARDDEMO.TRANSACT.DALY.G0032V00 2025-06-05T23:31:13.388Z INFO 4560 --- [ Thread-27] c.n.b.g.i.c.i.AbstractDatasetCatalogImpl : Register Dataset - GDG computed absolute generation 32 2025-06-05T23:31:13.388Z INFO 4560 --- [ Thread-27] c.n.b.g.i.c.i.AbstractDatasetCatalogImpl : Adding a generation to the registered dataset file AWS.M2.CARDDEMO.TRANSACT.DALY 2025-06-05T23:31:13.395Z INFO 4560 --- [ Thread-27] c.n.b.g.r.job.support.DefaultJobContext : Returning stored dataset path from job context for key (AWS.M2.CARDDEMO.TRANSACT.DALY,1) 2025-06-05T23:31:13.395Z INFO 4560 --- [ Thread-27] c.n.b.g.io.support.basic.BuilderHelper : Retrieved path from jobContext : .\AWS.M2.CARDDEMO.TRANSACT.DALY.G0032V00 2025-06-05T23:31:13.398Z INFO 4560 --- [ Thread-27] c.n.b.g.r.job.support.DefaultJobContext : Returning stored dataset path from job context for key (AWS.M2.CARDDEMO.TRANSACT.DALY,1) 2025-06-05T23:31:13.400Z INFO 4560 --- [ Thread-27] c.n.b.g.io.support.basic.BuilderHelper : Retrieved path from jobContext : .\AWS.M2.CARDDEMO.TRANSACT.DALY.G0032V00 2025-06-05T23:31:13.400Z INFO 4560 --- [ Thread-27] b.g.r.i.s.i.DefaultGDGEventsQueueHandler : [902803213] - Stacked GDG Event :GDGEvent [provider=filesystem, fsPath=./.\AWS.M2.CARDDEMO.TRANSACT.DALY.G0032V00, gdgName=AWS.M2.CARDDEMO.TRANSACT.DALY, type=NEW_GENERATION, relativeGeneration=1, absoluteGeneration=32, ] for [Thread-27] 2025-06-05T23:31:13.400Z INFO 4560 --- [ Thread-27] c.n.b.gapwalk.io.support.FileFactory : FileUtils : stack new generation event 2025-06-06_01-31-13-403 | Program return code is 0 2025-06-06_01-31-13-404 | [STEP] STEP05R - Ended 2025-06-06_01-31-13-412 | [STEP] STEP10R - Started 2025-06-05T23:31:13.417Z WARN 4560 --- [ Thread-27] c.n.b.g.i.s.c.b.FileConfigurationBuilder : Update of GDGSUpportConfiguration from catalog is not implemented. 2025-06-05T23:31:13.421Z WARN 4560 --- [ Thread-27] c.n.b.g.i.s.c.b.FileConfigurationBuilder : Update of GDGSUpportConfiguration from catalog is not implemented. 2025-06-05T23:31:13.422Z INFO 4560 --- [ Thread-27] c.n.b.g.r.c.i.ExecutionControllerImpl : Executing program: CBTRN03C 2025-06-05T23:31:13.422Z INFO 4560 --- [ Thread-27] c.n.b.g.rt.db.stats.DatabaseStatistics : DATABASE STATISTIC DISABLED 2025-06-05T23:31:13.429Z INFO 4560 --- [ Thread-27] c.n.b.g.io.support.basic.BuilderHelper : Using path =[.\AWS.M2.CARDDEMO.TRANREPT.G0016V00] for FileSystem GDG named AWS.M2.CARDDEMO.TRANREPT generation 16 2025-06-05T23:31:13.429Z INFO 4560 --- [ Thread-27] c.n.b.g.r.job.support.DefaultJobContext : Stored [.\AWS.M2.CARDDEMO.TRANREPT.G0016V00] for key (AWS.M2.CARDDEMO.TRANREPT,1) 2025-06-05T23:31:13.430Z INFO 4560 --- [ Thread-27] c.n.b.gapwalk.io.support.FileFactory : Created new file [D:\PhotonUser\Workshop\working-directory..\AWS.M2.CARDDEMO.TRANREPT.G0016V00] 2025-06-05T23:31:13.432Z INFO 4560 --- [ Thread-27] a.b.l.w.c.s.impl.Cbtrn03cProcessImpl : START OF EXECUTION OF PROGRAM CBTRN03C 2025-06-05T23:31:13.434Z INFO 4560 --- [ Thread-27] c.n.b.g.r.job.suppo

Topics
Migration & Modernization
Tags
AWS Blu Age
Language
English

asked a year ago139 views

1 Answer
0

The issue you're experiencing with getting only a few records in AWS.M2.CARDDEMO.TRANREPT is likely related to the SORT operation in the TRANREPT job. Based on similar issues reported with AWS BluAge L3 Workshop, there are a couple of potential causes:

  1. Sort key uniqueness problem: When the SORT operation is performed, it orders records based on the sort key value. If multiple records have the same sort key value, only one of those duplicates might be returned. This is a common issue when working with the COMBTRAN job and similar sorting operations in the AWS BluAge environment.

  2. Record size configuration: The recordSize parameter in your GDG configuration might need adjustment. In your logs, you have recordSize=133 for the TRANREPT file, which might be affecting how many records are processed or retained.

  3. Date filtering: The STEP05R in your TRANREPT job includes date filtering logic that might be excluding records that don't fall within your specified date range. Check the values of startDate and endDate parameters to ensure they're not overly restrictive.

  4. Sort field configuration: The SORT operation in STEP05R is sorting by TRAN-CARD-NUM and including only records where TRAN-PROC-DT falls between PARM-START-DATE and PARM-END-DATE. If these fields aren't properly defined or if the date format doesn't match, many records could be excluded.

To resolve this issue, you could try:

answered a year ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Relevant content