Anyone seen this: New license initialized / Field mapping errors

We’re seeing errors across the logs of all our Collibra environments as of Tuesday evening, about 23:20, and suspect that this is not related to anything we’re doing. Has anyone else seen this?

2023-05-09 23:29:12.597 [pool-35-thread-1] INFO c.c.d.c.l.impl.LicenseServiceImpl - Start reading license file. []
2023-05-09 23:29:12.600 [pool-35-thread-1] INFO c.c.d.c.l.impl.LicenseServiceImpl - New license initialized: License{expirationDate=…, valid=true, writerCount=…, readerCount=…, apiCount=…, maxAssets=…, maxWorkflows=…, company=’…’, guestAccess=…, products=[GLOSSARY, …, STEWARDSHIP], onTheGoMobile=true, onTheGoWindows=true, legacyUsers=0} [authenticated_id=00000000-0000-0000-0000-000000900001, session_hash=…]
2023-05-09 23:29:12.618 [pool-35-thread-1] ERROR c.g.d.core.MappingProcessor - Field mapping error -->
MapId: null
Type: null
Source parent class: com.collibra.dgc.core.model.user.impl.RoleImpl
Source field name: rights
Source field type: null
Source field value: null
Dest parent class: com.collibra.dgc.core.api.model.role.impl.RoleImpl
Dest field name: permissions
Dest field type: java.util.List [session_hash=…, authenticated_id=00000000-0000-0000-0000-000000900001, trace_id=…, trace_flags=01, span_id=…]

Tom Friesen

Posted 3 years ago · Edited 1 year ago·Last reply 3 years ago

8 comments

tjbrodeur1

·3 years ago · Edited

Yes. We were getting this issue as well. We stumbled across it on Friday (5/12) on our DEV instance while I was testing some workflow stuff. This morning we discovered it was also taking place in our PROD instance.

It does appear that restarting resolves this issue.

One rather disturbing component to this (at least it seems related) is that dcg log files appear to have been deleted from our console. Wondering if anyone else is seeing that same thing. Note: This doesn’t seem to be occurring for the dcg_recommender or dcg_jobs files, just the regular console log files (formatted dcg.YYYY-MM-DD-X.log)

I know it is deleting them for two reasons:

I routinely download log files from PROD which I parse to do some monitoring and analysis. I last downloaded logfiles on 5/8 so have logs going back from 5/7/2023. Currently the latest log file in our console is dcg.2023-05-12-2. So this would actually be the third file from 5/12 since these start with -0.
On Friday when we first noted this in DEV, I looked through the existing log files to figure out when this started. I found it in the 5/9/2023 log file (time stamp 2023-05-09 23:46:42.691 to be exact), so I know the 5/9/2023 file was in the console as of Friday in DEV. That file is now gone as are all files prior to this 5/12/2023 log file.

Anyway, can someone else verify their log files before 5/12 are no longer available?

arthurburkhardt

·3 years ago · Edited

@tj.brodeur Just checked both our instances, no logs have disappeared.

List of files in prod (for your confirmation)

'dgc.log','dgc_jobs.log','dgc_recommender.log','dgc.2023-05-15-2.log','dgc_recommender.2023-05-15-0.log','dgc.2023-05-15-1.log',
'dgc_jobs.2023-05-15-0.log','dgc.2023-05-15-0.log','dgc.2023-05-14-2.log','dgc_recommender.2023-05-14-0.log','dgc.2023-05-14-1.log',
'dgc.2023-05-14-0.log','dgc_jobs.2023-05-14-0.log','dgc.2023-05-13-2.log','dgc_recommender.2023-05-13-0.log','dgc.2023-05-13-1.log',
'dgc.2023-05-13-0.log','dgc_jobs.2023-05-13-0.log','dgc.2023-05-12-2.log','dgc_recommender.2023-05-12-0.log','dgc.2023-05-12-1.log',
'dgc_jobs.2023-05-12-0.log','dgc_recommender.2023-05-11-0.log','dgc_validations.log','dgc_jobs.2023-05-11-0.log','dgc_recommender.2023-05-10-0.log',
'dgc_jobs.2023-05-10-0.log','dgc_recommender.2023-05-09-0.log','dgc_jobs.2023-05-09-0.log','dgc_recommender.2023-05-08-0.log','dgc_jobs.2023-05-08-0.log',
'dgc_validations.2023-05-08-0.log','dgc_recommender.2023-05-07-0.log','dgc_jobs.2023-05-07-0.log','dgc_recommender.2023-05-06-0.log',
'dgc_jobs.2023-05-06-0.log','dgc_recommender.2023-05-05-0.log','dgc_jobs.2023-05-05-0.log','dgc_validations.2023-05-05-0.log',
'dgc_recommender.2023-05-04-0.log','dgc_jobs.2023-05-04-0.log','dgc_recommender.2023-05-03-0.log','dgc_jobs.2023-05-03-0.log',
'dgc_recommender.2023-05-02-0.log','dgc_jobs.2023-05-02-0.log','dgc_recommender.2023-05-01-0.log','dgc_jobs.2023-05-01-0.log',
'dgc_recommender.2023-04-30-0.log','dgc_jobs.2023-04-30-0.log','dgc_recommender.2023-04-29-0.log','dgc_jobs.2023-04-29-0.log',
'dgc_recommender.2023-04-28-0.log','dgc_jobs.2023-04-28-0.log','dgc_recommender.2023-04-27-0.log','dgc_jobs.2023-04-27-0.log',
'dgc_recommender.2023-04-26-0.log','dgc_jobs.2023-04-26-0.log','dgc_recommender.2023-04-25-0.log','dgc_jobs.2023-04-25-0.log',
'dgc_recommender.2023-04-24-0.log','dgc_jobs.2023-04-24-0.log','dgc_recommender.2023-04-23-0.log','dgc_jobs.2023-04-23-0.log',
'dgc_recommender.2023-04-22-0.log','dgc_jobs.2023-04-22-0.log','dgc_recommender.2023-04-21-0.log','dgc_jobs.2023-04-21-0.log',
'dgc_validations.2023-04-21-0.log','dgc_recommender.2023-04-20-0.log','dgc_jobs.2023-04-20-0.log','dgc_recommender.2023-04-19-0.log',
'dgc_jobs.2023-04-19-0.log','dgc_recommender.2023-04-18-0.log','dgc_jobs.2023-04-18-0.log','dgc_recommender.2023-04-17-0.log',
'dgc_jobs.2023-04-17-0.log','dgc_recommender.2023-04-16-0.log','dgc_jobs.2023-04-16-0.log','dgc_validations.2023-04-12-0.log',
'dgc_validations.2021-11-18-0.log','dgc_validations.2021-11-17-0.log','dgc_audit.log','dgc.2021-04-10-0.log','dgc_recommender.2021-04-10-0.log',
'dgc_jobs.2021-04-10-0.log','dgc.2021-04-09-0.log','dgc_recommender.2021-04-09-0.log','dgc_jobs.2021-04-09-0.log','dgc.2021-04-08-0.log',
'dgc_recommender.2021-04-08-0.log','dgc_jobs.2021-04-08-0.log','dgc_validations.2021-04-08-0.log','dgc.2021-04-07-0.log','dgc_recommender.2021-04-07-0.log',
'dgc_jobs.2021-04-07-0.log','dgc_validations.2021-04-07-0.log','dgc.2021-04-06-0.log','dgc_recommender.2021-04-06-0.log','dgc_jobs.2021-04-06-0.log',
'dgc.2021-04-05-0.log','dgc_recommender.2021-04-05-0.log','dgc_jobs.2021-04-05-0.log','dgc.2021-04-04-0.log','dgc_recommender.2021-04-04-0.log',
'dgc_jobs.2021-04-04-0.log','dgc.2021-04-03-0.log','dgc_recommender.2021-04-03-0.log','dgc_jobs.2021-04-03-0.log','dgc.2021-04-02-0.log',
'dgc_recommender.2021-04-02-0.log','dgc_jobs.2021-04-02-0.log','dgc.2021-04-01-0.log','dgc_recommender.2021-04-01-0.log','dgc_jobs.2021-04-01-0.log',
'dgc_validations.2021-04-01-0.log','dgc.2021-03-31-0.log','dgc_recommender.2021-03-31-0.log','dgc_jobs.2021-03-31-0.log','dgc.2021-03-30-0.log',
'dgc_recommender.2021-03-30-0.log','dgc_jobs.2021-03-30-0.log','dgc.2021-03-29-0.log','dgc_recommender.2021-03-29-0.log','dgc_jobs.2021-03-29-0.log',
'dgc.2021-03-28-0.log','dgc_recommender.2021-03-28-0.log','dgc_jobs.2021-03-28-0.log','dgc.2021-03-27-0.log','dgc_recommender.2021-03-27-0.log',
'dgc_jobs.2021-03-27-0.log','dgc.2021-03-26-0.log','dgc_recommender.2021-03-26-0.log','dgc_jobs.2021-03-26-0.log','dgc.2021-03-25-0.log',
'dgc_recommender.2021-03-25-0.log','dgc_jobs.2021-03-25-0.log','dgc.2021-03-24-0.log','dgc_recommender.2021-03-24-0.log','dgc_jobs.2021-03-24-0.log',
'dgc_validations.2021-03-24-0.log','dgc.2021-03-23-0.log','dgc_recommender.2021-03-23-0.log','dgc_jobs.2021-03-23-0.log','dgc.2021-03-22-0.log',
'dgc_recommender.2021-03-22-0.log','dgc_jobs.2021-03-22-0.log','dgc.2021-03-21-0.log','dgc_recommender.2021-03-21-0.log','dgc_jobs.2021-03-21-0.log',
'dgc.2021-03-20-0.log','dgc_recommender.2021-03-20-0.log','dgc_jobs.2021-03-20-0.log','dgc.2021-03-19-0.log','dgc_recommender.2021-03-19-0.log',
'dgc_jobs.2021-03-19-0.log','dgc.2021-03-18-0.log','dgc_recommender.2021-03-18-0.log','dgc_jobs.2021-03-18-0.log','dgc_validations.2021-03-18-0.log',
'dgc.2021-03-17-0.log','dgc_recommender.2021-03-17-0.log','dgc_jobs.2021-03-17-0.log','dgc.2021-03-16-0.log','dgc_recommender.2021-03-16-0.log',
'dgc_jobs.2021-03-16-0.log','dgc.2021-03-15-0.log','dgc_recommender.2021-03-15-0.log','dgc_jobs.2021-03-15-0.log','dgc.2021-03-14-0.log',
'dgc_recommender.2021-03-14-0.log','dgc_jobs.2021-03-14-0.log','dgc.2021-03-13-0.log','dgc_recommender.2021-03-13-0.log','dgc_jobs.2021-03-13-0.log',
'dgc.2021-03-12-0.log','dgc_recommender.2021-03-12-0.log','dgc_jobs.2021-03-12-0.log','dgc_validations.2021-03-10-0.log','dgc_validations.2019-10-28-0.log'

Are you interested to meet quickly and compare notes on log management? I’d be curious to see how you manage it. I’m currently quite happy with the automation and insights we extract from the logs, but I’d like to move to the next step and integrate with a proper monitoring tool.

tjbrodeur1

·3 years ago · Edited

@arthur.burkhardt Thank you for the confirmation. And, yes, I’d love to chat about log management. We’re extracting some pretty useful information out of ours and are also planning no more automated event monitoring, so this would be very valuable.

I’ll PM you.

daverichard

·3 years ago · Edited

A restart has also resolved this in our instance. As I am still currently testing workflows I will be able to see if it starts up again.

arthurburkhardt

·3 years ago · Edited

Yep, same here. I opened a support ticket a few day ago.
This prompted me to update this thread: https://datacitizens.collibra.com/forum/t/error-logs-management/621/7?u=arthur.burkhardt

Yesterday, a developer was trying to find the error caused by his workflow, but the answer lies in 0.01% of loglines, so good luck for finding it!

daverichard

·3 years ago · Edited

Yes, I was testing a workflow and getting so many of these stack traces that I had to download the logs every time to check errors. It is quite annoying. Whatever is happening the error started at 9AM EDT in our server and is happening about every 10 seconds.

So far, we are at 1937 instances since 9AM this morning.

Tom Friesen

OP3 years ago · Edited

Thanks for chiming in, Dave!

So why now? Is this a byproduct of some third party’s patch Tuesdays? Has Collibra gone and changed something outside of the regular maintenance window? Is this something to do with SSO?

Anyone else?

bartvanderlocht

·3 years ago · Edited

We were also having the same issue. Reboot seems to have solved it (for now)
No idea what’s the cause…