Backgroundjob error messages: SyncJob does not exist

[mmattel]

Steps to reproduce

1. Automatically run occ via cron

Note: I once installed the LDAP App and enabled it, but never configured it. It was just to see the screen how it looks like. Then I disabled the app but did not remove it.

Note: Grepping eg for LDAP in the log only shows entried past 2019.05.21 which was as far I remember the day I did the upgrade to 10.2

Expected behaviour

No error message for backgroundjobs

Actual behaviour

Getting error messages for backgroundjobs:
Could not resolve OCA SyncJob does not exist
CleanUp! Class OCA\\\\OAuth2
SyncJob! Class OCA\\\\DAV
UpdateGroups! Class OCA\\\\User_LDAP

Server configuration

Operating system: Ubuntu 16.04

Web server: nginx

Database: mysql

PHP version: 7.0

ownCloud version: 10.2.0.5

Updated from an older ownCloud or fresh install: updated

Where did you install ownCloud from: tar

Signing status (ownCloud 9.0 and above):

No errors have been found.

The content of config/config.php:

{
    "system": {
        "instanceid": "oct7bkicorxf",
        "passwordsalt": "***REMOVED SENSITIVE VALUE***",
        "secret": "***REMOVED SENSITIVE VALUE***",
        "trusted_domains": [
            "xxx"
        ],
        "datadirectory": "\/var\/www\/owncloud\/data",
        "overwrite.cli.url": "https:\/\/xxxx",
        "htaccess.RewriteBase": "\/",
        "dbtype": "mysql",
        "version": "10.2.0.5",
        "dbname": "owncloud",
        "dbhost": "localhost",
        "dbtableprefix": "oc_",
        "dbuser": "***REMOVED SENSITIVE VALUE***",
        "dbpassword": "***REMOVED SENSITIVE VALUE***",
        "logtimezone": "Europe\/Vienna",
        "installed": true,
        "filelocking.enabled": "true",
        "memcache.local": "\\OC\\Memcache\\Redis",
        "memcache.locking": "\\OC\\Memcache\\Redis",
        "memcache.distributed": "\\OC\\Memcache\\Redis",
        "redis": {
            "host": "localhost",
            "port": 6379,
            "timeout": 0,
            "dbindex": 0
        },
        "filesystem_check_changes": 1,
        "loglevel": 2,
        "mail_smtpmode": "smtp",
        "mail_from_address": "***REMOVED SENSITIVE VALUE***",
        "mail_smtpsecure": "tls",
        "mail_domain": "***REMOVED SENSITIVE VALUE***",
        "mail_smtpauthtype": "LOGIN",
        "mail_smtphost": "***REMOVED SENSITIVE VALUE***",
        "mail_smtpport": "587",
        "maintenance": false,
        "theme": "",
        "preview_max_scale_factor": 1,
        "excluded_directories": [
            ".snapshot",
            "~snapshot"
        ],
        "upgrade.automatic-app-update": true,
        "quota_include_external_storage": false,
        "singleuser": false,
        "apps_paths": [
            {
                "path": "\/var\/www\/owncloud\/apps",
                "url": "\/apps",
                "writable": false
            },
            {
                "path": "\/var\/www\/owncloud\/apps-external",
                "url": "\/apps-external",
                "writable": true
            }
        ],
        "show_server_hostname": false,
        "ldapIgnoreNamingRules": false
    }
}

List of activated apps:

Enabled:
  - activity: 2.4.2
  - audioplayer: 2.7.1
  - comments: 0.3.0
  - configreport: 0.2.0
  - dav: 0.4.0
  - federatedfilesharing: 0.4.0
  - federation: 0.1.0
  - files: 1.5.2
  - files_external: 0.7.1
  - files_external_dropbox: 1.1.0
  - files_external_ftp: 0.2.1
  - files_pdfviewer: 0.11.0
  - files_sharing: 0.11.0
  - files_texteditor: 2.3.0
  - files_trashbin: 0.9.1
  - files_versions: 1.3.0
  - files_videoplayer: 0.10.1
  - firstrunwizard: 1.2.0
  - gallery: 16.1.1
  - guests: 0.8.1
  - market: 0.4.0
  - notifications: 0.5.0
  - provisioning_api: 0.5.0
  - systemtags: 0.3.0
  - templateeditor: 0.4.0
  - updatenotification: 0.2.1
Disabled:
  - encryption
  - external
  - files_clipboard
  - user_external
  - user_ldap

Are you using external storage, if yes which one: local/smb/sftp/google drive, dropbox

Are you using encryption: no

Are you using an external user-backend, if yes which one: no

Client configuration

Browser: Opera

Operating system: W10x64

Logs

Web server error log

Not relevant

ownCloud log (data/owncloud.log)

{"reqId":"HAtiD0LKHgy0Bh44vG0o","level":3,"time":"2019-06-18T23:45:02+02:00","remoteAddr":"","user":"--","app":"core","method":"--","url":"--","message":"Exception: {\"Exception\":\"OCP\\\\AppFramework\\\\QueryException\",\"Message\":\"Could not resolve OCA\\\\OAuth2\\\\BackgroundJob\\\\CleanUp! Class OCA\\\\OAuth2\\\\BackgroundJob\\\\CleanUp does not exist\",\"Code\":0,\"Trace\":\"
#0 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/AppFramework\\\/Utility\\\/SimpleContainer.php(110): OC\\\\AppFramework\\\\Utility\\\\SimpleContainer->resolve('OCA\\\\\\\\OAuth2\\\\\\\\Back...')\\
n#1 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/ServerContainer.php(86): OC\\\\AppFramework\\\\Utility\\\\SimpleContainer->query('OCA\\\\\\\\OAuth2\\\\\\\\Back...')\\
n#2 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/BackgroundJob\\\/JobList.php(253): OC\\\\ServerContainer->query('OCA\\\\\\\\OAuth2\\\\\\\\Back...')\\
n#3 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/BackgroundJob\\\/JobList.php(209): OC\\\\BackgroundJob\\\\JobList->buildJob(Array)\\
n#4 \\\/var\\\/www\\\/owncloud\\\/cron.php(114): OC\\\\BackgroundJob\\\\JobList->getNext()\\
n#5 {main}\",\"File\":\"\\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/AppFramework\\\/Utility\\\/SimpleContainer.php\",\"Line\":96}"}

{"reqId":"tEZiKB0VZhumIdDiX8Ec","level":3,"time":"2019-06-18T23:00:03+02:00","remoteAddr":"","user":"--","app":"core","method":"--","url":"--","message":"Exception: {\"Exception\":\"OCP\\\\AppFramework\\\\QueryException\",\"Message\":\"Could not resolve OCA\\\\DAV\\\\CardDAV\\\\Sync\\\\SyncJob! Class OCA\\\\DAV\\\\CardDAV\\\\Sync\\\\SyncJob does not exist\",\"Code\":0,\"Trace\":\"
#0 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/AppFramework\\\/Utility\\\/SimpleContainer.php(110): OC\\\\AppFramework\\\\Utility\\\\SimpleContainer->resolve('OCA\\\\\\\\DAV\\\\\\\\CardDAV...')\\
n#1 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/ServerContainer.php(86): OC\\\\AppFramework\\\\Utility\\\\SimpleContainer->query('OCA\\\\\\\\DAV\\\\\\\\CardDAV...')\\
n#2 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/BackgroundJob\\\/JobList.php(253): OC\\\\ServerContainer->query('OCA\\\\\\\\DAV\\\\\\\\CardDAV...')\\
n#3 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/BackgroundJob\\\/JobList.php(209): OC\\\\BackgroundJob\\\\JobList->buildJob(Array)\\
n#4 \\\/var\\\/www\\\/owncloud\\\/cron.php(114): OC\\\\BackgroundJob\\\\JobList->getNext()\\
n#5 {main}\",\"File\":\"\\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/AppFramework\\\/Utility\\\/SimpleContainer.php\",\"Line\":96}"}

{"reqId":"IxZlSS20TS8Gz8AoPtvV","level":3,"time":"2019-06-19T02:45:03+02:00","remoteAddr":"","user":"--","app":"core","method":"--","url":"--","message":"Exception: {\"Exception\":\"OCP\\\\AppFramework\\\\QueryException\",\"Message\":\"Could not resolve OCA\\\\User_LDAP\\\\Jobs\\\\UpdateGroups! Class OCA\\\\User_LDAP\\\\Jobs\\\\UpdateGroups does not exist\",\"Code\":0,\"Trace\":\"
#0 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/AppFramework\\\/Utility\\\/SimpleContainer.php(110): OC\\\\AppFramework\\\\Utility\\\\SimpleContainer->resolve('OCA\\\\\\\\User_LDAP\\\\\\\\J...')\\
n#1 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/ServerContainer.php(86): OC\\\\AppFramework\\\\Utility\\\\SimpleContainer->query('OCA\\\\\\\\User_LDAP\\\\\\\\J...')\\
n#2 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/BackgroundJob\\\/JobList.php(253): OC\\\\ServerContainer->query('OCA\\\\\\\\User_LDAP\\\\\\\\J...')\\
n#3 \\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/BackgroundJob\\\/JobList.php(209): OC\\\\BackgroundJob\\\\JobList->buildJob(Array)\\
n#4 \\\/var\\\/www\\\/owncloud\\\/cron.php(114): OC\\\\BackgroundJob\\\\JobList->getNext()\\
n#5 {main}\",\"File\":\"\\\/var\\\/www\\\/owncloud\\\/lib\\\/private\\\/AppFramework\\\/Utility\\\/SimpleContainer.php\",\"Line\":96}"}

@DeepDiver1975 mind to take a look on respectively point to someone who could cover that?

[VicDeo]

@mmattel
please post

select * from oc_jobs where class like '%LDAP%';

[VicDeo]

Looks like the logging was added intentionally :unsure:
#32623

[mmattel]

id	class	argument	last_run	last_checked	reserved_at	execution_duration
325	OCA\User_LDAP\Jobs\UpdateGroups	null	0	1561185002	1561185002	1

[mmattel]

Any update on this as this fills up the log triggerd by cron every 15min... 👎

[VicDeo]

@mmattel you can delete OCA\User_LDAP\Jobs\UpdateGroups job from DB, as it is unneeded and has been removed from the app recently

[mmattel]

I am not convinced deleting a job manually. There is more than one job in question as you can see above, exact they are three. It is necessary to check and solve, eg during an upgrade, if there are bgj leftovers from former/disabled apps or had issues.
TIP: do not run a bgj for a disabled app... (which is at least true for the LDAP app above). That would make one problem gone and let two problems left to cover.

[VicDeo]

do not run a bgj for a disabled app...

@mmattel it is not run. #32623 adds a log entry why the job was skipped, before this PR the job was skipped silently.

[mmattel]

Anyhow, this is not an excuse. The app is disabled (or the BGJ does not exist anymore), so it must not try to run and therefore must not create a log entry. For the other two, investigations and fixes are needed. I get daily 96 sensless log entries filling up the log file.
BTW: by your refrence from above pls see comment of the PR:

core/lib/private/legacy/app.php

Line 1052 in 334bae3

// TODO remove jobs that no longer exist in this app version

[Linda-chan]

Just upgraded to 10.2.1.4 and got same issue. I think you should add autoremove for these jobs on upgrade process.

[cortho]

Are there any news on this topic? Even with a recent 10.7, when I disable e.g. the market app manual intervention is still required,.

I took efforts to collect the relevant information in my Ticket #36908 over a year ago which had not been considered in this ticket.

This happens because exceptions are thrown in any case, even when the app is disabled,

So it should be a junior job to at least not to throw the exception when the app is not enabled at all.

[UnitedMarsupials]

So, how do we deal with this for the time being?

[zubanst]

Same issue here even in version 10.10. For me is with CleanupExpiredWopiTokens: Could not resolve OCA\Richdocuments\BackgroundJob\CleanupExpiredWopiTokens; Class OCA\Richdocuments\BackgroundJob\CleanupExpiredWopiTokens does not exist.