[ehb54/us3lims_gridctl] d37d51: Retry permanent DB failures in cleanup only when t...
Branch: refs/heads/780-request-pbs-gfac-cleanup Home: https://github.com/ehb54/us3lims_gridctl Commit: d37d51a98d00609badf2602273db2211d339d080 https://github.com/ehb54/us3lims_gridctl/commit/d37d51a98d00609badf2602273db... Author: aaron-auc <aaron@aucsolutions.com> Date: 2026-10-06 (Tue, 06 Oct 2026) Changed paths: M job_state_machine.php M jobmonitor/cleanup.php M jobmonitor/cleanup_job.php M jobmonitor/gridctl.php M jobmonitor/jobmonitor.php M services.php Log Message: ----------- Retry permanent DB failures in cleanup only when they are actually connection-class, dedupe the 'fail' admin mail per job, retry the boot restart for its full budget in a detached background child with a final mail/syslog on failure, and fix the should-fix nits (post-ping scancel retries, missing-dbutils stderr spam, double timestamps, two stale comments, the startup connect exiting on a blip) Commit: 6f08d03ecaccd8327c814f80e91e90ba47d46bab https://github.com/ehb54/us3lims_gridctl/commit/6f08d03ecaccd8327c814f80e91e... Author: aaron-auc <aaron@aucsolutions.com> Date: 2026-10-06 (Tue, 06 Oct 2026) Changed paths: M job_state_machine.php M jobmonitor/jobmonitor.php Log Message: ----------- Use remote_exec's new breaker_gate option for the post-ping scancel so a real failure still counts against the breaker, and add +/-20% jitter to the steady-state poll (ultrascan-tickets#1120) Commit: bfefa2acc362a44ee4d5192d54f76a768905937d https://github.com/ehb54/us3lims_gridctl/commit/bfefa2acc362a44ee4d5192d54f7... Author: aaron-auc <aaron@aucsolutions.com> Date: 2026-10-06 (Tue, 06 Oct 2026) Changed paths: M services.php Log Message: ----------- Remove services.php's own monitor restart: it duplicated us3-jobmonitors.service, a separate dedicated unit, and put restarted monitors in us3-listen's own cgroup where a later systemctl restart us3-listen would kill them Compare: https://github.com/ehb54/us3lims_gridctl/compare/c26b10d4ebba...bfefa2acc362 To unsubscribe from these emails, change your notification settings at https://github.com/ehb54/us3lims_gridctl/settings/notifications
participants (1)
-
aaron-auc