feat(logging): add query job log and task correlation fields

[rishikeshdevsot]

Description

Checklist

• The PR satisfies the contribution guidelines.
• This is a breaking change and that has been indicated in the PR title, OR this isn't a
  breaking change.
• Necessary docs have been updated, OR no docs need to be updated.

Validation performed

• Query scheduler logs

{"event": "Completed job 3.", "logger": "search-job-handler", "level": "info", "query_hash": "ea3116b7594966c4", "job_id": "3", "query": "*WARN*", "query_job_type": "SEARCH_OR_AGGREGATION", "timestamp": "2026-06-22T00:35:29.296984Z"}
{"event": "Dispatched job 4 with 8 archives to search.", "logger": "search-job-handler", "level": "info", "query_hash": "a6bb4dd05bbddf0c", "job_id": "4", "query": "*StaticLoggerBinder*", "query_job_type": "SEARCH_OR_AGGREGATION", "timestamp": "2026-06-22T00:35:43.290284Z"}
{"event": "Search task job-4-task-25 succeeded in 0.234407 second(s).", "logger": "search-job-handler", "level": "info", "task_id": 25, "query_hash": "a6bb4dd05bbddf0c", "job_id": "4", "query": "*StaticLoggerBinder*", "query_job_type": "SEARCH_OR_AGGREGATION", "timestamp": "2026-06-22T00:35:43.543433Z"}
{"event": "Search task job-4-task-26 succeeded in 0.063165 second(s).", "logger": "search-job-handler", "level": "info", "task_id": 26, "query_hash": "a6bb4dd05bbddf0c", "job_id": "4", "query": "*StaticLoggerBinder*", "query_job_type": "SEARCH_OR_AGGREGATION", "timestamp": "2026-06-22T00:35:43.543850Z"}
{"event": "Search task job-4-task-27 succeeded in 0.060935 second(s).", "logger": "search-job-handler", "level": "info", "task_id": 27, "query_hash": "a6bb4dd05bbddf0c", "job_id": "4", "query": "*StaticLoggerBinder*", "query_job_type": "SEARCH_OR_AGGREGATION", "timestamp": "2026-06-22T00:35:43.544141Z"}
{"event": "Search task job-4-task-28 succeeded in 0.067564 second(s).", "logger": "search-job-handler", "level": "info", "task_id": 28, "query_hash": "a6bb4dd05bbddf0c", "job_id": "4", "query": "*StaticLoggerBinder*", "query_job_type": "SEARCH_OR_AGGREGATION", "timestamp": "2026-06-22T00:35:43.544394Z"}
{"event": "Search task job-4-task-29 succeeded in 0.066539 second(s).", "logger": "search-job-handler", "level": "info", "task_id": 29, "query_hash": "a6bb4dd05bbddf0c", "job_id": "4", "query": "*StaticLoggerBinder*", "query_job_type": "SEARCH_OR_AGGREGATION", "timestamp": "2026-06-22T00:35:43.544683Z"}
{"event": "Search task job-4-task-30 succeeded in 0.067184 second(s).", "logger": "search-job-handler", "level": "info", "task_id": 30, "query_hash": "a6bb4dd05bbddf0c", "job_id": "4", "query": "*StaticLoggerBinder*", "query_job_type": "SEARCH_OR_AGGREGATION", "timestamp": "2026-06-22T00:35:43.544944Z"}
{"event": "Search task job-4-task-31 succeeded in 0.04328 second(s).", "logger": "search-job-handler", "level": "info", "task_id": 31, "query_hash": "a6bb4dd05bbddf0c", "job_id": "4", "query": "*StaticLoggerBinder*", "query_job_type": "SEARCH_OR_AGGREGATION", "timestamp": "2026-06-22T00:35:43.545187Z"}
{"event": "Search task job-4-task-32 succeeded in 0.068461 second(s).", "logger": "search-job-handler", "level": "info", "task_id": 32, "query_hash": "a6bb4dd05bbddf0c", "job_id": "4", "query": "*StaticLoggerBinder*", "query_job_type": "SEARCH_OR_AGGREGATION", "timestamp": "2026-06-22T00:35:43.545429Z"}
{"event": "Completed job 4.", "logger": "search-job-handler", "level": "info", "query_hash": "a6bb4dd05bbddf0c", "job_id": "4", "query": "*StaticLoggerBinder*", "query_job_type": "SEARCH_OR_AGGREGATION", "timestamp": "2026-06-22T00:35:43.579987Z"}

• Query worker logs

{"event": "Contents of 120-clo.log:\njob_id=15 task_id=120 task_name=search\n", "logger": "job_orchestration.executor.query.fs_search_task", "level": "info", "dataset": "hive_24hr_9ce65c8c", "celery_task_id": "92e9d7b9-336f-41f8-9d63-08410050d224", "job_id": "15", "task_id": 120, "query_hash": "569cdfd8d26a87f7", "query": "*Exception*", "archive_id": "8ead844c-d989-48cb-8477-2bb716656368", "query_job_type": "SEARCH_OR_AGGREGATION", "timestamp": "2026-06-22T00:38:32.667144Z"}
{"event": "search task 115 completed for job 15", "logger": "job_orchestration.executor.query.fs_search_task", "level": "info", "query": "*Exception*", "job_id": "15", "celery_task_id": "49bcbaef-b83d-4d1f-96f6-e7571bd73c18", "query_hash": "569cdfd8d26a87f7", "clp_subprocess_pid": 139, "archive_id": "a54976d4-c861-4c97-a64f-5c899011d140", "task_id": 115, "dataset": "hive_24hr_9ce65c8c", "query_job_type": "SEARCH_OR_AGGREGATION", "timestamp": "2026-06-22T00:38:32.680945Z"}
{"event": "search task 117 completed for job 15", "logger": "job_orchestration.executor.query.fs_search_task", "level": "info", "query_hash": "569cdfd8d26a87f7", "clp_subprocess_pid": 142, "job_id": "15", "celery_task_id": "b6c9b783-1fde-48f1-8157-61bdf3b3a04e", "query": "*Exception*", "archive_id": "1d1aa397-8e64-4432-bc41-2a7433e59419", "task_id": 117, "query_job_type": "SEARCH_OR_AGGREGATION", "dataset": "hive_24hr_9ce65c8c", "timestamp": "2026-06-22T00:38:32.680994Z"}
{"event": "Contents of 115-clo.log:\njob_id=15 task_id=115 task_name=search\n", "logger": "job_orchestration.executor.query.fs_search_task", "level": "info", "query": "*Exception*", "job_id": "15", "celery_task_id": "49bcbaef-b83d-4d1f-96f6-e7571bd73c18", "query_hash": "569cdfd8d26a87f7", "archive_id": "a54976d4-c861-4c97-a64f-5c899011d140", "task_id": 115, "dataset": "hive_24hr_9ce65c8c", "query_job_type": "SEARCH_OR_AGGREGATION", "timestamp": "2026-06-22T00:38:32.681345Z"}
{"event": "Contents of 117-clo.log:\njob_id=15 task_id=117 task_name=search\n", "logger": "job_orchestration.executor.query.fs_search_task", "level": "info", "query_hash": "569cdfd8d26a87f7", "job_id": "15", "celery_task_id": "b6c9b783-1fde-48f1-8157-61bdf3b3a04e", "query": "*Exception*", "archive_id": "1d1aa397-8e64-4432-bc41-2a7433e59419", "task_id": 117, "query_job_type": "SEARCH_OR_AGGREGATION", "dataset": "hive_24hr_9ce65c8c", "timestamp": "2026-06-22T00:38:32.681382Z"}
{"event": "search task 114 completed for job 15", "logger": "job_orchestration.executor.query.fs_search_task", "level": "info", "job_id": "15", "celery_task_id": "106c3739-c820-4d99-b17c-f04cc7cdfd31", "task_id": 114, "query": "*Exception*", "clp_subprocess_pid": 140, "query_hash": "569cdfd8d26a87f7", "archive_id": "5c7e2eee-7a06-4756-b5e9-f68de3953db4", "query_job_type": "SEARCH_OR_AGGREGATION", "dataset": "hive_24hr_9ce65c8c", "timestamp": "2026-06-22T00:38:32.694732Z"}
{"event": "Contents of 114-clo.log:\njob_id=15 task_id=114 task_name=search\n", "logger": "job_orchestration.executor.query.fs_search_task", "level": "info", "job_id": "15", "celery_task_id": "106c3739-c820-4d99-b17c-f04cc7cdfd31", "task_id": 114, "query": "*Exception*", "query_hash": "569cdfd8d26a87f7", "archive_id": "5c7e2eee-7a06-4756-b5e9-f68de3953db4", "query_job_type": "SEARCH_OR_AGGREGATION", "dataset": "hive_24hr_9ce65c8c", "timestamp": "2026-06-22T00:38:32.695118Z"}

[coderabbitai]

Important

Review skipped

Draft detected.

Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

⚙️ Run configuration

Configuration used: Organization UI

Review profile: ASSERTIVE

Plan: Pro

Run ID: 6d8b119f-e3d3-4abc-99ee-2cfd0da65a6e

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

Use the checkbox below for a quick retry:

• 🔍 Trigger review

✨ Finishing Touches

🧪 Generate unit tests (beta)

• Create PR with unit tests

---

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

• X
• Mastodon
• Reddit
• LinkedIn

_{Comment @coderabbitai help to get the list of available commands and usage tips.}