[02:03:56.082] New invocation is queued and will start shortly
[02:03:57.161] Starting the invocation (attempt 1)
[02:03:57.191] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/cd087e0d8e748057971ab867759f94735ec8ac18"
[02:03:57.191] Popped gitiles commit info from properties and tags
[02:03:57.191] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[02:03:57.191] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[02:03:57.191] Buildbucket request:
{
"requestId": "9012182710895456736",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "cd087e0d8e748057971ab867759f94735ec8ac18",
"ref": "refs/heads/master"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9012182710895456736"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[02:03:57.771] Scheduled build:
{
"id": "8846752648975994192",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22150,
"createdBy": "project:chromium",
"createTime": "2021-05-20T02:03:57.280110Z",
"updateTime": "2021-05-20T02:03:57.692432Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "cd087e0d8e748057971ab867759f94735ec8ac18",
"ref": "refs/heads/master"
}
}
}
[02:03:57.771] Task URL: https://cr-buildbucket.appspot.com/build/8846752648975994192
[02:03:57.771] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:2:0) after 2m48s
[02:06:45.885] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:2:0)
[02:06:45.912] Build status: SCHEDULED
[02:06:45.912] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:3:0) after 1m19s
[02:07:09.700] Received PubSub notification, asking Buildbucket for the build status
[02:07:09.729] Build status: STARTED
[02:08:05.072] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:3:0)
[02:08:05.102] Build status: STARTED
[02:08:05.102] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:5:0) after 7m19s
[02:15:24.187] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:5:0)
[02:15:24.233] Build status: STARTED
[02:15:24.234] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:6:0) after 7m50s
[02:23:14.301] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:6:0)
[02:23:14.350] Build status: STARTED
[02:23:14.350] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:7:0) after 7m54s
[02:31:08.392] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:7:0)
[02:31:08.503] Build status: STARTED
[02:31:08.503] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:8:0) after 9m36s
[02:40:44.524] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:8:0)
[02:40:44.554] Build status: STARTED
[02:40:44.554] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:9:0) after 4m42s
[02:45:26.952] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:9:0)
[02:45:26.989] Build status: STARTED
[02:45:26.989] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:10:0) after 5m23s
[02:50:50.081] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:10:0)
[02:50:50.114] Build status: STARTED
[02:50:50.114] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:11:0) after 4m18s
[02:55:08.132] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:11:0)
[02:55:08.180] Build status: STARTED
[02:55:08.180] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:12:0) after 2m35s
[02:57:43.440] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:12:0)
[02:57:43.474] Build status: STARTED
[02:57:43.475] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:13:0) after 1m49s
[02:59:32.862] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:13:0)
[02:59:32.892] Build status: STARTED
[02:59:32.892] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:14:0) after 2m3s
[03:01:35.915] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:14:0)
[03:01:35.945] Build status: STARTED
[03:01:35.945] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:15:0) after 8m37s
[03:10:13.046] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:15:0)
[03:10:13.074] Build status: STARTED
[03:10:13.074] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:16:0) after 1m25s
[03:11:38.059] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:16:0)
[03:11:38.089] Build status: STARTED
[03:11:38.089] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:17:0) after 2m36s
[03:14:14.111] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:17:0)
[03:14:14.142] Build status: STARTED
[03:14:14.142] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:18:0) after 1m13s
[03:15:27.271] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:18:0)
[03:15:27.300] Build status: STARTED
[03:15:27.300] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:19:0) after 6m46s
[03:22:13.428] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:19:0)
[03:22:13.553] Build status: STARTED
[03:22:13.553] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:20:0) after 9m31s
[03:31:44.696] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:20:0)
[03:31:44.735] Build status: STARTED
[03:31:44.735] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:21:0) after 8m43s
[03:40:27.758] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:21:0)
[03:40:27.786] Build status: STARTED
[03:40:27.786] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:22:0) after 7m29s
[03:47:56.831] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:22:0)
[03:47:56.864] Build status: STARTED
[03:47:56.864] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:23:0) after 8m8s
[03:56:04.989] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:23:0)
[03:56:05.022] Build status: STARTED
[03:56:05.022] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:24:0) after 4m8s
[04:00:13.054] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:24:0)
[04:00:13.098] Build status: STARTED
[04:00:13.098] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:25:0) after 6m11s
[04:06:24.242] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:25:0)
[04:06:24.284] Build status: STARTED
[04:06:24.284] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:26:0) after 3m49s
[04:10:13.469] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:26:0)
[04:10:13.497] Build status: STARTED
[04:10:13.497] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:27:0) after 4m35s
[04:14:48.732] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:27:0)
[04:14:48.761] Build status: STARTED
[04:14:48.761] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:28:0) after 7m48s
[04:22:36.784] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:28:0)
[04:22:36.819] Build status: STARTED
[04:22:36.819] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:29:0) after 7m31s
[04:30:07.849] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:29:0)
[04:30:07.890] Build status: STARTED
[04:30:07.890] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:30:0) after 6m7s
[04:36:14.875] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:30:0)
[04:36:14.906] Build status: STARTED
[04:36:14.906] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:31:0) after 6m11s
[04:42:25.931] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:31:0)
[04:42:25.963] Build status: STARTED
[04:42:25.963] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:32:0) after 7m56s
[04:50:22.127] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:32:0)
[04:50:22.156] Build status: STARTED
[04:50:22.156] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:33:0) after 6m42s
[04:57:04.184] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:33:0)
[04:57:04.225] Build status: STARTED
[04:57:04.225] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:34:0) after 9m15s
[05:06:19.357] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:34:0)
[05:06:19.401] Build status: STARTED
[05:06:19.401] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:35:0) after 7m24s
[05:13:43.501] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:35:0)
[05:13:43.535] Build status: STARTED
[05:13:43.535] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:36:0) after 1m12s
[05:14:55.560] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:36:0)
[05:14:55.585] Build status: STARTED
[05:14:55.585] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:37:0) after 5m7s
[05:20:02.612] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:37:0)
[05:20:02.642] Build status: STARTED
[05:20:02.642] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:38:0) after 6m48s
[05:26:50.675] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:38:0)
[05:26:50.705] Build status: STARTED
[05:26:50.705] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:39:0) after 4m56s
[05:31:46.770] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:39:0)
[05:31:46.799] Build status: STARTED
[05:31:46.799] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:40:0) after 3m15s
[05:35:01.834] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:40:0)
[05:35:01.886] Build status: STARTED
[05:35:01.886] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:41:0) after 1m2s
[05:36:03.871] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:41:0)
[05:36:03.909] Build status: STARTED
[05:36:03.909] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:42:0) after 7m21s
[05:43:24.933] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:42:0)
[05:43:24.973] Build status: STARTED
[05:43:24.973] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:43:0) after 8m53s
[05:52:18.008] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:43:0)
[05:52:18.099] Build status: STARTED
[05:52:18.099] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:44:0) after 7m55s
[06:00:13.126] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:44:0)
[06:00:13.167] Build status: STARTED
[06:00:13.167] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:45:0) after 4m43s
[06:04:56.193] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:45:0)
[06:04:56.224] Build status: STARTED
[06:04:56.224] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:46:0) after 5m42s
[06:10:38.252] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:46:0)
[06:10:38.281] Build status: STARTED
[06:10:38.281] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:47:0) after 2m32s
[06:13:10.377] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:47:0)
[06:13:10.416] Build status: STARTED
[06:13:10.416] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:48:0) after 9m22s
[06:22:32.418] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:48:0)
[06:22:32.448] Build status: STARTED
[06:22:32.448] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:49:0) after 1m41s
[06:24:13.593] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:49:0)
[06:24:13.621] Build status: STARTED
[06:24:13.621] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:50:0) after 8m40s
[06:32:53.676] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:50:0)
[06:32:53.709] Build status: STARTED
[06:32:53.709] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:51:0) after 9m50s
[06:42:43.749] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:51:0)
[06:42:43.776] Build status: STARTED
[06:42:43.776] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:52:0) after 7m15s
[06:49:59.006] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:52:0)
[06:49:59.035] Build status: STARTED
[06:49:59.035] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9012182710895456736:53:0) after 7m22s
[06:51:32.974] Received PubSub notification, asking Buildbucket for the build status
[06:51:33.018] Build:
{
"id": "8846752648975994192",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22150,
"createdBy": "project:chromium",
"createTime": "2021-05-20T02:03:57.280110Z",
"startTime": "2021-05-20T02:07:08.388383Z",
"endTime": "2021-05-20T06:51:32.414102327Z",
"updateTime": "2021-05-20T06:51:32.414645611Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "cd087e0d8e748057971ab867759f94735ec8ac18",
"ref": "refs/heads/master"
}
}
}
[06:51:33.018] Invocation finished in 4h47m36.951402395s with status FAILED