[03:24:21.292] New invocation is queued and will start shortly
[03:24:22.369] Starting the invocation (attempt 1)
[03:24:22.419] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/2f4cb827324fcfb06c94a1ee6200bc6fb8f6e22b"
[03:24:22.419] Popped gitiles commit info from properties and tags
[03:24:22.419] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[03:24:22.419] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[03:24:22.419] Buildbucket request:
{
"requestId": "9010909293767917840",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2f4cb827324fcfb06c94a1ee6200bc6fb8f6e22b",
"ref": "refs/heads/master"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9010909293767917840"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[03:24:23.469] Scheduled build:
{
"id": "8845479231768444608",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22228,
"createdBy": "project:chromium",
"createTime": "2021-06-03T03:24:22.565061Z",
"updateTime": "2021-06-03T03:24:23.374372Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2f4cb827324fcfb06c94a1ee6200bc6fb8f6e22b",
"ref": "refs/heads/master"
}
},
"canary": true
}
[03:24:23.469] Task URL: https://cr-buildbucket.appspot.com/build/8845479231768444608
[03:24:23.469] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:2:0) after 4m54s
[03:27:18.282] Received PubSub notification, asking Buildbucket for the build status
[03:27:18.308] Build status: STARTED
[03:29:17.487] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:2:0)
[03:29:17.511] Build status: STARTED
[03:29:17.511] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:4:0) after 6m2s
[03:35:19.553] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:4:0)
[03:35:19.579] Build status: STARTED
[03:35:19.579] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:5:0) after 9m50s
[03:45:09.573] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:5:0)
[03:45:09.609] Build status: STARTED
[03:45:09.609] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:6:0) after 7m46s
[03:52:55.759] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:6:0)
[03:52:55.785] Build status: STARTED
[03:52:55.785] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:7:0) after 5m8s
[03:58:03.863] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:7:0)
[03:58:03.891] Build status: STARTED
[03:58:03.891] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:8:0) after 7m57s
[04:06:00.902] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:8:0)
[04:06:00.934] Build status: STARTED
[04:06:00.934] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:9:0) after 2m1s
[04:08:01.982] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:9:0)
[04:08:02.011] Build status: STARTED
[04:08:02.011] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:10:0) after 4m42s
[04:12:44.035] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:10:0)
[04:12:44.066] Build status: STARTED
[04:12:44.066] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:11:0) after 2m49s
[04:15:33.447] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:11:0)
[04:15:33.477] Build status: STARTED
[04:15:33.477] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:12:0) after 9m1s
[04:24:34.524] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:12:0)
[04:24:34.558] Build status: STARTED
[04:24:34.558] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:13:0) after 8m45s
[04:33:19.703] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:13:0)
[04:33:19.739] Build status: STARTED
[04:33:19.739] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:14:0) after 9m52s
[04:43:11.761] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:14:0)
[04:43:11.794] Build status: STARTED
[04:43:11.794] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:15:0) after 8m24s
[04:51:35.828] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:15:0)
[04:51:35.855] Build status: STARTED
[04:51:35.855] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:16:0) after 4m24s
[04:55:59.984] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:16:0)
[04:56:00.012] Build status: STARTED
[04:56:00.012] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:17:0) after 8m56s
[05:04:56.040] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:17:0)
[05:04:56.066] Build status: STARTED
[05:04:56.066] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:18:0) after 4m47s
[05:09:43.476] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:18:0)
[05:09:43.505] Build status: STARTED
[05:09:43.505] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:19:0) after 3m14s
[05:12:57.556] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:19:0)
[05:12:57.584] Build status: STARTED
[05:12:57.584] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:20:0) after 1m42s
[05:14:39.733] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:20:0)
[05:14:39.762] Build status: STARTED
[05:14:39.762] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:21:0) after 1m30s
[05:16:09.888] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:21:0)
[05:16:09.920] Build status: STARTED
[05:16:09.920] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:22:0) after 3m8s
[05:19:17.941] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:22:0)
[05:19:17.966] Build status: STARTED
[05:19:17.966] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:23:0) after 3m28s
[05:22:45.986] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:23:0)
[05:22:46.031] Build status: STARTED
[05:22:46.031] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:24:0) after 4m41s
[05:27:27.024] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:24:0)
[05:27:27.074] Build status: STARTED
[05:27:27.074] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:25:0) after 6m29s
[05:33:56.333] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:25:0)
[05:33:56.376] Build status: STARTED
[05:33:56.376] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:26:0) after 1m48s
[05:35:44.424] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:26:0)
[05:35:44.451] Build status: STARTED
[05:35:44.451] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:27:0) after 4m24s
[05:40:08.470] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:27:0)
[05:40:08.499] Build status: STARTED
[05:40:08.499] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:28:0) after 1m15s
[05:41:23.515] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:28:0)
[05:41:23.550] Build status: STARTED
[05:41:23.550] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:29:0) after 3m22s
[05:44:45.581] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:29:0)
[05:44:45.621] Build status: STARTED
[05:44:45.621] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:30:0) after 2m40s
[05:47:25.699] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:30:0)
[05:47:25.735] Build status: STARTED
[05:47:25.735] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:31:0) after 9m25s
[05:56:51.022] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:31:0)
[05:56:51.049] Build status: STARTED
[05:56:51.049] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:32:0) after 3m15s
[06:00:06.303] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:32:0)
[06:00:06.337] Build status: STARTED
[06:00:06.337] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:33:0) after 9m54s
[06:10:00.399] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:33:0)
[06:10:00.429] Build status: STARTED
[06:10:00.429] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:34:0) after 1m50s
[06:11:50.458] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:34:0)
[06:11:50.485] Build status: STARTED
[06:11:50.485] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:35:0) after 9m6s
[06:20:56.527] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:35:0)
[06:20:56.562] Build status: STARTED
[06:20:56.562] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:36:0) after 1m17s
[06:22:13.975] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:36:0)
[06:22:14.003] Build status: STARTED
[06:22:14.003] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:37:0) after 2m32s
[06:24:46.064] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:37:0)
[06:24:46.100] Build status: STARTED
[06:24:46.100] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:38:0) after 7m45s
[06:32:31.212] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:38:0)
[06:32:31.242] Build status: STARTED
[06:32:31.242] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:39:0) after 8m47s
[06:41:18.388] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:39:0)
[06:41:18.420] Build status: STARTED
[06:41:18.420] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:40:0) after 5m39s
[06:46:57.512] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:40:0)
[06:46:57.540] Build status: STARTED
[06:46:57.540] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:41:0) after 2m56s
[06:49:53.562] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:41:0)
[06:49:53.589] Build status: STARTED
[06:49:53.589] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:42:0) after 8m30s
[06:58:23.578] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:42:0)
[06:58:23.607] Build status: STARTED
[06:58:23.607] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:43:0) after 2m51s
[07:01:14.925] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:43:0)
[07:01:14.952] Build status: STARTED
[07:01:14.952] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:44:0) after 4m5s
[07:05:20.064] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:44:0)
[07:05:20.095] Build status: STARTED
[07:05:20.095] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:45:0) after 4m20s
[07:09:40.407] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:45:0)
[07:09:40.433] Build status: STARTED
[07:09:40.433] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:46:0) after 2m18s
[07:11:58.849] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:46:0)
[07:11:58.885] Build status: STARTED
[07:11:58.885] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:47:0) after 8m51s
[07:20:49.913] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:47:0)
[07:20:49.944] Build status: STARTED
[07:20:49.944] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:48:0) after 8m59s
[07:29:49.074] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:48:0)
[07:29:49.101] Build status: STARTED
[07:29:49.101] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:49:0) after 8m29s
[07:38:18.148] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:49:0)
[07:38:18.181] Build status: STARTED
[07:38:18.181] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:50:0) after 2m18s
[07:40:36.326] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:50:0)
[07:40:36.359] Build status: STARTED
[07:40:36.359] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:51:0) after 5m41s
[07:46:17.471] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:51:0)
[07:46:17.500] Build status: STARTED
[07:46:17.500] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:52:0) after 2m54s
[07:49:11.724] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:52:0)
[07:49:11.751] Build status: STARTED
[07:49:11.751] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:53:0) after 3m34s
[07:52:45.785] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:53:0)
[07:52:45.821] Build status: STARTED
[07:52:45.821] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:54:0) after 8m23s
[08:01:09.047] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:54:0)
[08:01:09.100] Build status: STARTED
[08:01:09.100] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:55:0) after 3m23s
[08:04:32.131] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:55:0)
[08:04:32.211] Build status: STARTED
[08:04:32.211] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:56:0) after 2m36s
[08:07:08.199] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:56:0)
[08:07:08.226] Build status: STARTED
[08:07:08.226] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9010909293767917840:57:0) after 6m36s
[08:10:09.566] Received PubSub notification, asking Buildbucket for the build status
[08:10:09.602] Build:
{
"id": "8845479231768444608",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 22228,
"createdBy": "project:chromium",
"createTime": "2021-06-03T03:24:22.565061Z",
"startTime": "2021-06-03T03:27:17.519469Z",
"endTime": "2021-06-03T08:10:08.928254271Z",
"updateTime": "2021-06-03T08:10:08.930137485Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "2f4cb827324fcfb06c94a1ee6200bc6fb8f6e22b",
"ref": "refs/heads/master"
}
},
"canary": true
}
[08:10:09.602] Invocation finished in 4h45m48.327058531s with status FAILED