[03:26:50.205] New invocation is queued and will start shortly
[03:26:51.298] Starting the invocation (attempt 1)
[03:26:51.328] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/8571f9784b41f0db41c2a87c6dc153de6054f829"
[03:26:51.328] Popped gitiles commit info from properties and tags
[03:26:51.328] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[03:26:51.328] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[03:26:51.328] Buildbucket request:
{
"requestId": "9015076598072629408",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8571f9784b41f0db41c2a87c6dc153de6054f829",
"ref": "refs/heads/master"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9015076598072629408"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOSDevice"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[03:26:51.817] Scheduled build:
{
"id": "8849646536169030880",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 21946,
"createdBy": "project:chromium",
"createTime": "2021-04-18T03:26:51.390896Z",
"updateTime": "2021-04-18T03:26:51.751069Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8571f9784b41f0db41c2a87c6dc153de6054f829",
"ref": "refs/heads/master"
}
}
}
[03:26:51.817] Task URL: https://cr-buildbucket.appspot.com/build/8849646536169030880
[03:26:51.817] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:2:0) after 7m8s
[03:29:51.161] Received PubSub notification, asking Buildbucket for the build status
[03:29:51.183] Build status: STARTED
[03:34:00.322] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:2:0)
[03:34:00.352] Build status: STARTED
[03:34:00.352] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:4:0) after 3m31s
[03:37:31.597] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:4:0)
[03:37:31.623] Build status: STARTED
[03:37:31.623] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:5:0) after 6m37s
[03:44:08.935] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:5:0)
[03:44:08.963] Build status: STARTED
[03:44:08.963] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:6:0) after 2m24s
[03:46:33.361] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:6:0)
[03:46:33.390] Build status: STARTED
[03:46:33.390] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:7:0) after 6m7s
[03:52:40.583] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:7:0)
[03:52:40.607] Build status: STARTED
[03:52:40.607] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:8:0) after 5m49s
[03:58:29.626] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:8:0)
[03:58:29.651] Build status: STARTED
[03:58:29.651] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:9:0) after 6m11s
[04:04:40.870] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:9:0)
[04:04:40.910] Build status: STARTED
[04:04:40.910] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:10:0) after 3m18s
[04:07:59.022] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:10:0)
[04:07:59.052] Build status: STARTED
[04:07:59.052] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:11:0) after 5m22s
[04:13:21.278] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:11:0)
[04:13:21.304] Build status: STARTED
[04:13:21.304] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:12:0) after 1m0s
[04:14:21.335] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:12:0)
[04:14:21.369] Build status: STARTED
[04:14:21.369] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:13:0) after 3m17s
[04:17:38.384] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:13:0)
[04:17:38.410] Build status: STARTED
[04:17:38.410] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:14:0) after 2m51s
[04:20:29.430] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:14:0)
[04:20:29.461] Build status: STARTED
[04:20:29.461] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:15:0) after 9m56s
[04:30:25.514] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:15:0)
[04:30:25.542] Build status: STARTED
[04:30:25.542] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:16:0) after 3m40s
[04:34:05.567] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:16:0)
[04:34:05.589] Build status: STARTED
[04:34:05.589] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:17:0) after 6m30s
[04:40:35.607] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:17:0)
[04:40:35.630] Build status: STARTED
[04:40:35.630] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:18:0) after 9m28s
[04:50:03.669] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:18:0)
[04:50:03.697] Build status: STARTED
[04:50:03.697] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:19:0) after 8m25s
[04:58:28.722] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:19:0)
[04:58:28.751] Build status: STARTED
[04:58:28.751] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:20:0) after 2m21s
[05:00:49.782] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:20:0)
[05:00:49.863] Build status: STARTED
[05:00:49.863] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:21:0) after 5m15s
[05:06:04.912] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:21:0)
[05:06:04.939] Build status: STARTED
[05:06:04.939] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:22:0) after 8m8s
[05:14:13.225] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:22:0)
[05:14:13.255] Build status: STARTED
[05:14:13.255] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:23:0) after 9m50s
[05:24:03.286] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:23:0)
[05:24:03.322] Build status: STARTED
[05:24:03.322] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:24:0) after 2m24s
[05:26:27.364] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:24:0)
[05:26:27.412] Build status: STARTED
[05:26:27.412] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:25:0) after 6m29s
[05:32:56.449] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:25:0)
[05:32:56.477] Build status: STARTED
[05:32:56.477] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:26:0) after 5m22s
[05:38:18.763] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:26:0)
[05:38:18.801] Build status: STARTED
[05:38:18.801] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:27:0) after 2m6s
[05:40:25.223] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:27:0)
[05:40:25.251] Build status: STARTED
[05:40:25.251] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:28:0) after 4m55s
[05:45:20.795] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:28:0)
[05:45:20.842] Build status: STARTED
[05:45:20.842] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:29:0) after 4m40s
[05:50:01.061] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:29:0)
[05:50:01.091] Build status: STARTED
[05:50:01.091] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:30:0) after 6m57s
[05:56:58.331] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:30:0)
[05:56:58.361] Build status: STARTED
[05:56:58.361] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:31:0) after 3m3s
[06:00:01.379] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:31:0)
[06:00:01.409] Build status: STARTED
[06:00:01.409] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:32:0) after 6m14s
[06:06:15.431] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:32:0)
[06:06:15.462] Build status: STARTED
[06:06:15.462] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:33:0) after 7m13s
[06:13:28.505] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:33:0)
[06:13:28.531] Build status: STARTED
[06:13:28.531] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:34:0) after 5m21s
[06:18:49.561] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:34:0)
[06:18:49.591] Build status: STARTED
[06:18:49.591] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:35:0) after 9m55s
[06:28:44.732] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:35:0)
[06:28:44.761] Build status: STARTED
[06:28:44.761] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:36:0) after 4m45s
[06:33:29.975] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:36:0)
[06:33:30.006] Build status: STARTED
[06:33:30.006] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:37:0) after 6m1s
[06:39:31.396] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:37:0)
[06:39:31.424] Build status: STARTED
[06:39:31.424] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:38:0) after 1m43s
[06:41:14.725] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:38:0)
[06:41:14.760] Build status: STARTED
[06:41:14.760] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:39:0) after 3m42s
[06:44:56.782] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:39:0)
[06:44:56.816] Build status: STARTED
[06:44:56.816] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:40:0) after 2m45s
[06:47:41.982] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:40:0)
[06:47:42.009] Build status: STARTED
[06:47:42.009] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:41:0) after 6m30s
[06:54:12.117] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:41:0)
[06:54:12.147] Build status: STARTED
[06:54:12.147] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:42:0) after 7m45s
[07:01:57.225] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:42:0)
[07:01:57.264] Build status: STARTED
[07:01:57.264] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:43:0) after 1m44s
[07:03:41.634] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:43:0)
[07:03:41.661] Build status: STARTED
[07:03:41.661] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:44:0) after 4m54s
[07:08:35.688] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:44:0)
[07:08:35.719] Build status: STARTED
[07:08:35.719] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:45:0) after 8m38s
[07:17:13.736] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:45:0)
[07:17:13.763] Build status: STARTED
[07:17:13.763] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:46:0) after 8m57s
[07:26:11.281] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:46:0)
[07:26:11.307] Build status: STARTED
[07:26:11.307] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:47:0) after 3m6s
[07:29:17.722] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:47:0)
[07:29:17.746] Build status: STARTED
[07:29:17.746] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:48:0) after 9m19s
[07:38:36.784] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:48:0)
[07:38:36.811] Build status: STARTED
[07:38:36.811] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:49:0) after 4m55s
[07:43:31.831] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:49:0)
[07:43:31.858] Build status: STARTED
[07:43:31.858] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:50:0) after 1m46s
[07:45:17.891] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:50:0)
[07:45:17.925] Build status: STARTED
[07:45:17.925] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:51:0) after 8m1s
[07:53:19.032] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:51:0)
[07:53:19.059] Build status: STARTED
[07:53:19.059] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:52:0) after 7m9s
[08:00:28.167] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:52:0)
[08:00:28.212] Build status: STARTED
[08:00:28.212] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:53:0) after 8m20s
[08:08:48.362] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:53:0)
[08:08:48.395] Build status: STARTED
[08:08:48.395] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:54:0) after 3m43s
[08:12:32.099] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:54:0)
[08:12:32.123] Build status: STARTED
[08:12:32.123] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:55:0) after 5m3s
[08:17:35.144] Handling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:55:0)
[08:17:35.173] Build status: STARTED
[08:17:35.173] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOSDevice:9015076598072629408:56:0) after 2m41s
[08:19:41.400] Received PubSub notification, asking Buildbucket for the build status
[08:19:41.427] Build:
{
"id": "8849646536169030880",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOSDevice"
},
"number": 21946,
"createdBy": "project:chromium",
"createTime": "2021-04-18T03:26:51.390896Z",
"startTime": "2021-04-18T03:29:49.439711Z",
"endTime": "2021-04-18T08:19:41.046487144Z",
"updateTime": "2021-04-18T08:19:41.046932808Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "8571f9784b41f0db41c2a87c6dc153de6054f829",
"ref": "refs/heads/master"
}
}
}
[08:19:41.427] Invocation finished in 4h52m51.236629754s with status FAILED