[13:18:47.498] New invocation is queued and will start shortly
[13:18:48.716] Starting the invocation (attempt 1)
[13:18:48.777] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/d38d56b60ac82f88bb66079a372fb28bd317ec9b"
[13:18:48.777] Popped gitiles commit info from properties and tags
[13:18:48.777] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[13:18:48.777] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[13:18:48.778] Buildbucket request:
{
"requestId": "9007248016385371088",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOS"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d38d56b60ac82f88bb66079a372fb28bd317ec9b",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "9007248016385371088"
},
{
"key": "scheduler_job_id",
"value": "chromium/ToTiOS"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[13:18:49.486] Scheduled build:
{
"id": "8841817954242321760",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOS"
},
"number": 18662,
"createdBy": "project:chromium",
"createTime": "2021-07-13T13:18:48.907927Z",
"updateTime": "2021-07-13T13:18:49.408541Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d38d56b60ac82f88bb66079a372fb28bd317ec9b",
"ref": "refs/heads/main"
}
},
"canary": true
}
[13:18:49.486] Task URL: https://cr-buildbucket.appspot.com/build/8841817954242321760
[13:18:49.486] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:2:0) after 5m52s
[13:21:19.650] Received PubSub notification, asking Buildbucket for the build status
[13:21:19.676] Build status: STARTED
[13:24:41.786] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:2:0)
[13:24:41.818] Build status: STARTED
[13:24:41.818] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:4:0) after 1m1s
[13:25:42.837] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:4:0)
[13:25:42.868] Build status: STARTED
[13:25:42.868] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:5:0) after 4m2s
[13:29:44.963] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:5:0)
[13:29:44.991] Build status: STARTED
[13:29:44.991] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:6:0) after 1m58s
[13:31:43.094] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:6:0)
[13:31:43.327] Build status: STARTED
[13:31:43.327] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:7:0) after 1m0s
[13:32:43.352] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:7:0)
[13:32:43.386] Build status: STARTED
[13:32:43.386] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:8:0) after 7m22s
[13:40:05.554] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:8:0)
[13:40:05.594] Build status: STARTED
[13:40:05.594] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:9:0) after 6m36s
[13:46:41.649] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:9:0)
[13:46:41.677] Build status: STARTED
[13:46:41.677] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:10:0) after 1m20s
[13:48:01.706] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:10:0)
[13:48:01.784] Build status: STARTED
[13:48:01.784] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:11:0) after 5m46s
[13:53:47.941] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:11:0)
[13:53:47.975] Build status: STARTED
[13:53:47.975] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:12:0) after 1m30s
[13:55:18.054] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:12:0)
[13:55:18.085] Build status: STARTED
[13:55:18.085] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:13:0) after 7m38s
[14:02:56.117] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:13:0)
[14:02:56.148] Build status: STARTED
[14:02:56.148] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:14:0) after 4m14s
[14:07:10.383] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:14:0)
[14:07:10.413] Build status: STARTED
[14:07:10.413] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:15:0) after 6m33s
[14:13:43.516] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:15:0)
[14:13:43.545] Build status: STARTED
[14:13:43.545] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:16:0) after 7m14s
[14:20:57.692] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:16:0)
[14:20:57.721] Build status: STARTED
[14:20:57.721] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:17:0) after 8m3s
[14:29:00.784] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:17:0)
[14:29:00.818] Build status: STARTED
[14:29:00.818] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:18:0) after 6m15s
[14:35:16.052] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:18:0)
[14:35:16.084] Build status: STARTED
[14:35:16.084] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:19:0) after 2m42s
[14:37:58.537] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:19:0)
[14:37:58.578] Build status: STARTED
[14:37:58.578] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:20:0) after 9m31s
[14:47:29.816] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:20:0)
[14:47:29.843] Build status: STARTED
[14:47:29.843] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:21:0) after 2m49s
[14:50:18.874] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:21:0)
[14:50:18.903] Build status: STARTED
[14:50:18.903] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:22:0) after 5m16s
[14:55:34.925] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:22:0)
[14:55:34.959] Build status: STARTED
[14:55:34.959] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:23:0) after 6m9s
[15:01:43.985] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:23:0)
[15:01:44.070] Build status: STARTED
[15:01:44.070] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:24:0) after 7m39s
[15:09:23.258] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:24:0)
[15:09:23.291] Build status: STARTED
[15:09:23.291] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:25:0) after 9m25s
[15:18:48.384] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:25:0)
[15:18:48.410] Build status: STARTED
[15:18:48.410] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:26:0) after 7m33s
[15:26:21.472] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:26:0)
[15:26:21.556] Build status: STARTED
[15:26:21.556] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:27:0) after 6m21s
[15:32:42.760] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:27:0)
[15:32:42.791] Build status: STARTED
[15:32:42.791] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:28:0) after 3m56s
[15:36:38.819] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:28:0)
[15:36:38.853] Build status: STARTED
[15:36:38.853] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:29:0) after 5m22s
[15:42:00.879] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:29:0)
[15:42:00.907] Build status: STARTED
[15:42:00.907] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:30:0) after 5m0s
[15:47:01.112] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:30:0)
[15:47:01.151] Build status: STARTED
[15:47:01.151] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:31:0) after 1m27s
[15:48:28.310] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:31:0)
[15:48:28.340] Build status: STARTED
[15:48:28.340] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:32:0) after 7m29s
[15:55:57.368] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:32:0)
[15:55:57.400] Build status: STARTED
[15:55:57.400] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:33:0) after 6m16s
[16:02:13.496] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:33:0)
[16:02:13.543] Build status: STARTED
[16:02:13.543] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:34:0) after 7m2s
[16:09:15.750] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:34:0)
[16:09:15.781] Build status: STARTED
[16:09:15.781] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:35:0) after 6m37s
[16:15:52.827] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:35:0)
[16:15:52.858] Build status: STARTED
[16:15:52.858] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:36:0) after 5m55s
[16:21:48.041] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:36:0)
[16:21:48.077] Build status: STARTED
[16:21:48.077] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:37:0) after 2m48s
[16:24:36.066] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:37:0)
[16:24:36.126] Build status: STARTED
[16:24:36.127] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:38:0) after 3m19s
[16:27:55.123] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:38:0)
[16:27:55.158] Build status: STARTED
[16:27:55.158] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:39:0) after 9m7s
[16:37:02.388] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:39:0)
[16:37:02.417] Build status: STARTED
[16:37:02.417] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:40:0) after 8m1s
[16:45:03.671] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:40:0)
[16:45:03.714] Build status: STARTED
[16:45:03.714] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:41:0) after 3m29s
[16:48:32.739] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:41:0)
[16:48:32.766] Build status: STARTED
[16:48:32.766] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:42:0) after 1m53s
[16:50:25.938] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:42:0)
[16:50:25.980] Build status: STARTED
[16:50:25.980] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:43:0) after 5m24s
[16:55:50.108] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:43:0)
[16:55:50.136] Build status: STARTED
[16:55:50.136] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:44:0) after 5m5s
[17:00:55.255] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:44:0)
[17:00:55.287] Build status: STARTED
[17:00:55.288] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:45:0) after 6m19s
[17:07:14.320] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:45:0)
[17:07:14.349] Build status: STARTED
[17:07:14.349] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:46:0) after 2m15s
[17:09:29.478] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:46:0)
[17:09:29.627] Build status: STARTED
[17:09:29.627] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:47:0) after 3m16s
[17:12:45.612] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:47:0)
[17:12:45.646] Build status: STARTED
[17:12:45.646] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:48:0) after 7m33s
[17:20:18.771] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:48:0)
[17:20:18.809] Build status: STARTED
[17:20:18.809] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:49:0) after 2m23s
[17:22:41.835] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:49:0)
[17:22:41.878] Build status: STARTED
[17:22:41.878] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:50:0) after 9m35s
[17:32:16.876] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:50:0)
[17:32:16.927] Build status: STARTED
[17:32:16.927] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:51:0) after 4m56s
[17:37:12.996] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:51:0)
[17:37:13.028] Build status: STARTED
[17:37:13.028] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:52:0) after 5m2s
[17:42:15.338] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:52:0)
[17:42:15.370] Build status: STARTED
[17:42:15.370] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:53:0) after 4m7s
[17:46:22.398] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:53:0)
[17:46:22.923] Build status: STARTED
[17:46:22.923] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:54:0) after 6m17s
[17:52:40.607] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:54:0)
[17:52:40.636] Build status: STARTED
[17:52:40.636] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:55:0) after 3m10s
[17:55:50.725] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:55:0)
[17:55:50.754] Build status: STARTED
[17:55:50.754] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:56:0) after 4m8s
[17:59:58.924] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:56:0)
[17:59:59.012] Build status: STARTED
[17:59:59.013] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:57:0) after 4m40s
[18:04:39.391] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:57:0)
[18:04:39.449] Build status: STARTED
[18:04:39.449] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:58:0) after 2m20s
[18:06:59.651] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:58:0)
[18:06:59.681] Build status: STARTED
[18:06:59.681] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:59:0) after 2m29s
[18:09:28.713] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:59:0)
[18:09:28.749] Build status: STARTED
[18:09:28.749] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:60:0) after 6m25s
[18:15:53.911] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:60:0)
[18:15:53.942] Build status: STARTED
[18:15:53.942] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:61:0) after 8m29s
[18:24:23.414] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:61:0)
[18:24:23.454] Build status: STARTED
[18:24:23.454] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:62:0) after 2m30s
[18:26:53.510] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:62:0)
[18:26:53.563] Build status: STARTED
[18:26:53.563] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:63:0) after 3m23s
[18:30:16.593] Handling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:63:0)
[18:30:16.623] Build status: STARTED
[18:30:16.623] Scheduling timer "check-buildbucket-build-status" (chromium/ToTiOS:9007248016385371088:64:0) after 9m10s
[18:36:16.573] Received PubSub notification, asking Buildbucket for the build status
[18:36:16.625] Build:
{
"id": "8841817954242321760",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "ToTiOS"
},
"number": 18662,
"createdBy": "project:chromium",
"createTime": "2021-07-13T13:18:48.907927Z",
"startTime": "2021-07-13T13:21:17.768277Z",
"endTime": "2021-07-13T18:36:16.157382168Z",
"updateTime": "2021-07-13T18:36:16.158003691Z",
"status": "FAILURE",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "d38d56b60ac82f88bb66079a372fb28bd317ec9b",
"ref": "refs/heads/main"
}
},
"canary": true
}
[18:36:16.625] Invocation finished in 5h17m29.145261078s with status FAILED