[16:09:09.073] New invocation is queued and will start shortly
[16:09:10.393] Starting the invocation (attempt 1)
[16:09:10.452] Popped buildset tag "buildset:commit/gitiles/chromium.googlesource.com/chromium/src/+/b3bd8477ec8731b1c7ee96fc340423e7c6975826"
[16:09:10.452] Popped gitiles commit info from properties and tags
[16:09:10.452] Preparing PubSub topic for "https://cr-buildbucket.appspot.com"
[16:09:10.452] PubSub topic is "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
[16:09:10.452] Buildbucket request:
{
"requestId": "8956231206197524256",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"properties": {
},
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b3bd8477ec8731b1c7ee96fc340423e7c6975826",
"ref": "refs/heads/main"
},
"tags": [
{
"key": "scheduler_invocation_id",
"value": "8956231206197524256"
},
{
"key": "scheduler_job_id",
"value": "chromium/Mac deterministic"
},
{
"key": "user_agent",
"value": "luci-scheduler"
}
],
"notify": {
"pubsubTopic": "projects/luci-scheduler/topics/scheduler.buildbucket.cr-buildbucket~appspot.gserviceaccount.com"
}
}
[16:09:10.952] Scheduled build:
{
"id": "8790801144003225681",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60256,
"createdBy": "project:chromium",
"createTime": "2023-01-27T16:09:10.537225464Z",
"updateTime": "2023-01-27T16:09:10.537225464Z",
"status": "SCHEDULED",
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b3bd8477ec8731b1c7ee96fc340423e7c6975826",
"ref": "refs/heads/main"
}
}
}
[16:09:10.952] Task URL: https://cr-buildbucket.appspot.com/build/8790801144003225681
[16:09:10.952] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:2:0) after 2m51s
[16:12:01.958] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:2:0)
[16:12:01.979] Build status: SCHEDULED
[16:12:01.979] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:3:0) after 9m28s
[16:21:30.185] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:3:0)
[16:21:30.207] Build status: SCHEDULED
[16:21:30.207] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:4:0) after 8m45s
[16:30:15.410] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:4:0)
[16:30:15.432] Build status: SCHEDULED
[16:30:15.432] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:5:0) after 7m21s
[16:37:36.812] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:5:0)
[16:37:36.835] Build status: SCHEDULED
[16:37:36.835] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:6:0) after 6m39s
[16:44:16.021] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:6:0)
[16:44:16.041] Build status: SCHEDULED
[16:44:16.041] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:7:0) after 7m21s
[16:51:37.060] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:7:0)
[16:51:37.085] Build status: SCHEDULED
[16:51:37.085] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:8:0) after 3m59s
[16:55:36.244] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:8:0)
[16:55:36.268] Build status: SCHEDULED
[16:55:36.268] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:9:0) after 5m45s
[17:01:21.546] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:9:0)
[17:01:21.622] Build status: SCHEDULED
[17:01:21.622] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:10:0) after 5m50s
[17:07:11.834] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:10:0)
[17:07:11.886] Build status: SCHEDULED
[17:07:11.886] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:11:0) after 2m36s
[17:09:47.915] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:11:0)
[17:09:47.999] Build status: SCHEDULED
[17:09:47.999] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:12:0) after 9m40s
[17:19:28.221] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:12:0)
[17:19:28.243] Build status: SCHEDULED
[17:19:28.243] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:13:0) after 4m26s
[17:23:54.292] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:13:0)
[17:23:54.333] Build status: SCHEDULED
[17:23:54.333] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:14:0) after 2m49s
[17:26:43.513] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:14:0)
[17:26:43.535] Build status: SCHEDULED
[17:26:43.535] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:15:0) after 5m15s
[17:31:58.627] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:15:0)
[17:31:58.650] Build status: SCHEDULED
[17:31:58.650] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:16:0) after 6m58s
[17:38:56.810] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:16:0)
[17:38:56.832] Build status: SCHEDULED
[17:38:56.833] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:17:0) after 5m31s
[17:44:27.954] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:17:0)
[17:44:27.973] Build status: SCHEDULED
[17:44:27.973] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:18:0) after 3m18s
[17:47:46.088] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:18:0)
[17:47:46.109] Build status: SCHEDULED
[17:47:46.109] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:19:0) after 1m56s
[17:49:42.243] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:19:0)
[17:49:42.265] Build status: SCHEDULED
[17:49:42.265] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:20:0) after 3m31s
[17:53:13.582] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:20:0)
[17:53:13.605] Build status: SCHEDULED
[17:53:13.605] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:21:0) after 2m42s
[17:55:55.660] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:21:0)
[17:55:55.791] Build status: SCHEDULED
[17:55:55.791] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:22:0) after 6m2s
[18:01:58.552] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:22:0)
[18:01:58.576] Build status: SCHEDULED
[18:01:58.576] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:23:0) after 8m34s
[18:10:32.610] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:23:0)
[18:10:32.631] Build status: SCHEDULED
[18:10:32.631] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:24:0) after 2m58s
[18:13:30.657] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:24:0)
[18:13:30.677] Build status: SCHEDULED
[18:13:30.677] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:25:0) after 2m12s
[18:15:42.715] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:25:0)
[18:15:42.846] Build status: SCHEDULED
[18:15:42.846] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:26:0) after 8m51s
[18:24:33.880] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:26:0)
[18:24:33.900] Build status: SCHEDULED
[18:24:33.900] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:27:0) after 7m32s
[18:32:05.978] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:27:0)
[18:32:06.078] Build status: SCHEDULED
[18:32:06.078] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:28:0) after 6m42s
[18:38:48.188] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:28:0)
[18:38:48.207] Build status: SCHEDULED
[18:38:48.207] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:29:0) after 1m18s
[18:40:06.321] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:29:0)
[18:40:06.350] Build status: SCHEDULED
[18:40:06.350] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:30:0) after 9m8s
[18:49:14.370] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:30:0)
[18:49:14.393] Build status: SCHEDULED
[18:49:14.393] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:31:0) after 7m40s
[18:56:54.473] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:31:0)
[18:56:54.496] Build status: SCHEDULED
[18:56:54.496] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:32:0) after 8m24s
[19:05:18.525] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:32:0)
[19:05:18.609] Build status: SCHEDULED
[19:05:18.609] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:33:0) after 9m21s
[19:14:39.629] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:33:0)
[19:14:39.655] Build status: SCHEDULED
[19:14:39.655] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:34:0) after 9m55s
[19:24:34.909] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:34:0)
[19:24:34.930] Build status: SCHEDULED
[19:24:34.930] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:35:0) after 3m25s
[19:28:00.038] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:35:0)
[19:28:00.068] Build status: SCHEDULED
[19:28:00.068] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:36:0) after 9m47s
[19:37:47.098] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:36:0)
[19:37:47.126] Build status: SCHEDULED
[19:37:47.126] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:37:0) after 3m21s
[19:41:08.340] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:37:0)
[19:41:08.373] Build status: SCHEDULED
[19:41:08.373] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:38:0) after 1m19s
[19:42:27.434] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:38:0)
[19:42:27.606] Build status: SCHEDULED
[19:42:27.606] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:39:0) after 9m47s
[19:52:14.680] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:39:0)
[19:52:14.701] Build status: SCHEDULED
[19:52:14.701] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:40:0) after 1m48s
[19:54:02.799] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:40:0)
[19:54:02.819] Build status: SCHEDULED
[19:54:02.819] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:41:0) after 7m1s
[20:01:03.977] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:41:0)
[20:01:04.016] Build status: SCHEDULED
[20:01:04.016] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:42:0) after 4m1s
[20:05:05.108] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:42:0)
[20:05:05.133] Build status: SCHEDULED
[20:05:05.134] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:43:0) after 8m10s
[20:13:15.213] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:43:0)
[20:13:15.243] Build status: SCHEDULED
[20:13:15.244] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:44:0) after 1m5s
[20:14:20.266] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:44:0)
[20:14:20.292] Build status: SCHEDULED
[20:14:20.292] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:45:0) after 5m3s
[20:19:23.317] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:45:0)
[20:19:23.351] Build status: SCHEDULED
[20:19:23.351] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:46:0) after 2m4s
[20:21:27.413] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:46:0)
[20:21:27.465] Build status: SCHEDULED
[20:21:27.465] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:47:0) after 2m10s
[20:23:37.533] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:47:0)
[20:23:37.554] Build status: SCHEDULED
[20:23:37.554] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:48:0) after 5m17s
[20:28:54.628] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:48:0)
[20:28:54.669] Build status: SCHEDULED
[20:28:54.669] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:49:0) after 8m16s
[20:37:10.711] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:49:0)
[20:37:10.732] Build status: SCHEDULED
[20:37:10.732] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:50:0) after 4m28s
[20:41:39.380] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:50:0)
[20:41:39.424] Build status: SCHEDULED
[20:41:39.424] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:51:0) after 9m53s
[20:51:32.456] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:51:0)
[20:51:32.487] Build status: SCHEDULED
[20:51:32.487] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:52:0) after 4m5s
[20:55:37.512] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:52:0)
[20:55:37.556] Build status: SCHEDULED
[20:55:37.556] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:53:0) after 3m25s
[20:59:02.582] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:53:0)
[20:59:02.609] Build status: SCHEDULED
[20:59:02.609] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:54:0) after 2m54s
[21:01:56.630] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:54:0)
[21:01:56.657] Build status: SCHEDULED
[21:01:56.657] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:55:0) after 8m51s
[21:10:47.835] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:55:0)
[21:10:47.855] Build status: SCHEDULED
[21:10:47.855] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:56:0) after 6m26s
[21:17:14.687] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:56:0)
[21:17:14.717] Build status: SCHEDULED
[21:17:14.717] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:57:0) after 8m58s
[21:26:13.118] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:57:0)
[21:26:13.139] Build status: SCHEDULED
[21:26:13.139] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:58:0) after 1m8s
[21:27:21.158] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:58:0)
[21:27:21.205] Build status: SCHEDULED
[21:27:21.205] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:59:0) after 3m56s
[21:31:17.680] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:59:0)
[21:31:17.718] Build status: SCHEDULED
[21:31:17.718] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:60:0) after 1m14s
[21:32:31.801] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:60:0)
[21:32:31.823] Build status: SCHEDULED
[21:32:31.823] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:61:0) after 3m46s
[21:36:17.850] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:61:0)
[21:36:17.875] Build status: SCHEDULED
[21:36:17.875] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:62:0) after 8m18s
[21:44:35.907] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:62:0)
[21:44:35.928] Build status: SCHEDULED
[21:44:35.928] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:63:0) after 5m20s
[21:49:56.179] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:63:0)
[21:49:56.203] Build status: SCHEDULED
[21:49:56.203] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:64:0) after 5m51s
[21:55:47.597] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:64:0)
[21:55:47.626] Build status: SCHEDULED
[21:55:47.626] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:65:0) after 7m36s
[22:03:23.994] Handling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:65:0)
[22:03:24.017] Build status: SCHEDULED
[22:03:24.017] Scheduling timer "check-buildbucket-build-status" (chromium/Mac deterministic:8956231206197524256:66:0) after 6m56s
[22:10:09.614] Received PubSub notification, asking Buildbucket for the build status
[22:10:09.661] Build:
{
"id": "8790801144003225681",
"builder": {
"project": "chromium",
"bucket": "ci",
"builder": "Mac deterministic"
},
"number": 60256,
"createdBy": "project:chromium",
"createTime": "2023-01-27T16:09:10.537225464Z",
"endTime": "2023-01-27T22:10:09.097966Z",
"updateTime": "2023-01-27T22:10:09.097966Z",
"status": "INFRA_FAILURE",
"statusDetails": {
"resourceExhaustion": {
},
"timeout": {
}
},
"input": {
"gitilesCommit": {
"host": "chromium.googlesource.com",
"project": "chromium/src",
"id": "b3bd8477ec8731b1c7ee96fc340423e7c6975826",
"ref": "refs/heads/main"
}
}
}
[22:10:09.661] Invocation finished in 6h1m0.600024285s with status FAILED