Failure on Helix tests - Tests timing out

[MiYanni]

Build Information

Build: https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=635799
Build error leg or test failing: Microsoft.DotNet.MSBuildSdkResolver.Tests.dll.3.WorkItemExecution
Pull request: #40059

Error Message

Fill the error message using step by step known issues guidance.

{
  "ErrorMessage": "END OF WORK ITEM LOG: Command timed out, and was killed",
  "BuildRetry": false,
  "ExcludeConsoleLog": false
}

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=635799
Error message validated: [END OF WORK ITEM LOG: Command timed out, and was killed]
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 4/9/2024 5:21:23 PM UTC

Report

Build	Repository	Test	Pull Request
1541040	dotnet/sdk	Microsoft.DotNet.PackageInstall.Tests.dll.2.WorkItemExecution	#55484
1541028	dotnet/sdk	Microsoft.DotNet.PackageInstall.Tests.dll.2.WorkItemExecution
1540894	dotnet/sdk	Microsoft.DotNet.PackageInstall.Tests.dll.2.WorkItemExecution
1540893	dotnet/sdk	Microsoft.DotNet.PackageInstall.Tests.dll.3.WorkItemExecution
1540327	dotnet/sdk	Microsoft.DotNet.PackageInstall.Tests.dll.3.WorkItemExecution	#55602
1538482	dotnet/sdk	Microsoft.DotNet.PackageInstall.Tests.dll.2.WorkItemExecution	#55586
1524358	dotnet/sdk	Microsoft.DotNet.PackageInstall.Tests.dll.2.WorkItemExecution	#55445
1520853	dotnet/sdk	dotnet.Tests.dll.24.WorkItemExecution	#55354
1513547	dotnet/sdk	Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution	#55267
1512350	dotnet/sdk	Microsoft.DotNet.PackageInstall.Tests.dll.2.WorkItemExecution
3023341	dotnet-sdk	dotnet.Tests.dll.24.WorkItemExecution	#62942
1509455	dotnet/sdk	Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution	#55292
1509188	dotnet/sdk	dotnet.Tests.dll.24.WorkItemExecution
1509160	dotnet/sdk	dotnet.Tests.dll.24.WorkItemExecution	#55285
1507336	dotnet/sdk	Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution	#55212
3018913	dotnet-sdk	dotnet.Tests.dll.24.WorkItemExecution	#62663
1498341	dotnet/sdk	dotnet-watch.Tests.dll.2.WorkItemExecution	#55189
1497563	dotnet/sdk	Microsoft.DotNet.PackageInstall.Tests.dll.2.WorkItemExecution

Summary

24-Hour Hit Count	7-Day Hit Count	1-Month Count
5	6	18

[nagilson]

@tmat May you please look at this dotnet watch failure?

[tmat]

@nagilson I checked a few logs from above and it looks like the failures are in release/8.0.1xx branch. That wouldn't have various test infra fixes.

[nagilson]

Thank you for checking :) @tmat, which test infra fixes are you referring to? It may be worth porting them over to 8.0.1xx. Any disagreements @marcpopMSFT?

[nagilson]

We also just hit it in main, so there might be another existing problem: #41045

[baronfel]

@tmat this is popping up again in the rc1 branches, when you get back can you take a look?

[tmat]

@baronfel I can take a look. Do you have a link to the failed run? The test log should be good enough to determine the issue on main/rc1 branches.

[baronfel]

The helix timeouts are most of the failed tests in this pipeline, but you can't access them right now due to helix auth issues.