Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Mark tool runfiles as such in expanded execution log #23702

Closed
wants to merge 1 commit into from

Conversation

fmeum
Copy link
Collaborator

@fmeum fmeum commented Sep 21, 2024

The expanded execution log did not mark any runfiles as tools, but the (local and remote) worker implementations explicitly do check whether a runfiles middleman is a tool.

Also adds a missing usage of a test parameter in testRunfileSymlinkFileWithDirectoryContents.

@fmeum fmeum requested a review from tjgq September 21, 2024 17:38
@fmeum
Copy link
Collaborator Author

fmeum commented Sep 21, 2024

@tjgq I have only modified the test so far. I'm not entirely sure whether and how to fix this for the expanded format. Is there a cheap way to get all the artifacts that a runfiles middleman contains, without flattening additional nested sets?

The expanded execution log did not mark any runfiles as tools, but the (local and remote) worker implementations explicitly do check whether a runfiles middleman is a tool.

Also uses a previously unused test parameter in `testRunfileSymlinkFileWithDirectoryContents`.
@fmeum
Copy link
Collaborator Author

fmeum commented Sep 21, 2024

Nevermind, I think I found a way to do it without much overhead.

@fmeum fmeum marked this pull request as ready for review September 21, 2024 20:12
@github-actions github-actions bot added the awaiting-review PR is awaiting review from an assigned reviewer label Sep 21, 2024
@iancha1992 iancha1992 added the team-Remote-Exec Issues and PRs for the Execution (Remote) team label Sep 24, 2024
@tjgq tjgq added awaiting-PR-merge PR has been approved by a reviewer and is ready to be merge internally and removed awaiting-review PR is awaiting review from an assigned reviewer labels Sep 24, 2024
@fmeum
Copy link
Collaborator Author

fmeum commented Sep 24, 2024

@bazel-io fork 7.4.0

@github-actions github-actions bot removed the awaiting-PR-merge PR has been approved by a reviewer and is ready to be merge internally label Sep 25, 2024
@fmeum fmeum deleted the execlog-tool-runfiles branch September 25, 2024 11:21
bazel-io pushed a commit to bazel-io/bazel that referenced this pull request Sep 30, 2024
Cherry-picks the following changes:

* Optimize representation of runfiles in compact execution log (bazelbuild#23321)
* Keep runfiles tree IDs in memory for multiple test attempts (bazelbuild#23703)
* Fix naming inconsistency in `spawn.proto` (bazelbuild#23706)
* Mark tool runfiles as such in expanded execution log (bazelbuild#23702)

The cherry-picks required introducing a `Map<Artifact, RunfilesTree>`
shim to `RunfilesSupplier` that matches the Bazel 8 way of obtaining a
`RunfilesTree` from a runfiles middleman via `InputMetadataProvider`.

Closes bazelbuild#23683 
Closes bazelbuild#23710
Closes bazelbuild#23711
Closes bazelbuild#23734
@iancha1992
Copy link
Member

The changes in this PR have been included in Bazel 7.4.0 RC1. Please test out the release candidate and report any issues as soon as possible.
If you're using Bazelisk, you can point to the latest RC by setting USE_BAZEL_VERSION=7.4.0rc1. Thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
team-Remote-Exec Issues and PRs for the Execution (Remote) team
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants