Skip to content

Port over changes made for paper submission#209

Merged
yhdengh merged 4 commits intomasterfrom
eurosys-cleanup
Oct 10, 2025
Merged

Port over changes made for paper submission#209
yhdengh merged 4 commits intomasterfrom
eurosys-cleanup

Conversation

@yhdengh
Copy link
Contributor

@yhdengh yhdengh commented Oct 7, 2025

This PR includes changes made for the paper submission that are useful for the master branch.

  • Implement functions related to reading directories and testing file existence in Flatware. This allows us to run the CPython without libraries packaged in a virtual filesystem layer.
  • Flatware also allows opening a file descriptor for a path. However, it currently does not keep the dirent of an opened path attached at a specific RO table index, and instead re-traverses from the root working directory every time when it needs the dirent. This still needs to be implemented in the future.
  • Fix various bugs in scheduler, runtime, and network worker.
  • Track total amount of available memory. Jobs that do not have requested memory available are not started until the requested resources are available.
  • Add get_shallow_tmp which only loads the top layer of a Tree into memory. select no longer creates a shallow copy of the Tree if it only selects one entry.

* `get_shallow_tmp` loads the raw first layer of a Tree into memory
  without shallowfying the entries or recursively loading all accessible
  data in to memory. This is useful for selecting entries from a
  Tree of a large number of entries by avoiding shallowfying the whole
  Tree.
@yhdengh yhdengh merged commit 9046859 into master Oct 10, 2025
13 checks passed
@yhdengh yhdengh deleted the eurosys-cleanup branch October 10, 2025 22:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants