Replace filters/infer-site.py #42
Loading…
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
To provide a best-effort match between a contributor's
delegated_byproperty and a TRR "site" (website taxonomy), a custom infer-site.py script is used:- name: Process contributorsrun: |cd ${{ steps.codecheckout.outputs.path }}dtc read-pages ${POOLAPI}/public/records/p/TRR379Person \| qrg inline-records --api-url ${POOLAPI}/ -c public -p delegated_by \| uv run filters/join-association.py --inline --pop --field-name x_associated_projects - .cache/projects.jsonl associated_with - \| uv run filters/infer-site.py - ${{ steps.datacheckout.outputs.path }}/v2.2-2026-01-29-ror-data.parquet - \| uv run person.py - ${{ steps.websitecheckout.outputs.path }}/content/contributorsThe custom script also relies on the ROR data dump (mirrored in q02/ror-data-copy in parquet format for faster access). The data dump is used because it provides an ability to walk "parent" and "related" organizations (this information is not available in the Pool).
It is not clear how we can proceed. Maybe we could extract a smaller mapping to not re-discover it on build. Maybe we need to represent the "site" directly in the metadata system. Maybe we need to give up on the concept of "site".