If its an open source project, the answer is to rebuild from the tagged source.
Eg: https://github.com/fastapi/fastapi/tree/0.112.4
With the right repo setup, you can pip install git+https://github.com/fastapi/[email protected]
(example only, not sure it works), so pypi doesn't need to keep all previous wheels, its just easier for it to do so.