Join Nostr
2026-09-02 18:59:45 UTC
in reply to

aljaz on Nostr: the fact that confidential inference is in not the greatest of states around as seen ...

the fact that confidential inference is in not the greatest of states around as seen in results at https://confidentialinference.net/attestation is one of the main reasons i'm building and sdk (still in early stage) https://github.com/enclava-labs/confidential-inference-sdk

the idea is to have a no nonsense way to integrate confidential inference properly, not just connecting to their openai compatible endpoint and praying for the best. this will enable you to fail close if attestation fails, it will hopefully also kick all providers asses to start doing things properly

the problem a lot of times is not necessarily that anyone is malicious, its just tedious to always have everything up2date and even more importantly we lack approaches that would be adopted by multiple providers so everyone rolls their setup a bit differently which leads to different attestation approach, different ways of communicating the versions etc.

also lets not get started about how easily reproducible the envs are, thats gonna be another story