Silo

Silo is a decentralized infrastructure to distribute your compute across multiple machines in parallel. For ex. if you want to run a certain python function, the silo infrastructure handles all the distribution across multiple machines, it runs the codes across multiple machines and multiple containers and sends the output back, all within few seconds.

Client Side:

Once the user defines the function and the ip address of the sever(s) to run the function on, we first convert the function to binary code, along with it's inputs, encrypt it via lit protocol and save it on filecoin storage. We then send the info via gRPC to the servers .

Server Side: The server ( built using rust ) get's the python function's binary file CID ( file stored in filecoin ) and decrypt the file ( using lit protocol ), the server then launches a container ( we built a custom container runtime engine from scratch in rust to minimize latency ) .

After launching the container, it's run the python function and returns the output back to the client.

The server has the capability to handle multiple requests concurrently