🍃 What is Lilypad?
Full Documentation
Vision
Lilypad is aiming to build an internet-scale trustless distributed compute network for web3. Creating the infrastructure for use cases like AI inference, ML training, DeSci and more.
Overview
Lilypad (v0) currently enables users to access verifiable, distributed off-chain compute directly from smart contracts.
Lilypad is at v0 and is a Proof of Concept project operating as an integration layer between Bacalhau compute jobs and solidity smart contracts. This integration enables users to access verifiable off-chain decentralised compute from DApps and smart contract projects, enabling interactions and innovations between on-chain and off-chain compute.
Lilypad v0 does not charge for compute jobs, outside of network running fees (ie. the cost of transactions on the blockchain network it is deployed to). It operates on the Bacalhau public compute network (which is free to use), though it is worth noting that there are no reliability guarantees given for this network (which is something future versions of this protocol will be working to improve\
Lilypad Roadmap
- v0: September 2022 - Lilypad Bridge POC for triggering and returning Bacalhau compute jobs from a smart contract
- v1: July 2023 - A modicum-based minimal testnet (EVM-based). See github
- v2: September 2023 - A more robust trustless distributed testnet
- v3: tbd - Lilypad Mainnet
Lilypad Roadmap
Lilypad v0 Reference
Architecture
Overview
Lilypad is a ‘bridge’ to enable computation jobs from smart contracts. The aim of Lilypad v0 was to create an integration for users to call Bacalhau jobs directly from their solidity smart contracts and hence enable interactions and innovations between on-chain and off-chain compute.
Lilypad v0 is a proof of concept bridge which runs off the public (free to use) Bacalhau compute network. As such, the reliability of jobs on this network are not guaranteed.
If you have a need for reliable compute based on this infrastructure - get in touch with us.
Lilypad v0 on the FVM Network
A user contract implements the LilypadCaller interface and to call a job, they make a function call to the deployed LilypadEvents contract.
This contract emits an event which the Lilypad bridge daemon listens for and then forwards on to the Bacalhau network for processing.
Once the job is complete, the results are returned back to the originating user contract from the bridge code.
Note: runBacalhauJob() is now runLilypadJob()
See more about how Bacalhau & Lilypad are related below:
-
FVM Hackerbase Video
Lilypad v0 Quick Start
Prefer Video?
Note: Since this video was released some changes have been made to the underlying code, but the process and general architecture remains the same.
Quick Start Guide
The Lilypad Contracts are not currently importable via npm (though this is in progress), so to import them to you own project, you'll need to use their github links
Using Lilypad in your own solidity smart contract requires the following steps
-
Create a contract that implements the LilypadCaller interface.
As part of this interface you need to implement 2 functions:
lilypadFulfilled- a callback function that will be called when the job completes successfullylilypadCancelled- a callback function that will be called when the job fails
-
Provide a public Docker Spec compatible for use on Bacalhau in JSON format to the contract.
-
To trigger a job from your contract, you need to call the
LilypadEventscontract which the Lilypad bridge is listening to and which connects to the Bacalhau public network. Create an instance ofLilypadEventsby passing the public contract address on the network you are using (see deployed network details) to theLilypadEventsconstructor. -
Call the LilypadEvents contract function
runLilypadJob()passing in the following parameters.
| Name | Type | Purpose |
|---|---|---|
_from | address | The address of the calling contract, to which success or failure will be passed back. You should probably use address(this) from your contract. |
_spec | string | A Bacalhau job spec in JSON format. See below for more information on creating a job spec. |
_resultType | LilypadResultType | The type of result that you want to be returned. If you specify CID, the result tree will come back as a retrievable IPFS CID. If you specify StdOut, StdErr or ExitCode, those raw values output from the job will be returned. |
Implement the LilypadCaller Interface in your contract
Create a contract that implements LilypadCallerInterface. As part of this interface you need to implement 2 functions:
lilypadFulfilled- a callback function that will be called when the job completes successfullylilypadCancelled- a callback function that will be called when the job fails
/** === LilypadCaller Interface === **/
pragma solidity >=0.8.4;
import 'https://github.com/bacalhau-project/lilypad/blob/main/hardhat/contracts/LilypadCallerInterface.sol' //Location of file link
/** === User Contract Example === **/
contract MyContract is LilypadCallerInterface {
function lilypadFulfilled(address _from, uint _jobId,
LilypadResultType _resultType, string calldata _result)
external override {
// Do something when the LilypadEvents contract returns
// results successfully
}
function lilypadCancelled(address _from, uint _jobId, string
calldata _errorMsg) external override {
// Do something if there's an error returned by the
// LilypadEvents contract
}
}
Add a Spec compatible with Bacalhau
There are several public examples you can try out without needing to know anything about Docker or WASM specification jobs -> see the Bacalhau Docs. The full specification for Bacalhau jobs can be seen here.
Bacalhau operates by executing jobs within containers. This means it is able to run any arbitrary Docker jobs or WASM images
We'll use the public Stable Diffusion Docker Container located here for this example.
Here's an example JSON job specification for the Stable Diffusion job:
{
"Engine": "docker",
"Verifier": "noop",
"PublisherSpec": { "Type": "ipfs" },
"Docker": {
"Image": "ghcr.io/bacalhau-project/examples/stable-diffusion-gpu:0.0.1",
"Entrypoint": ["python"],
"Parameters": [
"main.py",
"--o",
"./outputs",
"--p",
"A User Prompt Goes here"
]
},
"Resources": { "GPU": "1" },
"Outputs": [{ "Name": "outputs", "Path": "/outputs" }],
"Deal": { "Concurrency": 1 }
}
Here's an example of using this JSON specification in solidity:
Note that since we need to be able to add the user prompt input to the spec, it's been split into 2 parts.
string constant specStart = '{'
'"Engine": "docker",'
'"Verifier": "noop",'
'"PublisherSpec": {"Type": "ipfs"},'
'"Docker": {'
'"Image": "ghcr.io/bacalhau-project/examples/stable-diffusion-gpu:0.0.1",'
'"Entrypoint": ["python"],
'"Parameters": ["main.py", "--o", "./outputs", "--p", "';
string constant specEnd =
'"]},'
'"Resources": {"GPU": "1"},'
'"Outputs": [{"Name": "outputs", "Path": "/outputs"}],'
'"Deal": {"Concurrency": 1}'
'}';
//Example of use:
string memory spec = string.concat(specStart, _prompt, specEnd);
See more about how to onboard your Docker Workloads for Bacalhau, Onboard WebAssembly Workloads or Work with Custom Containers in the Bacalhau Docs.
Add the Lilypad Events Address & Network Fee
You can do this by either passing it into your constructor or setting it as a variable
// SPDX-License-Identifier: MIT
pragma solidity >=0.8.4;
import "https://github.com/bacalhau-project/lilypad/blob/main/hardhat/contracts/LilypadEventsUpgradeable.sol";
import "https://github.com/bacalhau-project/lilypad/blob/main/hardhat/contracts/LilypadCallerInterface.sol";
/** === User Contract Example === **/
contract MyContract is LilypadCallerInterface {
address public bridgeAddress; // LilypadEvents contract address for interacting with the deployed LilypadEvents contract
LilypadEventsUpgradeable bridge; // Instance of the LilypadEvents Contract to interact with
uint256 public lilypadFee; //=30000000000000000 on FVM;
constructor(address _bridgeContractAddress) {
bridgeAddress = _bridgeContractAddress; //the LilypadEvents contract address for your network
bridge = LilypadEventsUpgradeable(_bridgeContractAddress); //create an instance of the Events Contract to interact with
uint fee = bridge.getLilypadFee(); // you can fetch the fee amount required for the contract to run also
lilypadFee = fee;
}
function lilypadFulfilled(address _from, uint _jobId,
LilypadResultType _resultType, string calldata _result)
external override {
// Do something when the LilypadEvents contract returns
// results successfully
}
function lilypadCancelled(address _from, uint _jobId, string
calldata _errorMsg) external override {
// Do something if there's an error returned by the Lilypad Job
}
}
Call the LilypadEvents runLilypadJob function
Using the LilypadEvents Instance, we can now send jobs to the Bacalhau Network via our contract using the runLilypadJob() function.
In this example we'll use the Stable Diffusion Spec shown above in #add-a-spec-compatible-with-bacalhau
Note that calling the runLilypadJob() function requires a network fee. While the Bacalhau public Network is currently free to use, gas fees are still needed to return the results of the job performed. This is the payable fee in the contract.
// SPDX-License-Identifier: MIT
pragma solidity >=0.8.4;
import "https://github.com/bacalhau-project/lilypad/blob/main/hardhat/contracts/LilypadEventsUpgradeable.sol";
import "https://github.com/bacalhau-project/lilypad/blob/main/hardhat/contracts/LilypadCallerInterface.sol";
/** === User Contract Example === **/
contract MyContract is LilypadCallerInterface {
address public bridgeAddress; // Variable for interacting with the deployed LilypadEvents contract
LilypadEventsUpgradeable bridge;
uint256 public lilypadFee; //=30000000000000000;
constructor(address _bridgeContractAddress) {
bridgeAddress = _bridgeContractAddress;
bridge = LilypadEventsUpgradeable(_bridgeContractAddress);
uint fee = bridge.getLilypadFee(); // you can fetch the fee amount required for the contract to run also
lilypadFee = fee;
}
//** Define the Bacalhau Specification */
string constant specStart = '{'
'"Engine": "docker",'
'"Verifier": "noop",'
'"PublisherSpec": {"Type": "ipfs"},'
'"Docker": {'
'"Image": "ghcr.io/bacalhau-project/examples/stable-diffusion-gpu:0.0.1",'
'"Entrypoint": ["python"],
'"Parameters": ["main.py", "--o", "./outputs", "--p", "';
string constant specEnd =
'"]},'
'"Resources": {"GPU": "1"},'
'"Outputs": [{"Name": "outputs", "Path": "/outputs"}],'
'"Deal": {"Concurrency": 1}'
'}';
/** Call the runLilypadJob() to generate a stable diffusion image from a text prompt*/
function StableDiffusion(string calldata _prompt) external payable {
require(msg.value >= lilypadFee, "Not enough to run Lilypad job");
// TODO: spec -> do proper json encoding, look out for quotes in _prompt
string memory spec = string.concat(specStart, _prompt, specEnd);
uint id = bridge.runLilypadJob{value: lilypadFee}(address(this), spec, uint8(LilypadResultType.CID));
require(id > 0, "job didn't return a value");
prompts[id] = _prompt;
}
/** LilypadCaller Interface Implementation */
function lilypadFulfilled(address _from, uint _jobId,
LilypadResultType _resultType, string calldata _result)
external override {
// Do something when the LilypadEvents contract returns
// results successfully
}
function lilypadCancelled(address _from, uint _jobId, string
calldata _errorMsg) external override {
// Do something if there's an error returned by the
// LilypadEvents contract
}
}
description: Lilypad v0 Integrated Networks
Deployed Network Details
If you have a use case for another network - please get in touch with us!
The Lilypad Events contract - used for triggering compute jobs on Bacalhau, is currently integrated to the following networks on the address specified: