Description

The bacalhau agent alive command provides information about the agent's liveness and health. This is essential for monitoring and ensuring that the agent is active and functioning correctly.

Usage

bacalhau agent alive [flags]

Flags

• -h, --help:

  • Description: Displays help information for the alive sub-command.

• --output format:

  • Description: Determines the format in which the output is displayed. Available formats include JSON and YAML.

  • Options: json, yaml

  • Default: yaml

• --pretty:

  • Description: Formats the output for enhanced readability. This flag is relevant only when using JSON or YAML output formats.

Global Flags

• --api-host string:

  • Description: Specifies the host used for RESTful communication between the client and server. The flag is disregarded if the BACALHAU_API_HOST environment variable is set.

  • Default: bootstrap.production.bacalhau.org

• --api-port int:

  • Description: Specifies the port for REST communication. If the BACALHAU_API_PORT environment variable is set, this flag will be ignored.

  • Default: 1234

• --log-mode logging-mode:

  • Description: Sets the desired log format. Options are: default, station, json, combined, and event.

  • Default: default

• --repo string:

  • Description: Defines the path to the bacalhau repository.

  • Default: ``$HOME/.bacalhau`

Examples

Checking the Agent's Liveness and Health Info

1. Basic Usage:

   Command:

   Copy

   → bacalhau agent alive

   Output:

   Copy

   status: OK

2. Output in JSON format:

   Command:

   Copy

   → bacalhau agent alive --output json --pretty

   Output:

   Copy

   {
     "Status": "OK"
   }

Description

The bacalhau agent node command retrieves information about the agent's node, providing insights into the agent's environment and aiding in debugging.

Usage

bacalhau agent node [flags]

Flags

• -h, --help:

  • Displays help information for the node sub-command.

• --output format:

  • Defines the output format (either JSON or YAML).

  • Options: json, yaml

  • Default: yaml

• --pretty:

  • Beautifies the output when using JSON or YAML formats.

Global Flags

• --api-host string:

  • The host for REST communication. Overrides the BACALHAU_API_HOST environment variable.

  • Default: bootstrap.production.bacalhau.org

• --api-port int:

  • The port for REST communication. Overridden if BACALHAU_API_PORT environment variable is set.

  • Default: 1234

• --log-mode logging-mode:

  • Specifies the log format. Choices are: default, station, json, combined, event.

  • Default: default

• --repo string:

  • Path to the bacalhau repository.

  • Default: ``$HOME/.bacalhau`

Examples

1. Retrieve Node Information in Default Format (YAML)

   Copy

   bacalhau agent node

2. Retrieve Node Information in JSON Format

   Copy

   bacalhau agent node --output json

3. Retrieve Node Information in Pretty-printed JSON Format

   Copy

   bacalhau agent node --output json --pretty

The bacalhau agent version command is used to obtain the version of the bacalhau agent.

Description:

Using this command, users can quickly retrieve the version of the agent, allowing them to confirm the specific release of the software they are using.

Usage:

bacalhau agent version [flags]

Flags:

• -h, --help:

  • Show help for the version command.

• --output format:

  • Defines the output format of the command's results. Accepted formats include "json" and "yaml".

• --pretty:

  • Used for pretty printing the output, enhancing readability. This flag is applicable only for the "json" and "yaml" output formats.

Global Flags:

• --api-host string:

  • Designates the host for client-server communication via REST. If the BACALHAU_API_HOST environment variable is present, this flag will be disregarded.

  • Default: "bootstrap.production.bacalhau.org"

• --api-port int:

  • Defines the port for client-server communication through REST. This flag becomes irrelevant if the BACALHAU_API_PORT environment variable is specified.

  • Default: 1234

• --log-mode logging-mode:

  • Specifies the desired logging format.

  • Options: 'default','station','json','combined','event'

  • Default: 'default'

• --repo string:

  • Indicates the path to the bacalhau repository.

  • Default: "$HOME/.bacalhau"`

Examples

1. Retrieve the agent version:

   Execute the command to get the agent version:

   Copy

   bacalhau agent version

   Expected output:

   Copy

   Bacalhau v0.0.0-xxxxxxx
   BuildDate 2023-09-22 16:03:44 +0000 UTC
   GitCommit 0fe81cb488f666845ac72c73a4b804aaa658e511

2. Retrieve the agent version in JSON format:

   Copy

   bacalhau agent version --output json

   Expected output:

   Copy

   {"major":"0","minor":"0","gitversion":"v0.0.0-xxxxxxx","gitcommit":"0fe81cb488f666845ac72c73a4b804aaa658e511","builddate":"2023-09-22T16:03:44Z","goos":"linux","goarch":"amd64"}

3. Retrieve the agent version in Pretty-printed JSON format:

   Copy

   bacalhau agent version --output json --pretty

   Expected output:

   Copy

   {
     "major": "0",
     "minor": "0",
     "gitversion": "v0.0.0-xxxxxxx",
     "gitcommit": "0fe81cb488f666845ac72c73a4b804aaa658e511",
     "builddate": "2023-09-22T16:03:44Z",
     "goos": "linux",
     "goarch": "amd64"
   }

Description

The bacalhau config command is a parent command that offers sub-commands to modify and query information about the Bacalhau config. This can be useful for debugging, monitoring, or managing the nodes configuration.

Usage

Available Commands

1. :

   • Description: Lists the configuration keys and values of the bacalhau node. This command is useful for understanding how configuration keys map to their respective values, aiding in the use of the bacalhau config set command.

   • Usage:

2. :

   • Description: Sets a value in the bacalhau node's configuration file. This command is used to modify the configuration file that the bacalhau node will reference for its settings.

   • Usage:

3. :

   • Description: Prints the default configuration of a bacalhau node to the standard output (stdout). This command is beneficial for viewing the baseline settings a bacalhau node will use before any user-defined configuration changes are applied.

   • Usage:

4. :

   • Description: Automatically sets compute resource values in the bacalhau node's configuration file based on the hardware resources of the user's machine. This command simplifies the process of allocating resources for jobs by dynamically adjusting the settings to match the machine's capabilities.

   • Usage:

Description

The bacalhau agent command is a parent command that offers sub-commands to query information about the Bacalhau agent. This can be useful for debugging, monitoring, or managing the agent's behavior and health.

Usage

bacalhau agent [command]

Available Commands

1. alive:

   • Description: Retrieves the agent's liveness and health information. This can be helpful to determine if the agent is running and healthy.

   • Usage:

     Copy

     bacalhau agent alive

2. node:

   • Description: Gathers the agent's node-related information. This might include details about the machine or environment where the agent is running, available resources, supported engines, etc.

   • Usage:

     Copy

     bacalhau agent node

3. version:

   • Description: Retrieves the Bacalhau version of the agent. This can be beneficial for ensuring compatibility or checking for updates.

   • Usage:

     Copy

     bacalhau agent version

For more detailed information on any of the sub-commands, you can use the command:

bacalhau agent [command] --help

Flags

• -h, --help:

  • Description: Displays help information for the agent command.

Global Flags

• --api-host string:

  • Description: Specifies the host used for RESTful communication between the client and server. The flag is disregarded if the BACALHAU_API_HOST environment variable is set.

  • Default: bootstrap.production.bacalhau.org

• --api-port int:

  • Description: Specifies the port for REST communication. If the BACALHAU_API_PORT environment variable is set, this flag will be ignored.

  • Default: 1234

• --log-mode logging-mode:

  • Description: Sets the desired log format. Options are: default, station, json, combined, and event.

  • Default: default

• --repo string:

  • Description: Defines the path to the bacalhau repository.

  • Default: ``$HOME/.bacalhau`

Description:

The bacalhau config default command prints the default configuration of a bacalhau node to the standard output (stdout). This command is advantageous for users to view the baseline settings a bacalhau node will use in the absence of any user-defined configuration changes. It provides a clear view of the default operational parameters of the node, aiding users in understanding and customizing their configuration from a known baseline.

Note: The output of this command shows the initial default settings for a new bacalhau node and is useful for understanding the foundational settings for customization. To apply these default settings, you can redirect the output to your configuration file using bacalhau config default > ~/.bacalhau/config.yaml, which overwrites your current configuration file with the default settings. However, if you wish to always use the latest default settings, especially if the defaults are updated over time, consider deleting your existing configuration file (e.g., ~/.bacalhau/config.yaml). This approach ensures that your bacalhau node uses the most current defaults, circumventing potential discrepancies between the latest defaults and those captured in an older configuration file created with bacalhau config default.

Usage

bacalhau config default

Flags

• -h, --help:

  • Description: Displays help information for the list sub-command.

• --path:

  • Description: Sets path dependent config fields

  • Default: $HOME/.bacalhau

Examples

Redirecting Default Configuration to a File

bacalhau config default > ~/.bacalhau/config.yaml
# This command redirects the default configuration output directly into the bacalhau configuration file at ~/.bacalhau/config.yaml, effectively resetting it to default settings.

Description

The bacalhau config list command lists the configuration keys and values of the bacalhau node. This command is useful for understanding how configuration keys map to their respective values, aiding in the use of the bacalhau config set command.

Note: Configuration values displayed by this command represent the settings that will be applied when the bacalhau node is next restarted. It is important to note that these values may not reflect the current operational configuration of an active bacalhau node. The displayed configuration is relevant and accurate for a node that is either not currently running or that has been restarted after the execution of this command.

Usage

bacalhau config list [flags]

Flags

• -h, --help:

  • Description: Displays help information for the list sub-command.

• --hide-header:

  • Description: Do not print the column headers when displaying the results.

  • Default: false

• --no-style:

  • Description: Removes all styling from the table output, displaying raw data.

  • Default: false

• --output format:

  • Description: Determines the format in which the output is displayed. Available formats include Table, JSON, and YAML.

  • Options: json, yaml, table

  • Default: table

• --pretty:

  • Description: Formats the output for enhanced readability. This flag is relevant only when using JSON or YAML output formats.

  • Default: true

• --wide:

  • Description: Prints full values in the table results without truncating any information.

  • Default: false

Examples

Listing the Bacalhau nodes configuration settings

1. Basic Usage:

   Command:

   Copy

   bacalhau config list

   Output:

   Copy

    KEY          VALUE
    <key_name> <key_value>
   ...

2. Output in JSON format:

   Command:

   Copy

   bacalhau config list --output json --pretty

   Output:

   Copy

   [
     {
       "Key": "<key_name>",
       "Value": <key_value>
     },
     ...
   ]

Description:

The bacalhau config set command sets a value in the bacalhau node's configuration file. This command is used to modify the configuration file that the bacalhau node will reference for its settings. Key names in the configuration are case-insensitive. Additionally, the command validates the value being set based on the type of the configuration key, ensuring that only appropriate and valid configurations are applied.

Note: Changes made using this command will be applied to the configuration file, but they do not immediately affect the running configuration of an active bacalhau node. The modifications will take effect only after the node is restarted.

Usage

bacalhau config set <key> <value>

Flags

• -h, --help:

  • Description: Displays help information for the set sub-command.

Examples

Configuring the Server API Port Value

bacalhau config set node.serverapi.port 9999

bacalhau config list | grep serverapi.port
 node.serverapi.port                                             9999

cat ~/.bacalhau/config.yaml
node:
    serverapi:
        port: 9999

Configuring the Logging Mode Value

bacalhau config set node.loggingmode json

bacalhau config list | grep loggingmode
 node.loggingmode                                                json

cat ~/.bacalhau/config.yaml
node:
    loggingmode: json

Multiple Set commands append to the file

bacalhau config set node.serverapi.port 9999
bacalhau config set node.serverapi.host 0.0.0.0
bacalhau config set node.loggingmode json

cat ~/.bacalhau/config.yaml
node:
    loggingmode: json
    serverapi:
        host: 0.0.0.0
        port: 9999

Set command value validation

Example of invalid logging mode value

bacalhau config set node.loggingmode some-invalid-value

Error: setting "node.loggingmode": "some-invalid-value" is an invalid log-mode (valid modes: ["default" "station" "json" "combined" "event"])

Example of invalid time duration value

bacalhau config set node.volumesizerequesttimeout 10days

Error: setting "node.volumesizerequesttimeout": time: unknown unit "days" in duration "10days"

Description:

The bacalhau config auto-resources command automatically configures compute resource values in the bacalhau node's configuration file based on the hardware resources of the user's machine. This command streamlines the process of resource allocation for jobs, dynamically adjusting settings to align with the capabilities of the machine. It is designed to simplify the task of resource management, ensuring that the node operates efficiently and effectively within the hardware's limits.

Note: The bacalhau config auto-resources command intelligently adjusts resource allocation settings based on the specific hardware configuration of your machine, promoting optimal utilization for bacalhau jobs. Due to the dynamic nature of this command, the specific values set in the configuration will vary depending on the available hardware resources of the machine in use. This functionality is particularly beneficial for users who seek to optimize their node's performance without the need for manual calculations of resource limits. It is important for users to understand that these settings will directly impact the number and types of jobs their node can manage at any given time, based on the machine's resource capacity.

Usage

bacalhau config auto-resources [flags]

Flags

• --default-job-percentage int:

  • Description: Sets the default percentage of resources allocated for each job when specific limits are not defined. Acceptable values range from 1 to 100 (values over 100 are rejected).

  • Default: 75

• --job-percentage int:

  • Description: Determines the percentage of resources that can be utilized at one time for a single job. Accept values from 1 to 100 (values over 100 are rejected).

  • Default: 75

• --queue-job-percentage int:

  • Description: Specifies the total percentage of resources that the system can allocate for all jobs queued at one time. Accept values from 1 to 100 (values over 100 are accepted).

  • Default: 150

• --total-percentage int:

  • Description: Indicates the total percentage of resources that the system can utilize at one time across all jobs. Accept values from 1 to 100 (values over 100 are rejected).

  • Default: 75

Examples

(Ran on an Apple M1 Max with 10 Cores and 64GB RAM)

1. Basic Usage:

   Command:

   Copy

   bacalhau config auto-resources

   Config File:

   Copy

   node:
       compute:
           capacity:
               defaultjobresourcelimits:
                   cpu: 7500m
                   disk: 568 GB
                   gpu: "0"
                   memory: 52 GB
               jobresourcelimits:
                   cpu: 7500m
                   disk: 568 GB
                   gpu: "0"
                   memory: 52 GB
               queueresourcelimits:
                   cpu: 15000m
                   disk: 1.1 TB
                   gpu: "0"
                   memory: 103 GB
               totalresourcelimits:
                   cpu: 7500m
                   disk: 568 GB
                   gpu: "0"
                   memory: 52 GB

2. Queue 500% system resources:

   Command:

   Copy

   bacalhau config auto-resources --queue-job-percentage=500

   Config File:

   Copy

   node:
       compute:
           capacity:
               defaultjobresourcelimits:
                   cpu: 7500m
                   disk: 568 GB
                   gpu: "0"
                   memory: 52 GB
               jobresourcelimits:
                   cpu: 7500m
                   disk: 568 GB
                   gpu: "0"
                   memory: 52 GB
               queueresourcelimits:
                   cpu: 50000m
                   disk: 3.8 TB
                   gpu: "0"
                   memory: 344 GB
               totalresourcelimits:
                   cpu: 7500m
                   disk: 568 GB
                   gpu: "0"
                   memory: 52 GB

3. With 25% of system resources:

   Command:

   Copy

   bacalhau config auto-resources  --total-percentage=25 --job-percentage=25 --default-job-percentage=25

   Config File:

   Copy

   node:
       compute:
           capacity:
               defaultjobresourcelimits:
                   cpu: 2500m
                   disk: 190 GB
                   gpu: "0"
                   memory: 17 GB
               jobresourcelimits:
                   cpu: 2500m
                   disk: 190 GB
                   gpu: "0"
                   memory: 17 GB
               queueresourcelimits:
                   cpu: 15000m
                   disk: 1.1 TB
                   gpu: "0"
                   memory: 103 GB
               totalresourcelimits:
                   cpu: 2500m
                   disk: 190 GB
                   gpu: "0"
                   memory: 17 GB

Description

The bacalhau job command provides a suite of sub-commands to submit, query, and manage jobs within Bacalhau. Users can deploy jobs, obtain job details, track execution logs, and more.

Usage

Available Commands

1. :

   • Description: Retrieves detailed information of a job using its ID.

   • Usage:

2. :

   • Description: Lists all executions associated with a job, identified by its ID.

   • Usage:

3. :

   • Description: Enumerates the historical events related to a job, identified by its ID.

   • Usage:

4. :

   • Description: Provides an overview of all submitted jobs.

   • Usage:

5. :

   • Description: Fetches and streams the logs from a currently executing job.

   • Usage:

6. :

   • Description: Submits a job for execution using either a JSON or YAML configuration file.

   • Usage:

7. :

   • Description: Halts a previously submitted job.

   • Usage:

For comprehensive details on any of the sub-commands, run:

Flags

• -h, --help:

  • Description: Shows the help information for the job command.

Global Flags

1. --api-host string:

   • Description: Determines the host for RESTful communication between the client and server. This flag is overlooked if the BACALHAU_API_HOST environment variable is set.

   • Default: bootstrap.production.bacalhau.org

2. --api-port int:

   • Description: Designates the port for RESTful communication. This flag is bypassed if the BACALHAU_API_PORT environment variable is active.

   • Default: 1234

3. --log-mode logging-mode:

   • Description: Chooses the preferred log format. Available choices are: default, station, json, combined, and event.

   • Default: default

4. --repo string:

   • Description: Specifies the path to the bacalhau repository.

   • Default: $HOME/.bacalhau

Description

The bacalhau job describe command provides a detailed description of a specific job in YAML format. This description can be particularly useful when wanting to understand the attributes and current status of a specific job. To list all available jobs, the bacalhau job list command can be used.

Usage

Flags

• -h, --help:

  • Description: Display help for the describe command.

• --output format:

  • Description: Specifies the desired output format for the command. Supported values are json and yaml.

  • Default: yaml

• --pretty:

  • Description: Pretty prints the output. This option is applicable only to json and yaml output formats.

Global Flags

• --api-host string:

  • Description: Specifies the host for the client and server to communicate through via REST. If the BACALHAU_API_HOST environment variable is set, this flag will be ignored.

  • Default: bootstrap.production.bacalhau.org

• --api-port int:

  • Description: Determines the port for the client and server to communicate on using REST. If the BACALHAU_API_PORT environment variable is set, this flag will be ignored.

  • Default: 1234

• --log-mode logging-mode:

  • Description: Specifies the desired log format. Supported values include default, station, json, combined, and event.

  • Default: default

• --repo string:

  • Description: Defines the path to the bacalhau repository.

  • Default: $HOME/.bacalhau

Examples

1. Describe a Job with Full ID:
2. Describe a Job with Shortened ID:
3. Describe a Job with JSON Output:

Description

The bacalhau job list command provides a listing of all submitted jobs. This command offers an overview of all tasks and processes registered in the system, allowing users to monitor and manage their jobs effectively.

Usage

Flags

• -h, --help:

  • Description: Display help for the list command.

• --hide-header:

  • Description: Opts out of printing the column headers in the results.

• --labels string:

  • Description: Filters jobs by labels. It's designed to function similar to Kubernetes label selectors.

  • Default: bacalhau_canary != true

• --limit uint32:

  • Description: Limits the number of results returned.

  • Default: 10

• --next-token string:

  • Description: Uses the provided token for pagination.

• --no-style:

  • Description: Strips all styling from the table output.

• --order-by string:

  • Description: Organizes results based on a chosen field. Valid fields are id and created_at.

• --order-reversed:

  • Description: Reverses the order of the displayed results.

• --output format:

  • Description: Dictates the desired output format for the command. Options are table, csv, json, and yaml.

  • Default: table

• --pretty:

  • Description: Offers a more visually pleasing output for json and yaml formats.

• --wide:

  • Description: Presents full values in the table results, preventing truncation.

Global Flags

• --api-host string:

  • Description: Defines the host for client-server communication via REST. Overridden by the BACALHAU_API_HOST environment variable, if set.

  • Default: bootstrap.production.bacalhau.org

• --api-port int:

  • Description: Sets the port for RESTful communication between the client and server. The BACALHAU_API_PORT environment variable takes precedence if set.

  • Default: 1234

• --log-mode logging-mode:

  • Description: Designates the desired log format. Options include default, station, json, combined, and event.

  • Default: default

• --repo string:

  • Description: Points to the bacalhau repository location.

  • Default: $HOME/.bacalhau

Examples

1. List all jobs:

   Execute the command to list all the jobs:

   Expected output:
2. Limit the list to the last two jobs:

   Limit the list to display only the last two jobs:

   Expected output:
3. Order the list by creation date in descending order:

   Order the jobs by their creation date in a descending manner:

   Expected output:
4. Filter the jobs by specific labels:

   Display jobs that have specific labels:

   Expected output:
5. Display the list in JSON format with pretty printing:

   Get a limited list of jobs in a formatted JSON output:

   Expected output:

Description

The bacalhau job executions command retrieves a list of executions for a specific job based on its ID. This can be essential when tracking the various runs and their respective states for a particular job.

Usage

Flags

• -h, --help:

  • Description: Display help for the executions command.

• --hide-header:

  • Description: Do not print the column headers when displaying the results.

• --limit uint32:

  • Description: Restricts the number of results returned.

  • Default: 20

• --next-token string:

  • Description: Uses the specified token for pagination. Useful for fetching the next set of results.

• --no-style:

  • Description: Removes all styling from the table output, displaying raw data.

• --order-by string:

  • Description: Orders results based on a specific field. Valid fields are: modify_time, create_time, id, and state.

• --order-reversed:

  • Description: Reverses the order of the results. Useful in conjunction with --order-by.

• --output format:

  • Description: Specifies the desired output format for the command. Supported values are table, csv, json, and yaml.

  • Default: table

• --pretty:

  • Description: Pretty prints the output. This option is applicable only to json and yaml output formats.

• --wide:

  • Description: Prints full values in the table results without truncating any information.

Global Flags

• --api-host string:

  • Description: Specifies the host for the client and server to communicate through via REST. If the BACALHAU_API_HOST environment variable is set, this flag will be ignored.

  • Default: bootstrap.production.bacalhau.org

• --api-port int:

  • Description: Determines the port for the client and server to communicate on using REST. If the BACALHAU_API_PORT environment variable is set, this flag will be ignored.

  • Default: 1234

• --log-mode logging-mode:

  • Description: Specifies the desired log format. Supported values include default, station, json, combined, and event.

  • Default: default

• --repo string:

  • Description: Defines the path to the bacalhau repository.

  • Default: $HOME/.bacalhau

Examples

1. List executions for a specific Job:

   Expected output:
2. Order executions by state for a specific job:

   Execute the command:

   Expected output:
3. List executions with YAML output:

   Expected output:

Description

The bacalhau job history command lists the history events of a specific job based on its ID. This feature allows users to track changes, executions, and other significant milestones associated with a particular job.

Usage

Flags

• --event-type string:

  • Description: Specifies the type of history events to retrieve. Available options include all, job, and execution.

  • Default: all

• --execution-id string:

  • Description: Filters results by a specific execution ID.

• -h, --help:

  • Description: Display help for the history command.

• --hide-header:

  • Description: Opts out of printing the column headers in the results.

• --limit uint32:

  • Description: Limits the number of results returned.

• --next-token string:

  • Description: Uses the provided token for pagination.

• --no-style:

  • Description: Strips all styling from the table output.

• --node-id string:

  • Description: Filters the results by a specific node ID.

• --order-by string:

  • Description: Organizes results based on a chosen field.

• --order-reversed:

  • Description: Reverses the order of the displayed results.

• --output format:

  • Description: Dictates the desired output format for the command. Options are table, csv, json, and yaml.

  • Default: table

• --pretty:

  • Description: Offers a more visually pleasing output for json and yaml formats.

• --wide:

  • Description: Presents full values in the table results, preventing truncation.

Global Flags

• --api-host string:

  • Description: Defines the host for client-server communication via REST. Overridden by the BACALHAU_API_HOST environment variable, if set.

  • Default: bootstrap.production.bacalhau.org

• --api-port int:

  • Description: Sets the port for RESTful communication between the client and server. The BACALHAU_API_PORT environment variable takes precedence if set.

  • Default: 1234

• --log-mode logging-mode:

  • Description: Designates the desired log format. Options include default, station, json, combined, and event.

  • Default: default

• --repo string:

  • Description: Points to the bacalhau repository location.

  • Default: $HOME/.bacalhau

Examples

1. Retrieve the history of a specific job:

   Execute the command to get the job history:

   Expected output:
2. Filter the history by event type:

   Filter the job history by the event type:

   Expected output:
3. Filter the history by execution ID:

   Filter the job history by a specific execution ID:

   Expected output:
4. Retrieve the history in YAML format:

   Get the job history in YAML format:

   Expected output:

Description

The bacalhau exec command allows for the specification of jobs to be executed from the command line, without the need for a job specification file (see ).

Usage

Flags

1. -h, --help:

   • Description: Displays help information for the exec sub-command.

2. --code:

   • Includes the specified code in the job. This can be a single file, or a directory containing many files. There is a limit of 10Mb on the size of the uploaded code.

3. -f, --follow:

   • Description: If provided, the command will continuously display the output from the job as it runs.

4. --wait

   • Description: Wait for the job to finish. Use --wait=false to return as soon as the job is submitted.

5. --wait-timeout-secs

   • Description: When using --wait, how many seconds to wait for the job to complete before giving up.

6. --node-details

   • Description: Print out details of all nodes (overridden by --id-only).

7. --id-only:

   • Description: On successful job submission, only the Job ID will be printed.

8. -p, --publisher

   • Description: Where to publish the result of the job.

     Examples:

     Publish to IPFS

     -p ipfs

     Publish to S3

     -p s3://bucket/key

9. -i, --input

   • Description: Mount URIs as inputs to the job. Can be specified multiple times. Format: src=URI,dst=PATH[,opt=key=value]

     Examples:

     Mount IPFS CID to /inputs directory

     -i ipfs://QmeZRGhe4PmjctYVSVHuEiA9oSXnqmYa4kQubSHgWbjv72

     Mount S3 object to a specific path

     -i s3://bucket/key,dst=/my/input/path

     Mount S3 object with specific endpoint and region

     -i src=s3://bucket/key,dst=/my/input/path,opt=endpoint=https://s3.example.com,opt=region=us-east-1

10. -o, --output

    • Description: name:path of the output data volumes. 'outputs:/outputs' is always added unless '/outputs' is mapped to a different name.

11. -e, --env

    • Description: The environment variables to supply to the job (e.g. --env FOO=bar --env BAR=baz)

12. --timeout

    • Description: Job execution timeout in seconds (e.g. 300 for 5 minutes)

13. -l, --labels

    • Description: List of labels for the job. Enter multiple in the format '-l a -l 2'. All characters not matching /a-zA-Z0-9_:|-/ and all emojis will be stripped.

14. -s, --selector

    • Description: Selector (label query) to filter nodes on which this job can be executed, supports '=', '==', and '!='.(e.g. -s key1=value1,key2=value2). Matching objects must satisfy all of the specified label constraints.

Global Flags

1. --api-host string:

   • Description: Specifies the host used for RESTful communication between the client and server. The flag is disregarded if the BACALHAU_API_HOST environment variable is set.

   • Default: bootstrap.production.bacalhau.org

2. --api-port int:

   • Description: Specifies the port for REST communication. If the BACALHAU_API_PORT environment variable is set, this flag will be ignored.

   • Default: 1234

3. --log-mode logging-mode:

   • Description: Sets the desired log format. Options are: default, station, json, combined, and event.

   • Default: default

4. --repo string:

   • Description: Defines the path to the bacalhau repository.

   • Default: ``$HOME/.bacalhau`

Examples

Running python tasks

1. Basic Usage:

   Command:

   Output:
2. Single file Python:

   Command:

   where app.py is

   Output:

   As red text

Running duckdb queries

1. Basic Usage:

   Command:

   Output:

The bacalhau node approve command offers administrators the ability to approve the cluster membership for a node using its name.

Description:

Using the approve sub-command under the bacalhau node umbrella, users can allow a node in the pending state to join the cluster and receive work. This feature is crucial for system administrators to manage the cluster.

Usage:

bacalhau node approve [id] [flags]

Flags:

• [id]:

  • The unique identifier of the node you wish to describe.

• -h, --help:

  • Displays the help documentation for the describe command.

• -m message:

  • A message to be attached to the approval action.

Global Flags:

• --api-host string:

  • Specifies the host for client-server communication through REST. This flag is overridden if the BACALHAU_API_HOST environment variable is set.

  • Default: "bootstrap.production.bacalhau.org"

• --api-port int:

  • Designates the port for REST-based communication between client and server. This flag is overlooked if the BACALHAU_API_PORT environment variable is defined.

  • Default: 1234

• --log-mode logging-mode:

  • Determines the log format preference.

  • Options: 'default','station','json','combined','event'

  • Default: 'default'

• --repo string:

  • Points to the bacalhau repository's path.

  • Default: "$HOME/.bacalhau"`

Examples:

1. Approve a Node with ID nodeID123:

   Copy

   bacalhau node approve nodeID123

2. Approve a Node with an audit message:

   Copy

   bacalhau node approve nodeID123 -m "okay"

The bacalhau node delete command offers administrators the ability to remove a node from the cluster using its name.

Description:

Using the delete sub-command, administrators can remove a node from the list of available compute nodes in the cluster. This feature is necessary for the management of the infrastructure.

Usage:

bacalhau node delete [id] [flags]

Flags:

• [id]:

  • The unique identifier of the node you wish to describe.

• -h, --help:

  • Displays the help documentation for the describe command.

• -m message:

  • A message to be attached to the deletion action.

Global Flags:

• --api-host string:

  • Specifies the host for client-server communication through REST. This flag is overridden if the BACALHAU_API_HOST environment variable is set.

  • Default: "bootstrap.production.bacalhau.org"

• --api-port int:

  • Designates the port for REST-based communication between client and server. This flag is overlooked if the BACALHAU_API_PORT environment variable is defined.

  • Default: 1234

• --log-mode logging-mode:

  • Determines the log format preference.

  • Options: 'default','station','json','combined','event'

  • Default: 'default'

• --repo string:

  • Points to the bacalhau repository's path.

  • Default: "$HOME/.bacalhau"`

Examples:

1. Delete the Node with ID nodeID123:

   Copy

   bacalhau node delete nodeID123

2. Delete a Node with an audit message:

   Copy

   bacalhau node delete nodeID123 -m "bad actor"

Description

The bacalhau job stop command allows users to terminate a previously submitted job. This is useful in scenarios where there's a need to halt a running job, perhaps due to misconfiguration or changed priorities.

Usage

bacalhau job stop [id] [flags]

Flags

• --quiet:

  • Description: If provided, the command will not display any output, neither to the standard output (stdout) nor to the standard error (stderr).

• -h, --help:

  • Description: Displays help information for the stop command.

Global Flags

• --api-host string:

  • Description: Specifies the host used for RESTful communication between the client and server. The flag is disregarded if BACALHAU_API_HOST environment variable is set.

  • Default: bootstrap.production.bacalhau.org

• --api-port int:

  • Description: Determines the port for REST communication. If BACALHAU_API_PORT environment variable is set, this flag will be ignored.

  • Default: 1234

• --log-mode logging-mode:

  • Description: Selects the desired log format. Options include: default, station, json, combined, and event.

  • Default: default

• --repo string:

  • Description: Defines the path to the bacalhau repository.

  • Default: $HOME/.bacalhau

Examples

1. Stop a Specific Job:

   If you wish to halt the execution of a job, you can utilize the stop command. Here's how you can achieve that:

   Command:

   Copy

   bacalhau job stop j-10eb97de-14cd-4db4-96ec-561bb943309a

   Expected Output:

   Copy

   Checking job status
   
   	Connecting to network  ................  done ✅  0.0s
   	  Verifying job state  ................  done ✅  0.2s
   	          Stopping job ................  done ✅  0.1s
   
   Job stop successfully submitted with evaluation ID: 397fd425-8b1a-491e-952a-0632492e7ece

2. Silently Stop a Job:

   If you prefer to terminate a job without seeing any verbose feedback or messages, the --quiet option can be used.

   Command:

   Copy

   bacalhau job stop j-63b5ec0c-b5bf-4398-a152-b46c07abe52a --quiet

   Expected Output:

   Copy

   [No output displayed as the operation is run quietly.]

Description

The bacalhau job logs command allows users to retrieve logs from a job that has been previously submitted. This command is useful for tracking and debugging the progress and state of a running or completed job.

Usage

bacalhau job logs [id] [flags]

Flags

1. -f, --follow:

   • Description: This flag allows the user to follow the logs in real-time after fetching the current logs. It provides a continuous stream of log updates, similar to tail -f in Unix-like systems.

2. -h, --help:

   • Description: Display help information for the logs command.

Global Flags

1. --api-host string:

   • Description: Specifies the host for the client and server to communicate through REST. This flag is disregarded if the BACALHAU_API_HOST environment variable is set.

   • Default: bootstrap.production.bacalhau.org

2. --api-port int:

   • Description: Sets the port for RESTful communication between the client and server. If the BACALHAU_API_PORT environment variable is available, this flag is ignored.

   • Default: 1234

3. --log-mode logging-mode:

   • Description: Determines the desired log format. Available options include default, station, json, combined, and event.

   • Default: default

4. --repo string:

   • Description: Specifies the path to the bacalhau repository.

   • Default: $HOME/.bacalhau

Examples

1. Display Logs for a Previously Submitted Job with Full ID:

   Command:

   Copy

   bacalhau job logs j-51225160-807e-48b8-88c9-28311c7899e1

   Expected Output:

   Copy

   [2023-09-24 09:01:32] INFO - Application started successfully.
   [2023-09-24 09:01:33] DEBUG - Initializing database connections.
   [2023-09-24 09:01:35] WARN - API rate limit approaching.
   [2023-09-24 09:02:01] ERROR - Failed to retrieve data from endpoint: /api/v1/data.
   [2023-09-24 09:05:00] INFO - Data sync completed with 4500 new records.

2. Follow Logs in Real-Time:

   Command:

   Copy

   bacalhau job logs --follow j-51225160-807e-48b8-88c9-28311c7899e1

   Expected Output:

   Copy

   [2023-09-24 11:30:02] INFO - User 'john_doe' logged in successfully.
   [2023-09-24 11:30:15] DEBUG - Fetching data from cache for key: userSettings_john_doe.
   [2023-09-24 11:31:05] WARN - High memory usage detected: 85% of allocated resources.
   ... [Logs continue to appear in real-time] ...

3. Display Logs Using a Shortened ID:

   Command:

   Copy

   bacalhau job logs j-ebd9bf2f

   Expected Output:

   Copy

   [2023-09-24 10:15:12] INFO - Application initialization sequence started.
   [2023-09-24 10:15:13] DEBUG - Loading configurations from /config/app.json.
   [2023-09-24 10:15:14] INFO - Connected to message broker successfully.
   [2023-09-24 10:16:00] ERROR - Failed to send email notification to user@example.com.

Description

The bacalhau node command provides a set of sub-commands to query and manage node-related information within Bacalhau. With these tools, users can access specific details about nodes, list all network nodes, and more.

Usage

bacalhau node [command]

Available Commands

1. approve:

   • Description: Approves a single node to join the cluster.

   • Usage:

     Copy

     bacalhau node approve

2. delete:

   • Description: Deletes a node from the cluster using its ID.

   • Usage:

     Copy

     bacalhau node delete

3. describe:

   • Description: Retrieves detailed information of a node using its ID.

   • Usage:

     Copy

     bacalhau node describe

4. list:

   • Description: Lists the details of all nodes present in the network.

   • Usage:

     Copy

     bacalhau node list

5. reject:

• Description: Reject a specific node's request to join the cluster.

• Usage:

  Copy

  bacalhau node reject

For comprehensive details on any of the sub-commands, run:

bacalhau node [command] --help

Flags

• -h, --help:

  • Description: Shows the help information for the node command.

Global Flags

• --api-host string:

  • Description: Specifies the host for RESTful communication between the client and server. The flag will be ignored if the BACALHAU_API_HOST environment variable is set.

  • Default: bootstrap.production.bacalhau.org

• --api-port int:

  • Description: Designates the port for RESTful communication. The flag will be bypassed if the BACALHAU_API_PORT environment variable is active.

  • Default: 1234

• --log-mode logging-mode:

  • Description: Chooses the preferred log format. Available choices are: default, station, json, combined, and event.

  • Default: default

• --repo string:

  • Description: Specifies the path to the bacalhau repository.

  • Default: /Users/walid/.bacalhau

Description

The bacalhau job run command facilitates the initiation of a job from a file or directly from the standard input (stdin). The command supports both JSON and YAML data formats. This command is particularly useful for quickly executing a job without the need for manual configurations.

Usage

bacalhau job run [flags]

Flags

• --dry-run:

  • Description: With this flag, the job will not be submitted. Instead, it will display what would have been submitted, providing a way to preview before actual submission.

• -f, --follow:

  • Description: If provided, the command will continuously display the output from the job as it runs.

• --id-only:

  • Description: On successful job submission, only the Job ID will be printed.

• --no-template:

  • Disable the templating feature. When this flag is set, the job spec will be used as-is, without any placeholder replacements

• --node-details:

  • Description: Displays details of all nodes. Note that this flag is overridden if --id-only is provided.

• --show-warnings:

  • Description: Shows any warnings that occur during the job submission.

• -E, --template-envs:

  • Specify a regular expression pattern for selecting environment variables to be included as template variables in the job spec. e.g. --template-envs ".*" will include all environment variables.

• -V, --template-vars:

  • Replace a placeholder in the job spec with a value. e.g. --template-vars foo=bar

• --wait:

  • Description: Waits for the job to finish execution. To set this to false, use --wait=false

  • Default: true

• --wait-timeout-secs int:

  • Description: If --wait is provided, this flag sets the maximum time (in seconds) the command will wait for the job to finish before it terminates.

  • Default: 600 seconds

• -h, --help:

  • Description: Displays help information for the run command.

Global Flags

• --api-host string:

  • Description: Specifies the host used for RESTful communication between the client and server. The flag is disregarded if BACALHAU_API_HOST environment variable is set.

  • Default: bootstrap.production.bacalhau.org

• --api-port int:

  • Description: Determines the port for REST communication. If BACALHAU_API_PORT environment variable is set, this flag will be ignored.

  • Default: 1234

• --log-mode logging-mode:

  • Description: Selects the desired log format. Options include: default, station, json, combined, and event.

  • Default: default

• --repo string:

  • Description: Defines the path to the bacalhau repository.

  • Default: $HOME/.bacalhau

Examples

Sample Job (job.yaml)

A sample job used in the following examples is provided below:

cat job.yaml

name: A Simple Docker Job
type: batch
count: 1
tasks:
  - name: My main task
    engine:
      type: docker
      params:
        Image: ubuntu:latest
        Entrypoint:
          - /bin/bash
        Parameters:
          - -c
          - echo Hello Bacalhau!

This configuration describes a batch job that runs a Docker task. It utilizes the ubuntu:latest image and executes the command echo Hello Bacalhau!.

1. Running a Job using a YAML Configuration:

   To run a job with a configuration provided in a job.yaml file:

   Command:

   Copy

   bacalhau job run job.yaml

   Expected Output:

   Copy

   Job successfully submitted. Job ID: j-2d0f513a-9eb1-49c2-8bc8-246c6fb41520
   Checking job status... (Enter Ctrl+C to exit at any time, your job will continue running):
   
    Communicating with the network  ................  done ✅  0.1s
       Creating job for submission  ................  done ✅  0.6s
   
   To get more details about the run, execute:
    bacalhau job describe j-2d0f513a-9eb1-49c2-8bc8-246c6fb41520
   
   To get more details about the run executions, execute:
    bacalhau job executions j-2d0f513a-9eb1-49c2-8bc8-246c6fb41520

2. Running a Job and Following its Logs:

   Command:

   Copy

   bacalhau job run job.yaml --follow

   Expected Output:

   Copy

   Job successfully submitted. Job ID: j-b89df816-7564-4f04-b270-e6cda89eda72
   Waiting for logs... (Enter Ctrl+C to exit at any time, your job will continue running):
   
   Hello Bacalhau!

3. Running a Job Without Waiting:

   Command:

   Copy

   bacalhau job run job.yaml --wait=false

   Expected Output:

   Copy

   j-3fd396b3-e92e-42ca-bd87-0dc9eb15e6f9

4. Fetching Only the Job ID Upon Submission:

   Command:

   Copy

   bacalhau job run job.yaml --id-only

   Expected Output:

   Copy

   j-5976ffb6-3465-4fec-8b3b-2c822cbaf417

5. Fetching Only the Job ID and Wait for Completion:

   Command:

   Copy

   bacalhau job run job.yaml --id-only --wait

   Expected Output:

   Copy

   j-293f1302-3298-4aca-b06d-33fd1e3f9d2c

6. Running a Job with Node Details:

   Command:

   Copy

   bacalhau job run job.yaml --node-details

   Expected Output:

   Copy

   Job successfully submitted. Job ID: j-05e65dd3-4e9e-4e20-a104-3c91ba934435
   Checking job status... (Enter Ctrl+C to exit at any time, your job will continue running):
   
    Communicating with the network  ................  done ✅  0.1s
       Creating job for submission  ................  done ✅  0.6s
   
   Job Results By Node:
   • Node QmVXwmdZ:
    Hello Bacalhau!
   
   To get more details about the run, execute:
    bacalhau job describe j-05e65dd3-4e9e-4e20-a104-3c91ba934435
   
   To get more details about the run executions, execute:
    bacalhau job executions j-05e65dd3-4e9e-4e20-a104-3c91ba934435

7. Rerunning a previously submitting job:

   Command:

   Copy

   bacalhau job describe j-05e65dd3-4e9e-4e20-a104-3c91ba934435 | bacalhau job run

   Expected Output:

   Copy

   Reading from /dev/stdin; send Ctrl-d to stop.Job successfully submitted. Job ID: j-d8625929-83f4-411a-b9aa-7bcfecb27a8b
   Checking job status... (Enter Ctrl+C to exit at any time, your job will continue running):
   
    Communicating with the network  ................  done ✅  0.1s
       Creating job for submission  ................  done ✅  0.6s
   
   To get more details about the run, execute:
    bacalhau job describe j-d8625929-83f4-411a-b9aa-7bcfecb27a8b
   
   To get more details about the run executions, execute:
    bacalhau job executions j-d8625929-83f4-411a-b9aa-7bcfecb27a8b

Templating

bacalhau job run providing users with the ability to dynamically inject variables into their job specifications. This feature is particularly useful when running multiple jobs with varying parameters such as S3 buckets, prefixes, and time ranges without the need to edit each job specification file manually. You can find more information about templating here.

The bacalhau node reject command offers administrators the ability to reject a compute node's request to join the cluster.

Description:

Using the reject sub-command, administrators can reject a node in the pending state from joining the cluster and receiving work. This feature is crucial for system administrators to manage the cluster and will stop the node from taking part in the cluster until approved.

Usage:

Flags:

• [id]:

  • The unique identifier of the node you wish to describe.

• -h, --help:

  • Displays the help documentation for the describe command.

• -m message:

  • A message to be attached to the rejection action.

Global Flags:

• --api-host string:

  • Specifies the host for client-server communication through REST. This flag is overridden if the BACALHAU_API_HOST environment variable is set.

  • Default: "bootstrap.production.bacalhau.org"

• --api-port int:

  • Designates the port for REST-based communication between client and server. This flag is overlooked if the BACALHAU_API_PORT environment variable is defined.

  • Default: 1234

• --log-mode logging-mode:

  • Determines the log format preference.

  • Options: 'default','station','json','combined','event'

  • Default: 'default'

• --repo string:

  • Points to the bacalhau repository's path.

  • Default: "$HOME/.bacalhau"`

Examples:

1. Reject a Node with ID nodeID123:
2. Reject a Node with an audit message:

The bacalhau node describe command offers users the ability to retrieve detailed information about a specific node using its unique identifier.

Description:

Using the describe sub-command under the bacalhau node umbrella, users can get comprehensive details of a node by providing its ID. This information is crucial for system administrators and network managers to understand the state, specifications, and other attributes of nodes in their infrastructure.

Usage:

Flags:

• [id]:

  • The unique identifier of the node you wish to describe.

• -h, --help:

  • Displays the help documentation for the describe command.

• --output format:

  • Defines the desired format for the command's output.

  • Options: "json" or "yaml"

  • Default: "yaml"

• --pretty:

  • When this flag is used, the command will pretty print the output. This is applicable only for outputs in json and yaml formats.

Global Flags:

• --api-host string:

  • Specifies the host for client-server communication through REST. This flag is overridden if the BACALHAU_API_HOST environment variable is set.

  • Default: "bootstrap.production.bacalhau.org"

• --api-port int:

  • Designates the port for REST-based communication between client and server. This flag is overlooked if the BACALHAU_API_PORT environment variable is defined.

  • Default: 1234

• --log-mode logging-mode:

  • Determines the log format preference.

  • Options: 'default','station','json','combined','event'

  • Default: 'default'

• --repo string:

  • Points to the bacalhau repository's path.

  • Default: "$HOME/.bacalhau"`

Examples:

1. Describing a Node with ID nodeID123:
2. Describing a Node with Output in JSON Format:
3. Pretty Printing the Description of a Node:

The bacalhau node list command is designed to provide users with a comprehensive list of network nodes along with details based on specified flags.

Description:

The list sub-command under the bacalhau node category enumerates information about nodes in the network. It supports various filtering, ordering, and output formatting options, allowing users to tailor the output to their needs.

Usage:

Flags:

• -h, --help:

  • Show the help message for the list command.

• --hide-header:

  • Do not display the column headers in the output.

• --filter-approval:

  • Only show nodes with the specified approval status. Valid values are: approved, pending, rejected.

• --filter-status:

  • Only show nodes with the specified state. Valid values are: healthy, unhealthy, unknown.

• --labels string:

  • Filter nodes based on labels. This follows the filtering format provided by Kubernetes, as shown in their documentation about labels.

• --limit uint32:

  • Restrict the number of results displayed.

• --next-token string:

  • Provide the next token for pagination.

• --no-style:

  • Output the table without any style.

• --order-by string:

  • Sort the results based on a specific field. Valid sorting fields are: id, type, available_cpu, available_memory, available_disk, available_gpu.

• --order-reversed:

  • Display the results in reverse order.

• --output format:

  • Choose the output format. Available options: table, csv, json, yaml.

  • Default: table.

• --pretty:

  • Enhance the visual appeal of the output. This is applicable only to json and yaml formats.

• --show strings:

  • Determine the column groups to be displayed. Acceptable values are: labels, version, features, capacity.

  • Default: labels, capacity.

• --wide:

  • Display full values in the output table, without truncation.

Global Flags:

• --api-host string:

  • Specify the host for client-server communication via REST. This gets ignored if the BACALHAU_API_HOST environment variable is defined.

  • Default: "bootstrap.production.bacalhau.org".

• --api-port int:

  • Specify the port for RESTful communication between client and server. Gets overlooked if the BACALHAU_API_PORT environment variable is set.

  • Default: 1234.

• --log-mode logging-mode:

  • Choose the desired log format.

  • Options: 'default', 'station', 'json', 'combined', 'event'.

  • Default: 'default'.

• --repo string:

  • Point to the directory path of the bacalhau repository.

  • Default: "$HOME/.bacalhau"`.