Job Templates
Templating Support in Bacalhau Job Run
Was this helpful?
Templating Support in Bacalhau Job Run
Was this helpful?
This documentation introduces templating support for , providing users with the ability to dynamically inject variables into their job specifications. This feature is particularly useful when running multiple jobs with varying parameters such as DuckDB query, S3 buckets, prefixes, and time ranges without the need to edit each job specification file manually.
The motivation behind this feature arises from the need to streamline the process of preparing and running multiple jobs with different configurations. Rather than manually editing job specs for each run, users can leverage placeholders and pass actual values at runtime.
The templating functionality in Bacalhau is built upon the Go text/template package. This powerful library offers a wide range of features for manipulating and formatting text based on template definitions and input variables.
For more detailed information about the Go text/template library and its syntax, please refer to the official documentation: .
You can also use environment variables for templating:
To preview the final templated job spec without actually submitting the job, you can use the --dry-run flag:
This will output the processed job specification, showing you how the placeholders have been replaced with the provided values.
This is an ops job that runs on all nodes that match the job selection criteria. It accepts duckdb query variable, and two optional start-time and end-time variables to define the time range for the query.
To run this job, you can use the following command:
This is abatch job that runs on a single node. It accepts the duckdb query variable, and four other variables to define the S3 bucket, prefix, and pattern for the logs and the AWS region.
To run this job, you can use the following command: