2013-06-11 01:15:06 -04:00
|
|
|
---
|
2017-06-14 21:04:16 -04:00
|
|
|
description: |
|
2020-03-18 18:46:47 -04:00
|
|
|
It is possible to write custom builders using the Packer plugin interface, and
|
|
|
|
this page documents how to do that.
|
2015-07-22 22:31:00 -04:00
|
|
|
layout: docs
|
2020-03-18 18:46:47 -04:00
|
|
|
page_title: Custom Builders - Extending
|
2020-04-02 19:39:47 -04:00
|
|
|
sidebar_title: Custom Builders
|
2017-03-25 18:13:52 -04:00
|
|
|
---
|
2013-06-11 01:15:06 -04:00
|
|
|
|
2017-03-25 18:13:52 -04:00
|
|
|
# Custom Builders
|
2013-06-11 01:15:06 -04:00
|
|
|
|
2018-10-26 20:02:51 -04:00
|
|
|
Packer Builders are the components of Packer responsible for creating a
|
|
|
|
machine, bringing it to a point where it can be provisioned, and then turning
|
|
|
|
that provisioned machine into some sort of machine image. Several builders are
|
2015-07-22 22:31:00 -04:00
|
|
|
officially distributed with Packer itself, such as the AMI builder, the VMware
|
|
|
|
builder, etc. However, it is possible to write custom builders using the Packer
|
|
|
|
plugin interface, and this page documents how to do that.
|
2013-06-11 01:15:06 -04:00
|
|
|
|
2015-07-22 22:31:00 -04:00
|
|
|
Prior to reading this page, it is assumed you have read the page on [plugin
|
2020-03-31 17:40:07 -04:00
|
|
|
development basics](/docs/extending/plugins).
|
2013-06-11 01:15:06 -04:00
|
|
|
|
2020-03-23 20:02:12 -04:00
|
|
|
~> **Warning!** This is an advanced topic. If you're new to Packer, we
|
2014-10-20 13:55:16 -04:00
|
|
|
recommend getting a bit more comfortable before you dive into writing plugins.
|
2013-06-11 01:15:06 -04:00
|
|
|
|
|
|
|
## The Interface
|
|
|
|
|
|
|
|
The interface that must be implemented for a builder is the `packer.Builder`
|
2017-05-09 14:37:49 -04:00
|
|
|
interface. It is reproduced below for reference. The actual interface in the
|
|
|
|
source code contains some basic documentation as well explaining what each
|
2015-07-22 22:31:00 -04:00
|
|
|
method should do.
|
2013-06-11 01:15:06 -04:00
|
|
|
|
2020-03-18 18:46:47 -04:00
|
|
|
```go
|
2013-06-11 01:15:06 -04:00
|
|
|
type Builder interface {
|
2019-12-18 10:13:52 -05:00
|
|
|
ConfigSpec() hcldec.ObjectSpec
|
|
|
|
Prepare(...interface{}) ([]string, []string, error)
|
2019-04-29 07:06:09 -04:00
|
|
|
Run(context.Context, ui Ui, hook Hook) (Artifact, error)
|
2013-06-11 01:15:06 -04:00
|
|
|
}
|
2014-10-20 13:55:16 -04:00
|
|
|
```
|
2020-03-18 18:46:47 -04:00
|
|
|
|
2019-12-20 15:05:01 -05:00
|
|
|
### The "ConfigSpec" Method
|
|
|
|
|
|
|
|
This method returns a hcldec.ObjectSpec, which is a spec necessary for using
|
|
|
|
HCL2 templates with Packer. For information on how to use and implement this
|
|
|
|
function, check our
|
2020-03-31 18:19:18 -04:00
|
|
|
[object spec docs](/guides/hcl/component-object-spec)
|
2013-06-11 01:15:06 -04:00
|
|
|
|
|
|
|
### The "Prepare" Method
|
|
|
|
|
2015-07-22 22:31:00 -04:00
|
|
|
The `Prepare` method for each builder is called prior to any runs with the
|
|
|
|
configuration that was given in the template. This is passed in as an array of
|
|
|
|
`interface{}` types, but is generally `map[string]interface{}`. The prepare
|
2013-06-11 01:15:06 -04:00
|
|
|
method is responsible for translating this configuration into an internal
|
|
|
|
structure, validating it, and returning any errors.
|
|
|
|
|
2013-06-14 15:41:42 -04:00
|
|
|
For multiple parameters, they should be merged together into the final
|
2018-10-26 20:02:51 -04:00
|
|
|
configuration, with later parameters overwriting any previous configuration.
|
|
|
|
The exact semantics of the merge are left to the builder author.
|
2013-06-14 15:41:42 -04:00
|
|
|
|
2013-06-11 01:15:06 -04:00
|
|
|
For decoding the `interface{}` into a meaningful structure, the
|
2015-07-22 22:31:00 -04:00
|
|
|
[mapstructure](https://github.com/mitchellh/mapstructure) library is
|
|
|
|
recommended. Mapstructure will take an `interface{}` and decode it into an
|
|
|
|
arbitrarily complex struct. If there are any errors, it generates very human
|
|
|
|
friendly errors that can be returned directly from the prepare method.
|
|
|
|
|
2018-10-26 20:02:51 -04:00
|
|
|
While it is not actively enforced, **no side effects** should occur from
|
|
|
|
running the `Prepare` method. Specifically, don't create files, don't launch
|
|
|
|
virtual machines, etc. Prepare's purpose is solely to configure the builder and
|
|
|
|
validate the configuration.
|
2015-07-22 22:31:00 -04:00
|
|
|
|
|
|
|
In addition to normal configuration, Packer will inject a
|
|
|
|
`map[string]interface{}` with a key of `packer.DebugConfigKey` set to boolean
|
|
|
|
`true` if debug mode is enabled for the build. If this is set to true, then the
|
2018-10-26 20:02:51 -04:00
|
|
|
builder should enable a debug mode which assists builder developers and
|
|
|
|
advanced users to introspect what is going on during a build. During debug
|
|
|
|
builds, parallelism is strictly disabled, so it is safe to request input from
|
|
|
|
stdin and so on.
|
2013-06-14 15:41:42 -04:00
|
|
|
|
2013-06-11 01:15:06 -04:00
|
|
|
### The "Run" Method
|
|
|
|
|
2015-07-22 22:31:00 -04:00
|
|
|
`Run` is where all the interesting stuff happens. Run is executed, often in
|
2018-10-26 20:02:51 -04:00
|
|
|
parallel for multiple builders, to actually build the machine, provision it,
|
|
|
|
and create the resulting machine image, which is returned as an implementation
|
|
|
|
of the `packer.Artifact` interface.
|
2013-06-11 01:15:06 -04:00
|
|
|
|
|
|
|
The `Run` method takes three parameters. These are all very useful. The
|
2015-07-22 22:31:00 -04:00
|
|
|
`packer.Ui` object is used to send output to the console. `packer.Hook` is used
|
|
|
|
to execute hooks, which are covered in more detail in the hook section below.
|
|
|
|
And `packer.Cache` is used to store files between multiple Packer runs, and is
|
|
|
|
covered in more detail in the cache section below.
|
2013-06-11 01:15:06 -04:00
|
|
|
|
|
|
|
Because builder runs are typically a complex set of many steps, the
|
2018-01-24 20:27:08 -05:00
|
|
|
[multistep](https://github.com/hashicorp/packer/blob/master/helper/multistep)
|
|
|
|
helper is recommended to bring order to the complexity. Multistep is a library
|
|
|
|
which allows you to separate your logic into multiple distinct "steps" and
|
|
|
|
string them together. It fully supports cancellation mid-step and so on. Please
|
|
|
|
check it out, it is how the built-in builders are all implemented.
|
2015-07-22 22:31:00 -04:00
|
|
|
|
|
|
|
Finally, as a result of `Run`, an implementation of `packer.Artifact` should be
|
|
|
|
returned. More details on creating a `packer.Artifact` are covered in the
|
|
|
|
artifact section below. If something goes wrong during the build, an error can
|
|
|
|
be returned, as well. Note that it is perfectly fine to produce no artifact and
|
|
|
|
no error, although this is rare.
|
2013-06-11 01:15:06 -04:00
|
|
|
|
2019-04-29 07:06:09 -04:00
|
|
|
### Cancellation
|
2020-03-18 18:46:47 -04:00
|
|
|
|
2019-04-29 07:06:09 -04:00
|
|
|
The `Run` method is often run in parallel.
|
2013-06-11 01:15:06 -04:00
|
|
|
|
2020-03-18 18:46:47 -04:00
|
|
|
#### With the "Cancel" Method ( up until packer 1.3 )
|
2019-04-29 07:06:09 -04:00
|
|
|
|
|
|
|
The `Cancel` method can be called at any time and requests cancellation of any
|
|
|
|
builder run in progress. This method should block until the run actually stops.
|
|
|
|
Not that the Cancel method will no longer be called since packer 1.4.0.
|
|
|
|
|
|
|
|
#### Context cancellation ( from packer 1.4 )
|
|
|
|
|
|
|
|
The `<-ctx.Done()` can unblock at any time and signifies request for
|
|
|
|
cancellation of any builder run in progress.
|
2013-06-11 01:15:06 -04:00
|
|
|
|
2015-07-22 22:31:00 -04:00
|
|
|
Cancels are most commonly triggered by external interrupts, such as the user
|
|
|
|
pressing `Ctrl-C`. Packer will only exit once all the builders clean up, so it
|
|
|
|
is important that you architect your builder in a way that it is quick to
|
|
|
|
respond to these cancellations and clean up after itself.
|
2013-06-11 01:15:06 -04:00
|
|
|
|
|
|
|
## Creating an Artifact
|
|
|
|
|
2013-06-11 03:38:14 -04:00
|
|
|
The `Run` method is expected to return an implementation of the
|
2015-07-22 22:31:00 -04:00
|
|
|
`packer.Artifact` interface. Each builder must create their own implementation.
|
2017-05-09 14:37:49 -04:00
|
|
|
The interface has ample documentation to help you get started.
|
2013-06-11 03:38:14 -04:00
|
|
|
|
2015-07-22 22:31:00 -04:00
|
|
|
The only part of an artifact that may be confusing is the `BuilderId` method.
|
|
|
|
This method must return an absolutely unique ID for the builder. In general, I
|
|
|
|
follow the practice of making the ID contain my GitHub username and then the
|
|
|
|
platform it is building for. For example, the builder ID of the VMware builder
|
2017-06-25 22:34:23 -04:00
|
|
|
is "hashicorp.vmware" or something similar.
|
2013-06-11 03:38:14 -04:00
|
|
|
|
2018-10-26 20:02:51 -04:00
|
|
|
Post-processors use the builder ID value in order to make some assumptions
|
|
|
|
about the artifact results, so it is important it never changes.
|
2013-06-11 03:38:14 -04:00
|
|
|
|
2015-07-22 22:31:00 -04:00
|
|
|
Other than the builder ID, the rest should be self-explanatory by reading the
|
2017-02-10 03:40:36 -05:00
|
|
|
[packer.Artifact interface
|
2017-04-04 16:39:01 -04:00
|
|
|
documentation](https://github.com/hashicorp/packer/blob/master/packer/artifact.go).
|
2013-06-11 01:15:06 -04:00
|
|
|
|
|
|
|
## Provisioning
|
|
|
|
|
2013-06-11 03:38:14 -04:00
|
|
|
Packer has built-in support for provisioning, but the moment when provisioning
|
2015-07-22 22:31:00 -04:00
|
|
|
runs must be invoked by the builder itself, since only the builder knows when
|
|
|
|
the machine is running and ready for communication.
|
2013-06-11 01:15:06 -04:00
|
|
|
|
2013-06-11 03:38:14 -04:00
|
|
|
When the machine is ready to be provisioned, run the `packer.HookProvision`
|
|
|
|
hook, making sure the communicator is not nil, since this is required for
|
|
|
|
provisioners. An example of calling the hook is shown below:
|
2013-06-11 01:15:06 -04:00
|
|
|
|
2020-03-18 18:46:47 -04:00
|
|
|
```go
|
2019-04-29 07:06:09 -04:00
|
|
|
hook.Run(context.Context, packer.HookProvision, ui, comm, nil)
|
2014-10-20 13:55:16 -04:00
|
|
|
```
|
2013-06-11 01:15:06 -04:00
|
|
|
|
2015-07-22 22:31:00 -04:00
|
|
|
At this point, Packer will run the provisioners and no additional work is
|
|
|
|
necessary.
|
2013-06-11 03:38:14 -04:00
|
|
|
|
2020-03-23 20:02:12 -04:00
|
|
|
-> **Note:** Hooks are still undergoing thought around their general design
|
2015-07-22 22:31:00 -04:00
|
|
|
and will likely change in a future version. They aren't fully "baked" yet, so
|
|
|
|
they aren't documented here other than to tell you how to hook in provisioners.
|
2013-06-24 12:36:55 -04:00
|
|
|
|
2020-01-17 05:21:52 -05:00
|
|
|
## Template Engine
|
|
|
|
|
|
|
|
### Build variables
|
|
|
|
|
2020-03-18 18:46:47 -04:00
|
|
|
Packer makes it possible to provide custom template engine variables to be shared with
|
|
|
|
provisioners and post-processors using the `build` function.
|
|
|
|
|
|
|
|
Part of the builder interface changes made in 1.5.0 was to make builder Prepare() methods
|
|
|
|
return a list of custom variables which we call `generated data`.
|
|
|
|
We use that list of variables to generate a custom placeholder map per builder that
|
2020-03-23 20:02:12 -04:00
|
|
|
combines custom variables with the placeholder map of default build variables created by Packer.
|
2020-01-17 05:21:52 -05:00
|
|
|
Here's an example snippet telling packer what will be made available by the builder:
|
|
|
|
|
2020-03-27 14:22:33 -04:00
|
|
|
```go
|
2020-01-17 05:21:52 -05:00
|
|
|
func (b *Builder) Prepare(raws ...interface{}) ([]string, []string, error) {
|
|
|
|
// ...
|
2020-03-18 18:46:47 -04:00
|
|
|
|
2020-01-17 05:21:52 -05:00
|
|
|
generatedData := []string{"SourceImageName"}
|
|
|
|
return generatedData, warns, nil
|
|
|
|
}
|
|
|
|
```
|
2020-03-18 18:46:47 -04:00
|
|
|
|
|
|
|
Returning the custom variable name(s) within the `generated_data` placeholder is necessary
|
2020-03-23 20:02:12 -04:00
|
|
|
for the template containing the build variable(s) to validate.
|
|
|
|
|
2020-03-18 18:46:47 -04:00
|
|
|
Once the placeholder is set, it's necessary to pass the variables' real values when calling
|
|
|
|
the provisioner. This can be done as the example below:
|
2020-01-17 05:21:52 -05:00
|
|
|
|
2020-03-27 14:22:33 -04:00
|
|
|
```go
|
2020-01-17 05:21:52 -05:00
|
|
|
func (b *Builder) Run(ctx context.Context, ui packer.Ui, hook packer.Hook) (packer.Artifact, error) {
|
|
|
|
// ...
|
2020-03-18 18:46:47 -04:00
|
|
|
|
2020-01-17 05:21:52 -05:00
|
|
|
// Create map of custom variable
|
|
|
|
generatedData := map[string]interface{}{"SourceImageName": "the source image name value"}
|
|
|
|
// Pass map to provisioner
|
|
|
|
hook.Run(context.Context, packer.HookProvision, ui, comm, generatedData)
|
2020-03-18 18:46:47 -04:00
|
|
|
|
2020-01-17 05:21:52 -05:00
|
|
|
// ...
|
|
|
|
}
|
|
|
|
```
|
|
|
|
|
2020-03-18 18:46:47 -04:00
|
|
|
In order to make these same variables and the Packer default ones also available to post-processor,
|
2020-01-30 12:16:55 -05:00
|
|
|
it is necessary to add them to the Artifact returned by the builder. This can be done by adding an attribute of type
|
2020-03-18 18:46:47 -04:00
|
|
|
`map[string]interface{}` to the Artifact and putting the generated data in it. The post-processor
|
|
|
|
will access this data later via the Artifact's `State` method.
|
2020-01-30 12:16:55 -05:00
|
|
|
|
|
|
|
The Artifact code should be implemented similar to the below:
|
|
|
|
|
2020-03-27 14:22:33 -04:00
|
|
|
```go
|
2020-01-30 12:16:55 -05:00
|
|
|
type Artifact struct {
|
|
|
|
// ...
|
|
|
|
|
|
|
|
// StateData should store data such as GeneratedData
|
|
|
|
// to be shared with post-processors
|
|
|
|
StateData map[string]interface{}
|
|
|
|
}
|
|
|
|
|
|
|
|
// ...
|
|
|
|
|
|
|
|
func (a *Artifact) State(name string) interface{} {
|
|
|
|
return a.StateData[name]
|
|
|
|
}
|
|
|
|
|
|
|
|
// ...
|
2020-03-18 18:46:47 -04:00
|
|
|
```
|
|
|
|
|
2020-01-30 12:16:55 -05:00
|
|
|
The builder should return the above Artifact containing the generated data and the code should be similar
|
|
|
|
to the example snippet below:
|
|
|
|
|
2020-03-27 14:22:33 -04:00
|
|
|
```go
|
2020-01-30 12:16:55 -05:00
|
|
|
func (b *Builder) Run(ctx context.Context, ui packer.Ui, hook packer.Hook) (packer.Artifact, error) {
|
|
|
|
// ...
|
2020-03-18 18:46:47 -04:00
|
|
|
|
2020-01-30 12:16:55 -05:00
|
|
|
return &Artifact{
|
|
|
|
// ...
|
|
|
|
StateData: map[string]interface{}{"generated_data": state.Get("generated_data")},
|
|
|
|
}, nil
|
|
|
|
}
|
|
|
|
```
|
|
|
|
|
2020-03-18 18:46:47 -04:00
|
|
|
The code above assigns the `generated_data` state to the `StateData` map with the key `generated_data`.
|
|
|
|
|
|
|
|
Here some example of how this data will be used by post-processors:
|
2020-01-30 12:16:55 -05:00
|
|
|
|
2020-03-27 14:22:33 -04:00
|
|
|
```go
|
2020-01-30 12:16:55 -05:00
|
|
|
func (p *PostProcessor) PostProcess(ctx context.Context, ui packer.Ui, source packer.Artifact) (packer.Artifact, bool, bool, error) {
|
|
|
|
generatedData := source.State("generated_data")
|
2020-03-18 18:46:47 -04:00
|
|
|
|
2020-01-30 12:16:55 -05:00
|
|
|
// generatedData will then be used for interpolation
|
2020-03-18 18:46:47 -04:00
|
|
|
|
2020-01-30 12:16:55 -05:00
|
|
|
// ...
|
|
|
|
}
|
|
|
|
```
|
|
|
|
|
2020-03-31 17:40:07 -04:00
|
|
|
To know more about the template engine build function, please refer to the [template engine docs](/docs/templates/engine).
|