645cdf1a59
Updating the modules to include update to autorest 12.4
2020-04-02 17:13:36 -07:00
f5c98a7601
make sure cli vars supercede var files ( #8964 )
2020-03-30 10:31:59 +02:00
d068430abf
make sure locals are evaluated only once variables are + test this ( #8918 )
...
fix #8898
2020-03-19 15:30:34 +01:00
ad8dafa3bd
HCL: add tests and fixes around var-file and var args ( #8914 )
2020-03-19 13:57:22 +01:00
88297c796d
Merge branch 'master' into hcl2_singular_blocks
2020-03-17 14:47:17 +01:00
94a1f0bcb6
go fmt
2020-03-17 12:05:37 +01:00
0a46bb9525
more precise docs
2020-03-17 11:50:16 +01:00
b5e8750f5f
Change key/value to name/value to remain consistent with Terraform
2020-03-17 11:23:11 +01:00
c8300b620a
allow to use hcl files as var files in HCL mode
...
fix #8781
2020-03-12 15:41:40 +01:00
d2964d59e9
document that the `-var-file` option still expects JSON files for now
2020-03-03 17:19:51 +01:00
9ec8b67392
Add golangci-lint to project ( #8686 )
...
* Add golangci-lint as linting tool
* Disable failing staticchecks to start; GitHub issue to handle coming soon
* Run `goimports -w` to repair all source files that have improperly
formatted imports
* makefile: Add ci-lint target to run on travis
This change adds a new make target for running golangci-lint on newly
added Go files only. This target is expected to run during Packer ci builds.
* .github/contributing: Add code linting instructions
* travis: Update job configuration to run parallel builds
2020-02-14 11:42:29 -05:00
23fa3107a3
Render variables one time on prepare method ( #8727 )
2020-02-13 17:35:23 +01:00
193dad46e6
Hcl2 input variables, local variables and functions ( #8588 )
...
Mainly redefine or reused what Terraform did.
* allow to used `variables`, `variable` and `local` blocks
* import the following functions and their docs from Terraform: abs, abspath, basename, base64decode, base64encode, bcrypt, can, ceil, chomp, chunklist, cidrhost, cidrnetmask, cidrsubnet, cidrsubnets, coalesce, coalescelist, compact, concat, contains, convert, csvdecode, dirname, distinct, element, file, fileexists, fileset, flatten, floor, format, formatdate, formatlist, indent, index, join, jsondecode, jsonencode, keys, length, log, lookup, lower, max, md5, merge, min, parseint, pathexpand, pow, range, reverse, rsadecrypt, setintersection, setproduct, setunion, sha1, sha256, sha512, signum, slice, sort, split, strrev, substr, timestamp, timeadd, title, trim, trimprefix, trimspace, trimsuffix, try, upper, urlencode, uuidv4, uuidv5, values, yamldecode, yamlencode, zipmap.
2020-02-06 11:49:21 +01:00
073eda76aa
remove extraneous files from when vsphere builder was a plugin, and move README into packer website as separated docs for vsphere-clone and vsphere-iso. Move option descriptions into struct code, and generate documentation directly from those structs as we do inside of the other builders
2020-01-07 16:59:31 -08:00
5bacd37014
fix pps
2019-12-17 16:13:21 -08:00
dca2c03cdb
Merge pull request #7866 from hashicorp/sharing_info
...
Add new struct to Provision() method signature, allowing us to share connection and credential info generated at build time with provisioners.
2019-12-17 14:55:20 -08:00
3d56f8ac80
command/build: Fix URL to HCL2 syntax guide
...
* small typo fixes
2019-12-17 15:36:04 -05:00
4b7132c87c
Merge remote-tracking branch 'origin/master' into sharing_info
2019-12-17 11:57:09 +01:00
0785c2f6fc
build using HCL2 ( #8423 )
...
This follows #8232 which added the code to generate the code required to parse
HCL files for each packer component.
All old config files of packer will keep on working the same. Packer takes one
argument. When a directory is passed, all files in the folder with a name
ending with “.pkr.hcl” or “.pkr.json” will be parsed using the HCL2 format.
When a file ending with “.pkr.hcl” or “.pkr.json” is passed it will be parsed
using the HCL2 format. For every other case; the old packer style will be used.
## 1. the hcl2template pkg can create a packer.Build from a set of HCL (v2) files
I had to make the packer.coreBuild (which is our one and only packer.Build ) a public struct with public fields
## 2. Components interfaces get a new ConfigSpec Method to read a file from an HCL file.
This is a breaking change for packer plugins.
a packer component can be a: builder/provisioner/post-processor
each component interface now gets a `ConfigSpec() hcldec.ObjectSpec`
which allows packer to tell what is the layout of the hcl2 config meant
to configure that specific component.
This ObjectSpec is sent through the wire (RPC) and a cty.Value is now
sent through the already existing configuration entrypoints:
Provisioner.Prepare(raws ...interface{}) error
Builder.Prepare(raws ...interface{}) ([]string, error)
PostProcessor.Configure(raws ...interface{}) error
close #1768
Example hcl files:
```hcl
// file amazon-ebs-kms-key/run.pkr.hcl
build {
sources = [
"source.amazon-ebs.first",
]
provisioner "shell" {
inline = [
"sleep 5"
]
}
post-processor "shell-local" {
inline = [
"sleep 5"
]
}
}
// amazon-ebs-kms-key/source.pkr.hcl
source "amazon-ebs" "first" {
ami_name = "hcl2-test"
region = "us-east-1"
instance_type = "t2.micro"
kms_key_id = "c729958f-c6ba-44cd-ab39-35ab68ce0a6c"
encrypt_boot = true
source_ami_filter {
filters {
virtualization-type = "hvm"
name = "amzn-ami-hvm-????.??.?.????????-x86_64-gp2"
root-device-type = "ebs"
}
most_recent = true
owners = ["amazon"]
}
launch_block_device_mappings {
device_name = "/dev/xvda"
volume_size = 20
volume_type = "gp2"
delete_on_termination = "true"
}
launch_block_device_mappings {
device_name = "/dev/xvdf"
volume_size = 500
volume_type = "gp2"
delete_on_termination = true
encrypted = true
}
ami_regions = ["eu-central-1"]
run_tags {
Name = "packer-solr-something"
stack-name = "DevOps Tools"
}
communicator = "ssh"
ssh_pty = true
ssh_username = "ec2-user"
associate_public_ip_address = true
}
```
2019-12-17 11:25:56 +01:00
0f6d1beccf
add an extra string array to the Prepare() return values in the builder interfaces; this sets up the ability for builders to give the provisioners custom user-accessible build-time variables.
2019-12-16 21:23:05 -08:00
a0329ef196
Simplify testing template
2019-12-10 18:59:56 +01:00
7466c4fdca
Return exit code 1 when builder type is not found
2019-12-10 18:55:18 +01:00
2c513fce64
update ucloud packer
2019-10-29 16:11:43 -07:00
61f9d3a9fe
add ucloud import
2019-10-29 16:11:43 -07:00
7297d74c98
Add azure-chroot builder plugin
2019-10-15 21:13:37 +00:00
59efa0faee
rename option to error-cleanup-privisoner, which I think is clearer
2019-09-25 13:43:29 -07:00
0683bc409b
add test for error-cleanup provisioner, and fix tests by fixing null builder to use an actual none communicator instead of skipping communicator generation altogether
2019-09-25 13:39:09 -07:00
6688f436dd
Merge pull request #7960 from guidodobboletta/master
...
Fix console help text
2019-08-12 16:32:29 -07:00
f4fc9dd09a
Rewrite all files, remove sensitive information
2019-08-09 15:00:23 +08:00
e79d62d006
Fix text
2019-08-08 13:22:59 -05:00
d3202497ae
First working version of virtualbox/vm builder
2019-07-26 12:29:44 +02:00
2a531f8ad6
Merged changes from local branch
2019-07-26 12:29:44 +02:00
2b16b5cae4
Move fixer test to fix package
...
Signed-off-by: Brendan Devenney <brendan.devenney@form3.tech>
2019-07-24 18:04:17 +01:00
6520814a6c
Ensure help output is consistently formatted
...
Signed-off-by: Brendan Devenney <brendan.devenney@form3.tech>
2019-07-24 17:41:57 +01:00
75d8d7fce5
Update and futureproof fix command usage
...
* Dynamically generate the fixer documentation (in order) from
FixerOrder
* Update fixers which used linebreaks in their Synopsis
Signed-off-by: Brendan Devenney <brendan.devenney@form3.tech>
2019-07-24 17:18:07 +01:00
91b7d8c572
Add test to ensure all fixers are enabled
...
Signed-off-by: Brendan Devenney <brendan.devenney@form3.tech>
2019-07-24 16:52:07 +01:00
9f0bc29db5
Test that Fixers and FixerOrder are equal length
...
Signed-off-by: Brendan Devenney <brendan.devenney@form3.tech>
2019-07-24 16:51:39 +01:00
80dadaf3f1
feature: add bsuvolume builder and acceptance test
2019-07-18 09:39:08 -07:00
0c47ee55e6
feature: add chroot builder structure
2019-07-18 09:39:07 -07:00
c4e69d3169
wip: add bsu plugin acc testing
2019-07-18 09:39:07 -07:00
1281f28f6d
add prevalidate step
2019-07-18 09:39:07 -07:00
00c2df24df
Add Exoscale Import post-processor
...
This change adds a new `exoscale-import` post-processor allowing users
to create Private Templates on Exoscale.
2019-07-01 08:40:26 +02:00
6109ad79a3
Merge branch 'master' into feature/ucloud_builder
2019-06-26 10:09:28 +08:00
5efab58ed8
allow to have timestamped colorless ui messages
2019-06-19 15:04:13 +02:00
d1b9ad90c8
Merge remote-tracking branch 'origin' into feature/ucloud_builder
2019-06-18 18:17:19 +08:00
c8bab9b382
add ucloud packer
2019-06-13 15:16:49 +08:00
f7bf80724c
document what a REPL is
2019-06-10 11:39:42 -07:00
53a5e90d78
Update command/console.go
...
Co-Authored-By: Adrien Delorme <azr@users.noreply.github.com>
2019-06-10 11:38:29 -07:00
7cce3157a8
Update command/console.go
...
Co-Authored-By: Adrien Delorme <azr@users.noreply.github.com>
2019-06-10 11:38:14 -07:00
668e92f2ca
add docs and the option to list variables from inside the console
2019-06-06 14:26:12 -07:00
df916e805e
borrow wrappedreadline workarounds from terraform and implement a similar check for piped commands; this makes the cli experience much cleaner
2019-06-06 13:26:07 -07:00
b8ac1a800d
implement a packer console analogous to the terraform console
2019-06-05 16:35:22 -07:00
cb2d89af6f
simplify path parsing by making at string instead of an array + add tests
2019-05-07 11:51:21 +02:00
a4b8570991
refactor arg parsing into it's own cfg maker & test it
2019-05-07 11:43:18 +02:00
7e8c42d243
BuildCommand: put config in a local struct
2019-05-07 11:15:35 +02:00
cdbb742496
add more cancellation tests
2019-05-06 16:29:35 +02:00
73a55631c4
fix testfile call
2019-05-06 15:47:53 +02:00
2890687b2b
fix race condition in BuildCommand
...
a map[string]error was being written on unprotectedly
2019-05-06 15:42:23 +02:00
af15ed3583
nil signals are probably just a cancellation in disguise
2019-05-06 15:29:59 +02:00
583d93790f
add tests for cancellation while building
2019-05-06 15:07:57 +02:00
dd2785ff08
BuildCommand.Run: avoid triggering a cancellation on termination
2019-05-06 12:26:22 +02:00
0094d2878c
Build: move BuildCommand.Run into a RunContext command to allow testing for cancellation, put cancellation in `Run`
2019-05-06 12:19:59 +02:00
a2cc2532ea
add TestBuildParallel_Timeout to test errors on parallel builds
2019-05-03 09:02:56 +02:00
d40d3eca88
swap semaquire and wg.Add to avoid a deadlock
2019-05-03 08:19:33 +02:00
263f318e82
be true to docs
2019-05-02 17:48:34 +02:00
1dca416f87
move the semacquire to the main build loop so that the build order is kept
...
* a goroutine could start before another !
2019-05-02 16:58:28 +02:00
852af993e6
BuildParallel: test with 3 parallel builds
2019-05-02 16:24:28 +02:00
9281fada2d
prevent a breaking change so that we can merge the `-parallel-builds` option first.
2019-05-02 16:24:28 +02:00
14486003a1
fix test to be race free
2019-05-02 15:04:02 +02:00
c1527d9b47
fix text
2019-05-02 14:41:44 +02:00
ae71a81c1e
Merge remote-tracking branch 'origin/master' into pr/7501
2019-05-02 11:47:43 +02:00
aaf56ffd26
added: testing
2019-05-02 08:38:56 +10:00
76b5c1995f
fixed: small changes to cancellation on ctrl-c
2019-04-19 17:10:36 +10:00
99987c2d56
Add Linode Images builder
...
Packer Builder for [Linode Images](https://www.linode.com/docs/platform/disk-images/linode-images/ )
Adds the following builder:
* `linode`
Based on https://github.com/linode/packer-builder-linode (MPL/2)
(formerly maintained by @dradtke). Includes website docs and tests.
Relates to #174 , #3131
2019-04-15 20:40:59 -04:00
97f2914c6a
Merge pull request #7484 from yandex-cloud/yandex-cloud-builder
...
Builder for Yandex.Cloud
2019-04-15 14:02:43 +02:00
92e75f838a
added the ability to limit number of builds running in parallel
2019-04-13 22:31:54 +10:00
d2f036ec44
Revert "Revert "Merge pull request #7391 from carlpett/proxmox-builder""
...
This reverts commit 032527ecfe
2019-04-12 12:26:34 +02:00
8f53ca5e5e
Add 'yandex' plugin as Builder
2019-04-12 01:00:54 +03:00
032527ecfe
Revert "Merge pull request #7391 from carlpett/proxmox-builder"
...
This reverts commit b7d62b2ae0c36eaf16f7
2019-04-11 14:19:25 +02:00
0b4ada9690
make sleep provisioner available to packer
2019-04-08 20:09:22 +02:00
d7b1b597a7
test provisionning timeout
2019-04-08 20:09:21 +02:00
a81abd297b
Merge remote-tracking branch 'origin/master' into context_provisioner
2019-04-08 20:09:01 +02:00
9f8fc37fde
Implement Proxmox builder
2019-04-04 15:20:46 -07:00
217a93fc30
fix build_test.go on windows. This code needs to not be run in parallel, or else there can be race conditions with the post-processors all trying to access the same file at once. Additionally, I changed the test template itself so that it is valid code on either bash or cmd. Finally, I found and fixed a small bug in naming the file extensions in shell local inline scripts.
2019-04-04 14:57:56 -07:00
a4bf94dd3c
change Builder to be passed a context for cancellation
...
we have to to give it to our hook
2019-04-03 15:55:55 +02:00
045f2f41bd
display received signal in debug mode
2019-03-22 14:25:06 +01:00
9f82b75e57
Use the hashicorp/go-getter to download files
...
* removed packer.Cache and references since packer.Cache is never used except in the download step. The download step now uses the new func packer.CachePath(targetPath) for this, the behavior is the same.
* removed download code from packer that was reimplemented into the go-getter library: progress bar, http download restart, checksuming from file, skip already downloaded files, symlinking, make a download cancellable by context.
* on windows if packer is running without symlinking rights and we are getting a local file, the file will be copied instead to avoid errors.
* added unit tests for step_download that are now CI tested on windows, mac & linux.
* files are now downloaded under cache dir `sha1(filename + "?checksum=" + checksum) + file_extension`
* since the output dir is based on the source url and the checksum, when the checksum fails, the file is auto deleted.
* a download file is protected and locked by a file lock,
* updated docs
* updated go modules and vendors
2019-03-13 12:11:58 +01:00
a5b753820c
Fix build commands -except help message
...
The `-except` option needed some updates that were missed in 270f851e
2019-03-05 10:54:35 -05:00
b8510f35fc
Merge pull request #7330 from hashicorp/except_post_processor_tests
...
name a post-processor to it's type when it is not named
2019-02-26 09:26:17 -08:00
94a7a07c87
Merge branch 'master' into hyperone
2019-02-24 15:16:21 +01:00
7e2d86731e
tests: add a post-processor that creates an unnamed.txt file
2019-02-20 11:03:17 +01:00
de336ef15e
TestBuildOnlyFileMultipleFlags: check that tomato.txt is not created
2019-02-19 16:40:42 +01:00
b04b8b3857
test building with `-except=""`
2019-02-19 15:25:41 +01:00
75f574bd4b
Merge pull request #7221 from hashicorp/vagrant_builder
...
Vagrant builder
2019-02-15 10:05:44 -08:00
be21850e32
Merge pull request #7060 from andrewsomething/do-post-processor
...
Add digitalocean-import post-processor.
2019-02-14 11:58:00 -08:00
c207451f7e
Merge branch 'master' of https://github.com/hashicorp/packer into packer-provisioner-inspec
2019-02-12 05:32:05 +00:00
228829139b
Merge branch 'master' into hyperone
2019-02-07 14:12:13 +01:00
ad21367b21
vagrant builder
2019-02-04 14:08:43 -08:00
8621949e01
make generate
2019-02-04 15:16:38 +01:00
dd3e2c255c
respect a 'only' defined in a post-processor
2019-02-01 15:50:06 +01:00
Vaijanath Angadihiremath
Megan Marsh
Adrien Delorme
Adrien Delorme
Wilken Rivera
Sylvia Moss
mingsheng.su
Paul Meyer
xiaohan.liang
Guido Dobboletta
Thomas Meckel
Brendan Devenney
Marin Salinas
Marc Falzon
Brett Wandel
Marques Johansson
Gennady Lipenkov
Calle Pettersson
Andrew Widdersheim
Miłosz Smółka
xinau