Commit Graph

170 Commits

Author SHA1 Message Date
Megan Marsh e87aa237dd Get plugin up to parity with v1.5.0. Remove custom jetbrains-internal testing logic; disable acceptance tests (for now) until we can set up a test rig inside of HashiCorp. Regenerate code based on vendoring changes. 2020-01-08 14:41:51 -08:00
Megan Marsh 073eda76aa remove extraneous files from when vsphere builder was a plugin, and move README into packer website as separated docs for vsphere-clone and vsphere-iso. Move option descriptions into struct code, and generate documentation directly from those structs as we do inside of the other builders 2020-01-07 16:59:31 -08:00
Adrien Delorme 0785c2f6fc
build using HCL2 (#8423)
This follows #8232 which added the code to generate the code required to parse
HCL files for each packer component.

All old config files of packer will keep on working the same. Packer takes one
argument. When a directory is passed, all files in the folder with a name
ending with  “.pkr.hcl” or “.pkr.json” will be parsed using the HCL2 format.
When a file ending with “.pkr.hcl” or “.pkr.json” is passed it will be parsed
using the HCL2 format. For every other case; the old packer style will be used.

## 1. the hcl2template pkg can create a packer.Build from a set of HCL (v2) files

I had to make the packer.coreBuild (which is our one and only packer.Build ) a public struct with public fields

## 2. Components interfaces get a new ConfigSpec Method to read a file from an HCL file.

  This is a breaking change for packer plugins.

a packer component can be a: builder/provisioner/post-processor

each component interface now gets a `ConfigSpec() hcldec.ObjectSpec`
which allows packer to tell what is the layout of the hcl2 config meant
to configure that specific component.

This ObjectSpec is sent through the wire (RPC) and a cty.Value is now
sent through the already existing configuration entrypoints:

 Provisioner.Prepare(raws ...interface{}) error
 Builder.Prepare(raws ...interface{}) ([]string, error)
 PostProcessor.Configure(raws ...interface{}) error

close #1768


Example hcl files:

```hcl
// file amazon-ebs-kms-key/run.pkr.hcl
build {
    sources = [
        "source.amazon-ebs.first",
    ]

    provisioner "shell" {
        inline = [
            "sleep 5"
        ]
    }

    post-processor "shell-local" {
        inline = [
            "sleep 5"
        ]
    }
}

// amazon-ebs-kms-key/source.pkr.hcl

source "amazon-ebs" "first" {

    ami_name = "hcl2-test"
    region = "us-east-1"
    instance_type = "t2.micro"

    kms_key_id = "c729958f-c6ba-44cd-ab39-35ab68ce0a6c"
    encrypt_boot = true
    source_ami_filter {
        filters {
          virtualization-type = "hvm"
          name =  "amzn-ami-hvm-????.??.?.????????-x86_64-gp2"
          root-device-type = "ebs"
        }
        most_recent = true
        owners = ["amazon"]
    }
    launch_block_device_mappings {
        device_name = "/dev/xvda"
        volume_size = 20
        volume_type = "gp2"
        delete_on_termination = "true"
    }
    launch_block_device_mappings {
        device_name = "/dev/xvdf"
        volume_size = 500
        volume_type = "gp2"
        delete_on_termination = true
        encrypted = true
    }

    ami_regions = ["eu-central-1"]
    run_tags {
        Name = "packer-solr-something"
        stack-name = "DevOps Tools"
    }
    
    communicator = "ssh"
    ssh_pty = true
    ssh_username = "ec2-user"
    associate_public_ip_address = true
}
```
2019-12-17 11:25:56 +01:00
Adam Dobrawy 3b091e6046 builder/hyperone: fix & add tests for tags 2019-12-03 14:57:40 +01:00
Megan Marsh 452ca602ee update go-ntlmssp dependency to fix upstream bug affecting winrm users 2019-11-15 13:08:38 -08:00
Megan Marsh 53bbce4cd7 update to newest version of go-tty to fix control flow bug 2019-11-12 10:17:21 -08:00
Li Kexian f2f544c434 fixed get copy region value (#8345) 2019-11-07 11:12:19 +01:00
Adrien Delorme 5ddd02d1c0
Cut version 1.4.5 2019-11-04 18:43:29 +01:00
Megan Marsh 991af72758 checkout go.mod and go.sum from master, rebuild 2019-10-30 10:47:13 -07:00
Megan Marsh 58b94574c5 clean up dependencies 2019-10-30 09:33:09 -07:00
Megan Marsh 9c02d7c1eb fix modules 2019-10-29 16:11:44 -07:00
mingsheng.su 61f9d3a9fe add ucloud import 2019-10-29 16:11:43 -07:00
Adrien Delorme 889ab163f1
Merge pull request #8241 from carlpett/bump-proxmox-api
Bump proxmox dependency
2019-10-29 14:45:41 +01:00
Megan Marsh 1d489d1899 revert bad commit and re-vendor code. 2019-10-28 14:38:18 -07:00
Megan Marsh 5ab31b0363 Revert "vendor vendors"
This reverts commit 8b1fcbb3bd.
2019-10-28 14:31:07 -07:00
Calle Pettersson 9e00438453 Bump proxmox-api 2019-10-27 13:03:31 +01:00
Megan Marsh d15f43e4eb
Merge pull request #8232 from hashicorp/artifact-tree
HCL2 configs - part one
2019-10-22 11:54:34 -07:00
Megan Marsh 0c2fba089d
Merge pull request #8250 from tencentyun/master
tencentcloud-cvm builder: we added retry on remote api call to improve the user experience
2019-10-21 14:45:37 -07:00
Li Kexian 6fb8988d08
we added retry on remote api call to improve the user experience 2019-10-21 13:21:56 +08:00
Adrien Delorme cf1555bf17 Merge remote-tracking branch 'origin/master' into artifact-tree 2019-10-16 10:22:56 +02:00
Paul Meyer b9c726417f update modules 2019-10-15 21:14:20 +00:00
Adrien Delorme 8b1fcbb3bd vendor vendors 2019-10-15 12:56:42 +02:00
psinghal20 7f1f77b8c6
chore: tidy up go.mod
Signed-off-by: psinghal20 <psinghal20@gmail.com>
2019-10-11 14:35:44 +05:30
psinghal20 6492995a20
feat: add strftime function in templates
This commit adds strfttime function in templates to provide conventional format for ISO time based on C standard.

Signed-off-by: psinghal20 <psinghal20@gmail.com>
2019-10-11 14:35:39 +05:30
Megan Marsh 17d4e54947
Cut version 1.4.4 2019-10-01 11:29:00 -07:00
Megan Marsh 4644af7b66
Merge pull request #8131 from hashicorp/fix_8036
Fix 8036
2019-10-01 09:40:11 -07:00
Megan Marsh e31a28bb77 fix generated files for update I committed directly to master 2019-09-27 13:51:38 -07:00
Gennady Lipenkov 91733c49bb update yandex-cloud/go-sdk & yandex-cloud/go-genproto 2019-09-23 21:18:33 +03:00
Gennady Lipenkov 6708641942 update go modules 2019-09-23 21:09:10 +03:00
Megan Marsh ca51bff695
Merge pull request #8119 from hashicorp/switch_sed_because_license
templating: deprecate `sed` with `replace` and `replace_all`
2019-09-23 09:41:03 -07:00
Adrien Delorme 9f6be64f43 Merge remote-tracking branch 'origin/master' into fix_7277_le_deux 2019-09-23 12:43:24 +02:00
Adrien Delorme 0f14077664 Merge remote-tracking branch 'origin/master' into switch_sed_because_license 2019-09-23 12:38:52 +02:00
Megan Marsh 87b3a1f99d update aws sdk 2019-09-20 10:04:37 -07:00
Adrien Delorme 3fe9d52e3f Merge remote-tracking branch 'origin/master' into scrape_doc_to_builder_struct_config 2019-09-20 11:15:44 +02:00
Megan Marsh 11c87a786a update go modules 2019-09-18 10:33:16 -07:00
Adrien Delorme 52afb3ab05 go mod tidy && go mod vendor 2019-09-17 16:02:56 +02:00
Gennady Lipenkov a6c3145fdb update yandex-cloud/go-sdk & yandex-cloud/go-genproto 2019-09-10 18:52:55 +03:00
Adrien Delorme 597a3e323b Merge remote-tracking branch 'origin/master' into scrape_doc_to_builder_struct_config 2019-09-10 13:20:07 +02:00
Adrien Delorme aa9cc919ab Merge branch 'master' into circle_ci_windows 2019-09-10 12:54:35 +02:00
Adrien Delorme 146b88ba1e Merge remote-tracking branch 'origin/master' into scrape_doc_to_builder_struct_config 2019-09-10 12:44:46 +02:00
Calle Pettersson 8c2c1a82cb Bump proxmox-api-go dependency 2019-09-07 23:07:45 +02:00
Adrien Delorme 4748958cca go get go get github.com/hashicorp/go-getter@master && tidy 2019-09-06 11:59:23 +02:00
Adrien Delorme 44ba58321d pin to go 1.13 & cleanup go deps 2019-09-05 17:11:08 +02:00
Adrien Delorme 1d00daedac replace github.com/gofrs/flock => github.com/azr/flock v0.0.0-20190823144736-958d66434653
to test my fix
2019-09-05 17:03:54 +02:00
Adrien Delorme 1151641424 fix broken git.apache.org/thrift.git link 2019-09-04 14:50:28 +02:00
Adrien Delorme 4cb7c30987 Merge remote-tracking branch 'origin/master' into scrape_doc_to_builder_struct_config 2019-08-21 16:44:23 +02:00
Andre Hilsendeger d832cd6f67 chore: bump hcloud dependency 2019-08-13 08:40:47 +02:00
Megan Marsh 067cb1475f
Merge pull request #7967 from bdwyertech/update-aws-sdk
Update aws-sdk-go to v1.22.2
2019-08-12 16:34:28 -07:00
Brian Dwyer ecd118b6c2
Update aws-sdk-go to v1.22.2
Signed-off-by: Brian Dwyer <Brian.Dwyer@broadridge.com>
2019-08-09 13:01:30 -04:00
xiaohan.liang f4fc9dd09a Rewrite all files, remove sensitive information 2019-08-09 15:00:23 +08:00
Thomas Meckel a4d168ec4b Corrected go.mod and modules.txt 2019-07-26 12:34:24 +02:00
Megan Marsh 975ee377b2
Merge pull request #7792 from psinghal20/issue-7721
set openstack image metadata with use_blockstorage_volume
2019-07-18 11:58:01 -07:00
Marin Salinas dc0db4b322 fix: change osc builder to be passed a context for cancellation and remove conflicts 2019-07-18 09:39:08 -07:00
Marin Salinas 5535dfa03d chore: go modules integration 2019-07-18 09:39:08 -07:00
Marin Salinas c9234e12a2 add missing vendor dependencies 2019-07-18 09:39:07 -07:00
Jayson Cofell 8d842645b3 Vendor Qemu QMP builder dependencies 2019-07-10 12:30:41 -06:00
Megan Marsh 4adf265b67
Merge pull request #7822 from exoscale/feature/exoscale/post-processor
Add Exoscale Import post-processor
2019-07-03 14:01:35 -07:00
Pratyush singhal cf8bfa56f0 fix: set openstack image metadata with use_blockstorage_volume
Signed-off-by: Pratyush singhal <psinghal20@gmail.com>
2019-07-01 12:56:00 +05:30
Marc Falzon 00c2df24df Add Exoscale Import post-processor
This change adds a new `exoscale-import` post-processor allowing users
to create Private Templates on Exoscale.
2019-07-01 08:40:26 +02:00
ZhiQiang Fan 7235a4a775 feature: support data disks for tencentcloud builder
Data disk is an important feature for instances and images, this
patch implements the basic functionality of it. More work needs
to be done to make it friendly to users. Docs has pointed out
current limitation.

Also update dependencies because this feature requires new code in
tencentcloud go sdk.
2019-06-30 00:05:38 +08:00
Megan Marsh 21e35edfe2 update go mod file 2019-06-28 14:36:54 -07:00
Megan Marsh 998ef4053f parse checksum file so that we can use the checksums inside in the vmware-esxi builder stepuploadiso 2019-06-28 14:35:43 -07:00
mingsheng.su 95611695b1 update builder_test && make generate 2019-06-20 18:07:56 +08:00
Adrien Delorme 4c1abf828c
Merge branch 'master' into scrape_doc_to_builder_struct_config 2019-06-19 11:21:06 +02:00
mingsheng.su d1b9ad90c8 Merge remote-tracking branch 'origin' into feature/ucloud_builder 2019-06-18 18:17:19 +08:00
mingsheng.su 29d46b3104 update vendor about go sdk 2019-06-18 18:07:30 +08:00
Adrien Delorme 022b559c2f
Merge pull request #7755 from aerialls/proxmox-api
fix(promox): update proxmox-api-go dependency
2019-06-17 16:29:12 +02:00
Julien Brochet ab52c4f87e fix(promox): update proxmox-api-go dependency 2019-06-14 20:42:09 +02:00
Megan Marsh 352438c090 vendoring 2019-06-14 11:14:12 -07:00
mingsheng.su 787485f66f add validate project_id 2019-06-14 14:50:46 +08:00
mingsheng.su c8bab9b382 add ucloud packer 2019-06-13 15:16:49 +08:00
Adrien Delorme 6e3dc1aa9a Merge remote-tracking branch 'origin/master' into scrape_doc_to_builder_struct_config 2019-06-12 14:28:11 +02:00
Megan Marsh df916e805e borrow wrappedreadline workarounds from terraform and implement a similar check for piped commands; this makes the cli experience much cleaner 2019-06-06 13:26:07 -07:00
Adrien Delorme ee716d3f7e up go mod, go mod vendor & go mod tidy 2019-06-06 17:34:17 +02:00
Amrita Dutta 700c95c613 Update Azure SDK for Go to v30.0.0 2019-05-30 21:25:43 +00:00
Sander van Harmelen 8e4251d446 gomod: update go-cloudstack 2019-05-26 11:58:26 +02:00
Radek Simko 3e65b5dbcb
vendor: github.com/hashicorp/go-version@v1.2.0 2019-05-06 22:28:27 +01:00
Adrien Delorme b68aa40a69
Merge pull request #7567 from creack/bump-goselect2
Update vendors for s390x support. Remove Solaris support.
2019-04-30 12:02:31 +02:00
Megan Marsh e40739f332
Merge pull request #7579 from hashicorp/fix_7525
fix race condition causing hang
2019-04-29 11:03:06 -07:00
Megan Marsh 1287fcfa27 add iochan by mitchell to modules 2019-04-26 16:23:33 -07:00
Adrien Delorme 86d26ac6f1
Merge branch 'master' into bump-goselect2 2019-04-26 11:31:29 +02:00
chhaj5236 6b081cc41c
update alicloud builder to use official SDK (#7477) 2019-04-26 10:37:49 +08:00
Guillaume J. Charmes 669970717e Bump golang.org/x
Signed-off-by: Guillaume J. Charmes <gcharmes@magicleap.com>
2019-04-25 15:47:01 -04:00
Guillaume J. Charmes 40f6fcdcfd Bump goselect version to include mips/ppc/s390x
Signed-off-by: Guillaume J. Charmes <gcharmes@magicleap.com>
2019-04-25 15:40:09 -04:00
Megan Marsh e6363a1bdf
Merge pull request #7517 from hashicorp/fix_7506
fix tty related panics
2019-04-25 11:04:42 -07:00
Adrien Delorme 71c00c200f fix panic: send on closed channel
on windows: if the term is resized when ReadString is being called and no one is reading form ws, we get a panic: send on closed channel.
It could make sense to poll getconsolescreenbufferinfo calls instead of this:
something started from the sigwinch() func

on unix: same story, sigwinch was listened upon by default but if the
signals (chan sends) were not handled, this could cause a crash

fix #7434
2019-04-25 10:49:08 +02:00
amydutta bca4ecda9e update azure sdk version 2019-04-25 02:28:30 +00:00
Marques Johansson 99987c2d56 Add Linode Images builder
Packer Builder for [Linode Images](https://www.linode.com/docs/platform/disk-images/linode-images/)

Adds the following builder:

  * `linode`

Based on https://github.com/linode/packer-builder-linode (MPL/2)
(formerly maintained by @dradtke).  Includes website docs and tests.

Relates to #174, #3131
2019-04-15 20:40:59 -04:00
Adrien Delorme 97f2914c6a
Merge pull request #7484 from yandex-cloud/yandex-cloud-builder
Builder for Yandex.Cloud
2019-04-15 14:02:43 +02:00
Adrien Delorme d2f036ec44 Revert "Revert "Merge pull request #7391 from carlpett/proxmox-builder""
This reverts commit 032527ecfe.
2019-04-12 12:26:34 +02:00
Gennady Lipenkov be7e0ae4f8 go mod vendor && go mod tidy 2019-04-12 01:29:34 +03:00
Adrien Delorme 63f5bbbc73 use our own copy of iochan.LineReader 2019-04-11 14:25:24 +02:00
Adrien Delorme 032527ecfe Revert "Merge pull request #7391 from carlpett/proxmox-builder"
This reverts commit b7d62b2ae0, reversing
changes made to c36eaf16f7.
2019-04-11 14:19:25 +02:00
Adrien Delorme 2f97dc2933 go mod vendor && go mod tidy 2019-04-11 14:19:24 +02:00
Adrien Delorme 2a90ce6178 packer communicator: use iochan.LineReader instead of iochan.LineReader(in)
* as it's the recommended way
2019-04-08 20:09:21 +02:00
Adrien Delorme f0295a7ca3 fix tty to avoid panic after resizing term near exit time 2019-04-02 10:18:46 +02:00
Adrien Delorme 2bfd1f7c74 don't ENABLE_PROCESSED_INPUT on windows
( just updating go deps )
2019-03-22 14:24:52 +01:00
Adrien Delorme 9f82b75e57 Use the hashicorp/go-getter to download files
* removed packer.Cache and references since packer.Cache is never used except in the download step. The download step now uses the new func packer.CachePath(targetPath) for this, the behavior is the same.
* removed download code from packer that was reimplemented into the go-getter library: progress bar, http download restart, checksuming from file, skip already downloaded files, symlinking, make a download cancellable by context.
* on windows if packer is running without symlinking rights and we are getting a local file, the file will be copied instead to avoid errors.
* added unit tests for step_download that are now CI tested on windows, mac & linux.
* files are now downloaded under cache dir `sha1(filename + "?checksum=" + checksum) + file_extension`
* since the output dir is based on the source url and the checksum, when the checksum fails, the file is auto deleted.
* a download file is protected and locked by a file lock,
* updated docs
* updated go modules and vendors
2019-03-13 12:11:58 +01:00
Megan Marsh 6e442e616c
Merge pull request #7352 from hashicorp/research_7299
use a tty to ui.Ask
2019-03-07 09:47:01 -08:00
Megan Marsh 5aeab4ec06
Merge pull request #7300 from kmbulebu/openstack_app_creds
OpenStack: Support Application Credential Authentication
2019-03-05 13:11:51 -08:00