6428 Commits

Author SHA1 Message Date
James Nugent
36c09af992 builder/amazon: Add tests for the ebs-volume builder
These smoke tests are effectively a mirror of the EBS builder tests.
2016-11-02 12:56:39 -04:00
James Nugent
b1ff8c3bfc builder/amazon: Add ebs-volume builder
This commit adds a builder that works like EBS builders, except does not
create an AMI, and instead is intended to create EBS volumes in an
initialized state. For example, the following template can be used to
create and export a set of 3 EBS Volumes in a ZFS zpool named `data` for
importing by instances running production systems:

```
{
	"variables": {
		"aws_access_key_id": "{{ env `AWS_ACCESS_KEY_ID` }}",
		"aws_secret_access_key": "{{ env `AWS_SECRET_ACCESS_KEY` }}",
		"region": "{{ env `AWS_REGION` }}",
		"source_ami": "{{ env `PACKER_SOURCE_AMI` }}",
		"vpc_id": "{{ env `PACKER_VPC_ID` }}",
		"subnet_id": "{{ env `PACKER_SUBNET_ID` }}"
	},
	"builders": [{
		"type": "amazon-ebs-volume",
		"access_key": "{{ user `aws_access_key_id` }}",
		"secret_key": "{{ user `aws_secret_access_key` }}",
		"region": "{{user `region`}}",
		"spot_price_auto_product": "Linux/UNIX (Amazon VPC)",

		"ssh_pty": true,
		"instance_type": "t2.medium",
		"vpc_id": "{{user `vpc_id` }}",
		"subnet_id": "{{user `subnet_id` }}",
		"associate_public_ip_address": true,
		"source_ami": "{{user `source_ami` }}",
		"ssh_username": "ubuntu",
		"ssh_timeout": "5m",

		"ebs_volumes": [
			{
				"device_name": "/dev/xvdf",
				"delete_on_termination": false,
				"volume_size": 10,
				"volume_type": "gp2",
				"tags": {
					"Name": "TeamCity-Data1",
					"zpool": "data",
					"Component": "TeamCity"
				}
			},
			{
				"device_name": "/dev/xvdg",
				"delete_on_termination": false,
				"volume_size": 10,
				"volume_type": "gp2",
				"tags": {
					"Name": "TeamCity-Data2",
					"zpool": "data",
					"Component": "TeamCity"
				}
			},
			{
				"device_name": "/dev/xvdh",
				"delete_on_termination": false,
				"volume_size": 10,
				"volume_type": "gp2",
				"tags": {
					"Name": "TeamCity-Data3",
					"zpool": "data",
					"Component": "TeamCity"
				}
			}
		]
	}],
	"provisioners": [
	{
		"type": "shell",
		"start_retry_timeout": "10m",
		"inline": [
			"DEBIAN_FRONTEND=noninteractive sudo apt-get update",
			"DEBIAN_FRONTEND=noninteractive sudo apt-get install -y zfs",
			"lsblk",
			"sudo parted /dev/xvdf --script mklabel GPT",
			"sudo parted /dev/xvdg --script mklabel GPT",
			"sudo parted /dev/xvdh --script mklabel GPT",
			"sudo zpool create -m none data raidz xvdf xvdg xvdh",
			"sudo zpool status",
			"sudo zpool export data",
			"sudo zpool status"
		]
	}
	]
}
```

StepModifyInstance and StepStopInstance are now shared between EBS and
EBS-Volume builders - move them into the AWS common directory and rename
them to indicate that they only apply to EBS-backed builders.
2016-11-02 12:56:39 -04:00
Matthew Hooker
3ee8cbc1f1 update changelog 2016-11-01 17:28:23 -07:00
Matthew Hooker
970b37077e Merge pull request #4050 from jen20/ssh-agent
builder/amazon: Allow use of local SSH Agent
2016-11-01 17:27:37 -07:00
Matthew Hooker
d920b3fbf4 run gofmt 2016-11-01 14:08:04 -07:00
Matthew Hooker
32c0fef4c1 Merge pull request #4092 from mitchellh/gofmt
Gofmt
2016-11-01 14:07:41 -07:00
Matthew Hooker
9cf65d8e1b say when we finish checking gofmt 2016-11-01 14:07:05 -07:00
Matthew Hooker
3a79620e92 fail test target if we have gofmt problems 2016-11-01 14:07:00 -07:00
Matthew Hooker
b8893e1aa4 fix fmt and add check 2016-11-01 13:48:10 -07:00
Matthew Hooker
b74b7548f4 remove fmt as test dependency 2016-11-01 13:16:23 -07:00
Matthew Hooker
952f5a6ae7 Merge pull request #4038 from dacamp/gofmt
make fmt
2016-11-01 13:15:13 -07:00
Matthew Hooker
c2d7d420f9 fix broken link 2016-11-01 11:16:47 -07:00
Matthew Hooker
fcca905d40 Merge pull request #4085 from mitchellh/sethvargo/security
Add security page
2016-10-31 17:38:11 -07:00
Matthew Hooker
064f48bf39 update changelog 2016-10-31 16:45:06 -07:00
Matthew Hooker
0dd7d7ff3b fix error message 2016-10-31 16:44:18 -07:00
Ganesh kumar Sankaran
b9c6139d67 AWS async operations sometimes takes long times, if there are multiple parallel builds, polling at 2 second frequency will exceed the request limit. Allow 2 seconds to be overwritten with AWS_POLL_DELAY_SECONDS 2016-10-31 16:44:18 -07:00
Matthew Hooker
8594822e24 update changelog 2016-10-31 15:47:12 -07:00
Matthew Hooker
01be917450 Merge pull request #3660 from StackPointCloud/packer-builder-profitbricks
Packer Builder ProfitBricks
2016-10-31 15:45:24 -07:00
Matthew Hooker
7646942430 add cloudstack builder to changelog 2016-10-31 13:39:15 -07:00
Matthew Hooker
93f0436766 Merge pull request #3909 from svanharmelen/f-cloudstack-builder
Add a CloudStack builder
2016-10-31 13:34:20 -07:00
Matthew Hooker
42bae09fb0 update changelog 2016-10-31 13:02:29 -07:00
Matthew Hooker
f69ee4634f Merge pull request #4041 from mitchellh/vmwareshutdown
VIP: VMware shutdown fails
2016-10-31 11:37:00 -07:00
Seth Vargo
5c3259b2d2
Add security page 2016-10-29 14:16:06 -04:00
Chris Bednarski
999a0968f5 Merge pull request #4080 from rickard-von-essen/issue-4057
Properly cleanup AWS temporary key pairs
2016-10-28 13:25:44 -07:00
Rickard von Essen
4eaec76827 Merge pull request #4082 from geerlingguy/packer-compile-readme-fix
Fixes #4081: Fix broken README link for 'compile Packer yourself'.
2016-10-28 06:22:39 +02:00
Jeff Geerling
8ca9f633d3 Fixes #4081: Fix broken README link for 'compile Packer yourself'. 2016-10-27 22:31:57 -05:00
Rickard von Essen
d66490ebfd
Properly cleanup AWS temporary key pairs
Closes #4057 - Amazon key pair no longer cleaned up at end of build
2016-10-27 23:06:13 +02:00
Rickard von Essen
252cc4cd1c Updated CHANGELOG.md 2016-10-27 22:30:57 +02:00
Rickard von Essen
beeefc6b44 Merge pull request #4069 from rickard-von-essen/revert-3371
Revert "Removed escaped quotes in non-elevated powershell invocation"
2016-10-27 22:26:25 +02:00
Rickard von Essen
0e7eac7546 Merge pull request #4075 from artburkart/update-aws-chroot-docs
Updates root_volume_size documentation
2016-10-27 08:10:12 +02:00
Rickard von Essen
4b06d7d20c Merge pull request #4072 from MaximF/patch-1
Fixed typo at chef-solo.html.md
2016-10-27 06:41:05 +02:00
Arthur Burkart
3eaa8a2dc3 Updates root_volume_size documentation
It didn't indicate its unit of size (GB), the default value was not
indicated, the fact that it ignores the user-given size when it is
smaller than the source AMI's snapshot size, and the fact that the
value is required when `from_scratch` is `true` all needed to be added.
2016-10-27 00:20:45 -04:00
Maxim Fedchyshyn
77efbe572d Fixed typo at chef-solo.html.md 2016-10-26 16:41:53 -07:00
Rickard von Essen
f17bd30070 Revert "Removed escaped quotes in non-elevated powershell invocation"
This reverts commit 1b186f16136d0c1c012108ca9873ca0e2e7d3d5d.
2016-10-26 21:12:11 +02:00
Rickard von Essen
d3e3889559 Merge pull request #4065 from ksatirli/patch-2
fixes identifier for launch_device_mappings
2016-10-26 21:05:51 +02:00
Rickard von Essen
574fb995b0 Merge pull request #4067 from jrnt30/website-updates
- Adding in links for new post-processors missing

(And removed some trailing spaces)
2016-10-26 20:44:44 +02:00
Rickard von Essen
efb591323f Merge pull request #4064 from tylert/env-vars-doc-typo-fix
Improve clarity of environment vars doc PACKER_LOG setting
2016-10-26 20:42:27 +02:00
Rickard von Essen
8f7e48ec12 Merge pull request #4068 from tylert/post-proc-doc-consist
Match title capitalization of compress to other post-processors
2016-10-26 20:38:16 +02:00
Tyler Tidman
5b25ba655b Match title capitalization of compress to other post-processors 2016-10-26 14:18:47 -04:00
Justin Nauman
38bf53ed84 - Adding in links for new post-processors missing 2016-10-26 12:27:07 -05:00
Kerim Satirli
723a4a1a53 fixes identifier for launch_device_mappings
Hi!

I believe the **Note** to reference an incorrect variable: `launch_device_mappings `; this should be `launch_block_device_mappings` as far as I can tell from the [code](https://github.com/mitchellh/packer/search?utf8=%E2%9C%93&q=launch_block_device_mappings).
2016-10-26 16:38:26 +02:00
Tyler Tidman
e15a169831 Improve clarity of environment vars doc PACKER_LOG setting 2016-10-26 09:54:05 -04:00
Rickard von Essen
a66d125fc9 Update CHANGELOG.md 2016-10-25 21:26:38 +02:00
Rickard von Essen
d16d5d9686 Merge pull request #3817 from ChrisLundquist/dynamic-source-ami
Dynamic source ami
2016-10-25 21:24:41 +02:00
Rickard von Essen
3ced7513ff Merge pull request #4059 from jinesh-choksi/patch-1
Packer v0.11.0 requires "ec2:DescribeSecurityGroups" permissions to work
2016-10-25 17:41:42 +02:00
Jinesh Choksi
0f4d2341cb Packer v0.11.0 requires "ec2:DescribeSecurityGroups" permissions to work
Without the "ec2:DescribeSecurityGroups" permission, you would get the following error:

2016/10/25 16:03:28 ui: ==> aws: Creating temporary security group for this instance...
2016/10/25 16:03:28 packer.exe: 2016/10/25 16:03:28 Temporary group name: packer 580f7440-2135-068c-99b7-35595a7522d1
2016/10/25 16:03:28 ui: ==> aws: Authorizing access to port 22 the temporary security group...
2016/10/25 16:03:28 packer.exe: 2016/10/25 16:03:28 [DEBUG] Describing tempSecurityGroup to ensure it is available: sg-38e0355e
2016/10/25 16:03:29 packer.exe: 2016/10/25 16:03:29 [DEBUG] Error in querying security group UnauthorizedOperation: You are not authorized to perform this operation.
2016/10/25 16:03:29 packer.exe: 	status code: 403, request id: bc664eff-cc01-42c1-8408-23493c11d92d
2016-10-25 16:27:20 +01:00
Rickard von Essen
7a51e68091 Merge pull request #4058 from richardowen/patch-1
Fix typo in encrypted ami step log message
2016-10-25 17:20:37 +02:00
Richard Owen
adddc60a1d Fix typo in encrypted ami step log message 2016-10-25 16:01:01 +01:00
James Nugent
395d88941c amazon: Allow SSH Agent auth for existing key pair
This commit allows SSH Agent authentication to be used with an existing
key pair defined in AWS.
2016-10-23 22:26:14 -05:00
James Nugent
7425fef2c7 builder/amazon: Allow use of local SSH Agent
This commit adds an option to use the local SSH Agent to authenticate
connections to source instances started by the the EBS and Instance
Store builders.

This is of use when the source AMI _already_ has configuration for
authorized SSH keys - for example if one uses an SSH certificate
authority.

A further extension (not implemented in this commit) is to allow SSH
agent use with a pre-defined key pair, in order to allow keys with
passphrases to be used without giving the passphrase to Packer.
2016-10-23 21:43:47 -05:00