Use the hashicorp/go-getter to download files
* removed packer.Cache and references since packer.Cache is never used except in the download step. The download step now uses the new func packer.CachePath(targetPath) for this, the behavior is the same.
* removed download code from packer that was reimplemented into the go-getter library: progress bar, http download restart, checksuming from file, skip already downloaded files, symlinking, make a download cancellable by context.
* on windows if packer is running without symlinking rights and we are getting a local file, the file will be copied instead to avoid errors.
* added unit tests for step_download that are now CI tested on windows, mac & linux.
* files are now downloaded under cache dir `sha1(filename + "?checksum=" + checksum) + file_extension`
* since the output dir is based on the source url and the checksum, when the checksum fails, the file is auto deleted.
* a download file is protected and locked by a file lock,
* updated docs
* updated go modules and vendors
2019-03-13 07:11:58 -04:00
|
|
|
// Copyright 2018, OpenCensus Authors
|
|
|
|
//
|
|
|
|
// Licensed under the Apache License, Version 2.0 (the "License");
|
|
|
|
// you may not use this file except in compliance with the License.
|
|
|
|
// You may obtain a copy of the License at
|
|
|
|
//
|
|
|
|
// http://www.apache.org/licenses/LICENSE-2.0
|
|
|
|
//
|
|
|
|
// Unless required by applicable law or agreed to in writing, software
|
|
|
|
// distributed under the License is distributed on an "AS IS" BASIS,
|
|
|
|
// WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
|
|
|
|
// See the License for the specific language governing permissions and
|
|
|
|
// limitations under the License.
|
|
|
|
//
|
|
|
|
|
|
|
|
package stats
|
|
|
|
|
|
|
|
import (
|
|
|
|
"context"
|
|
|
|
|
2019-05-30 17:25:43 -04:00
|
|
|
"go.opencensus.io/metric/metricdata"
|
Use the hashicorp/go-getter to download files
* removed packer.Cache and references since packer.Cache is never used except in the download step. The download step now uses the new func packer.CachePath(targetPath) for this, the behavior is the same.
* removed download code from packer that was reimplemented into the go-getter library: progress bar, http download restart, checksuming from file, skip already downloaded files, symlinking, make a download cancellable by context.
* on windows if packer is running without symlinking rights and we are getting a local file, the file will be copied instead to avoid errors.
* added unit tests for step_download that are now CI tested on windows, mac & linux.
* files are now downloaded under cache dir `sha1(filename + "?checksum=" + checksum) + file_extension`
* since the output dir is based on the source url and the checksum, when the checksum fails, the file is auto deleted.
* a download file is protected and locked by a file lock,
* updated docs
* updated go modules and vendors
2019-03-13 07:11:58 -04:00
|
|
|
"go.opencensus.io/stats/internal"
|
|
|
|
"go.opencensus.io/tag"
|
|
|
|
)
|
|
|
|
|
|
|
|
func init() {
|
|
|
|
internal.SubscriptionReporter = func(measure string) {
|
|
|
|
mu.Lock()
|
|
|
|
measures[measure].subscribe()
|
|
|
|
mu.Unlock()
|
|
|
|
}
|
|
|
|
}
|
|
|
|
|
2019-05-30 17:25:43 -04:00
|
|
|
type recordOptions struct {
|
|
|
|
attachments metricdata.Attachments
|
|
|
|
mutators []tag.Mutator
|
|
|
|
measurements []Measurement
|
|
|
|
}
|
|
|
|
|
|
|
|
// WithAttachments applies provided exemplar attachments.
|
|
|
|
func WithAttachments(attachments metricdata.Attachments) Options {
|
|
|
|
return func(ro *recordOptions) {
|
|
|
|
ro.attachments = attachments
|
|
|
|
}
|
|
|
|
}
|
|
|
|
|
|
|
|
// WithTags applies provided tag mutators.
|
|
|
|
func WithTags(mutators ...tag.Mutator) Options {
|
|
|
|
return func(ro *recordOptions) {
|
|
|
|
ro.mutators = mutators
|
|
|
|
}
|
|
|
|
}
|
|
|
|
|
|
|
|
// WithMeasurements applies provided measurements.
|
|
|
|
func WithMeasurements(measurements ...Measurement) Options {
|
|
|
|
return func(ro *recordOptions) {
|
|
|
|
ro.measurements = measurements
|
|
|
|
}
|
|
|
|
}
|
|
|
|
|
|
|
|
// Options apply changes to recordOptions.
|
|
|
|
type Options func(*recordOptions)
|
|
|
|
|
|
|
|
func createRecordOption(ros ...Options) *recordOptions {
|
|
|
|
o := &recordOptions{}
|
|
|
|
for _, ro := range ros {
|
|
|
|
ro(o)
|
|
|
|
}
|
|
|
|
return o
|
|
|
|
}
|
|
|
|
|
Use the hashicorp/go-getter to download files
* removed packer.Cache and references since packer.Cache is never used except in the download step. The download step now uses the new func packer.CachePath(targetPath) for this, the behavior is the same.
* removed download code from packer that was reimplemented into the go-getter library: progress bar, http download restart, checksuming from file, skip already downloaded files, symlinking, make a download cancellable by context.
* on windows if packer is running without symlinking rights and we are getting a local file, the file will be copied instead to avoid errors.
* added unit tests for step_download that are now CI tested on windows, mac & linux.
* files are now downloaded under cache dir `sha1(filename + "?checksum=" + checksum) + file_extension`
* since the output dir is based on the source url and the checksum, when the checksum fails, the file is auto deleted.
* a download file is protected and locked by a file lock,
* updated docs
* updated go modules and vendors
2019-03-13 07:11:58 -04:00
|
|
|
// Record records one or multiple measurements with the same context at once.
|
|
|
|
// If there are any tags in the context, measurements will be tagged with them.
|
|
|
|
func Record(ctx context.Context, ms ...Measurement) {
|
2019-05-30 17:25:43 -04:00
|
|
|
RecordWithOptions(ctx, WithMeasurements(ms...))
|
|
|
|
}
|
|
|
|
|
|
|
|
// RecordWithTags records one or multiple measurements at once.
|
|
|
|
//
|
|
|
|
// Measurements will be tagged with the tags in the context mutated by the mutators.
|
|
|
|
// RecordWithTags is useful if you want to record with tag mutations but don't want
|
|
|
|
// to propagate the mutations in the context.
|
|
|
|
func RecordWithTags(ctx context.Context, mutators []tag.Mutator, ms ...Measurement) error {
|
|
|
|
return RecordWithOptions(ctx, WithTags(mutators...), WithMeasurements(ms...))
|
|
|
|
}
|
|
|
|
|
|
|
|
// RecordWithOptions records measurements from the given options (if any) against context
|
|
|
|
// and tags and attachments in the options (if any).
|
|
|
|
// If there are any tags in the context, measurements will be tagged with them.
|
|
|
|
func RecordWithOptions(ctx context.Context, ros ...Options) error {
|
|
|
|
o := createRecordOption(ros...)
|
|
|
|
if len(o.measurements) == 0 {
|
|
|
|
return nil
|
|
|
|
}
|
Use the hashicorp/go-getter to download files
* removed packer.Cache and references since packer.Cache is never used except in the download step. The download step now uses the new func packer.CachePath(targetPath) for this, the behavior is the same.
* removed download code from packer that was reimplemented into the go-getter library: progress bar, http download restart, checksuming from file, skip already downloaded files, symlinking, make a download cancellable by context.
* on windows if packer is running without symlinking rights and we are getting a local file, the file will be copied instead to avoid errors.
* added unit tests for step_download that are now CI tested on windows, mac & linux.
* files are now downloaded under cache dir `sha1(filename + "?checksum=" + checksum) + file_extension`
* since the output dir is based on the source url and the checksum, when the checksum fails, the file is auto deleted.
* a download file is protected and locked by a file lock,
* updated docs
* updated go modules and vendors
2019-03-13 07:11:58 -04:00
|
|
|
recorder := internal.DefaultRecorder
|
|
|
|
if recorder == nil {
|
2019-05-30 17:25:43 -04:00
|
|
|
return nil
|
Use the hashicorp/go-getter to download files
* removed packer.Cache and references since packer.Cache is never used except in the download step. The download step now uses the new func packer.CachePath(targetPath) for this, the behavior is the same.
* removed download code from packer that was reimplemented into the go-getter library: progress bar, http download restart, checksuming from file, skip already downloaded files, symlinking, make a download cancellable by context.
* on windows if packer is running without symlinking rights and we are getting a local file, the file will be copied instead to avoid errors.
* added unit tests for step_download that are now CI tested on windows, mac & linux.
* files are now downloaded under cache dir `sha1(filename + "?checksum=" + checksum) + file_extension`
* since the output dir is based on the source url and the checksum, when the checksum fails, the file is auto deleted.
* a download file is protected and locked by a file lock,
* updated docs
* updated go modules and vendors
2019-03-13 07:11:58 -04:00
|
|
|
}
|
|
|
|
record := false
|
2019-05-30 17:25:43 -04:00
|
|
|
for _, m := range o.measurements {
|
2019-04-20 19:53:34 -04:00
|
|
|
if m.desc.subscribed() {
|
Use the hashicorp/go-getter to download files
* removed packer.Cache and references since packer.Cache is never used except in the download step. The download step now uses the new func packer.CachePath(targetPath) for this, the behavior is the same.
* removed download code from packer that was reimplemented into the go-getter library: progress bar, http download restart, checksuming from file, skip already downloaded files, symlinking, make a download cancellable by context.
* on windows if packer is running without symlinking rights and we are getting a local file, the file will be copied instead to avoid errors.
* added unit tests for step_download that are now CI tested on windows, mac & linux.
* files are now downloaded under cache dir `sha1(filename + "?checksum=" + checksum) + file_extension`
* since the output dir is based on the source url and the checksum, when the checksum fails, the file is auto deleted.
* a download file is protected and locked by a file lock,
* updated docs
* updated go modules and vendors
2019-03-13 07:11:58 -04:00
|
|
|
record = true
|
|
|
|
break
|
|
|
|
}
|
|
|
|
}
|
|
|
|
if !record {
|
2019-05-30 17:25:43 -04:00
|
|
|
return nil
|
Use the hashicorp/go-getter to download files
* removed packer.Cache and references since packer.Cache is never used except in the download step. The download step now uses the new func packer.CachePath(targetPath) for this, the behavior is the same.
* removed download code from packer that was reimplemented into the go-getter library: progress bar, http download restart, checksuming from file, skip already downloaded files, symlinking, make a download cancellable by context.
* on windows if packer is running without symlinking rights and we are getting a local file, the file will be copied instead to avoid errors.
* added unit tests for step_download that are now CI tested on windows, mac & linux.
* files are now downloaded under cache dir `sha1(filename + "?checksum=" + checksum) + file_extension`
* since the output dir is based on the source url and the checksum, when the checksum fails, the file is auto deleted.
* a download file is protected and locked by a file lock,
* updated docs
* updated go modules and vendors
2019-03-13 07:11:58 -04:00
|
|
|
}
|
2019-05-30 17:25:43 -04:00
|
|
|
if len(o.mutators) > 0 {
|
|
|
|
var err error
|
|
|
|
if ctx, err = tag.New(ctx, o.mutators...); err != nil {
|
|
|
|
return err
|
|
|
|
}
|
Use the hashicorp/go-getter to download files
* removed packer.Cache and references since packer.Cache is never used except in the download step. The download step now uses the new func packer.CachePath(targetPath) for this, the behavior is the same.
* removed download code from packer that was reimplemented into the go-getter library: progress bar, http download restart, checksuming from file, skip already downloaded files, symlinking, make a download cancellable by context.
* on windows if packer is running without symlinking rights and we are getting a local file, the file will be copied instead to avoid errors.
* added unit tests for step_download that are now CI tested on windows, mac & linux.
* files are now downloaded under cache dir `sha1(filename + "?checksum=" + checksum) + file_extension`
* since the output dir is based on the source url and the checksum, when the checksum fails, the file is auto deleted.
* a download file is protected and locked by a file lock,
* updated docs
* updated go modules and vendors
2019-03-13 07:11:58 -04:00
|
|
|
}
|
2019-05-30 17:25:43 -04:00
|
|
|
recorder(tag.FromContext(ctx), o.measurements, o.attachments)
|
Use the hashicorp/go-getter to download files
* removed packer.Cache and references since packer.Cache is never used except in the download step. The download step now uses the new func packer.CachePath(targetPath) for this, the behavior is the same.
* removed download code from packer that was reimplemented into the go-getter library: progress bar, http download restart, checksuming from file, skip already downloaded files, symlinking, make a download cancellable by context.
* on windows if packer is running without symlinking rights and we are getting a local file, the file will be copied instead to avoid errors.
* added unit tests for step_download that are now CI tested on windows, mac & linux.
* files are now downloaded under cache dir `sha1(filename + "?checksum=" + checksum) + file_extension`
* since the output dir is based on the source url and the checksum, when the checksum fails, the file is auto deleted.
* a download file is protected and locked by a file lock,
* updated docs
* updated go modules and vendors
2019-03-13 07:11:58 -04:00
|
|
|
return nil
|
|
|
|
}
|