1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145
|
require 'rake'
require 'open3'
require 'json'
require 'parser/current'
task :release_test do
modules_to_test = [
'puppetlabs/puppetlabs-apt',
'puppetlabs/puppetlabs-tomcat',
'puppetlabs/puppetlabs-apache',
'puppetlabs/puppetlabs-mysql',
'puppetlabs/puppetlabs-ntp',
'puppetlabs/puppetlabs-acl',
'puppetlabs/puppetlabs-chocolatey',
'voxpupuli/puppet-archive',
'voxpupuli/puppet-collectd',
'garethr/garethr-docker',
'sensu/sensu-puppet',
'jenkinsci/puppet-jenkins',
'rnelson0/puppet-local_user',
]
Bundler.with_clean_env do
FileUtils.mkdir_p('tmp')
Dir.chdir('tmp') do
modules_to_test.each do |module_name|
puts "Testing #{module_name}..."
module_dir = File.basename(module_name)
if File.directory?(module_dir)
Dir.chdir(module_dir) do
print ' Updating repository... '
_, status = Open3.capture2e('git', 'pull', '--rebase')
if status.success?
puts 'Done'
else
puts 'FAILED'
next
end
end
else
print ' Cloning repository... '
_, status = Open3.capture2e('git', 'clone', "https://github.com/#{module_name}")
if status.success?
puts 'Done'
else
puts 'FAILED'
next
end
end
Dir.chdir(module_dir) do
print ' Installing dependencies... '
bundle_install_output, status = Open3.capture2e('bundle', 'install', '--path', '../vendor/gems')
if status.success?
puts 'Done'
else
puts 'FAILED'
puts bundle_install_output
next
end
print ' Running baseline tests... '
baseline_output, _, status = Open3.capture3({'SPEC_OPTS' => '--format json'}, 'bundle', 'exec', 'rake', 'spec')
if status.success?
puts 'Done'
else
puts 'Done (tests failed)'
end
print ' Updating Gemfile to use rspec-puppet HEAD... '
buffer = Parser::Source::Buffer.new('Gemfile')
buffer.source = File.read('Gemfile')
parser = Parser::CurrentRuby.new
ast = parser.parse(buffer)
modified_gemfile = GemfileRewrite.new.rewrite(buffer, ast)
gem_root = File.expand_path(File.join(__FILE__, '..', '..', '..', '..'))
if modified_gemfile == buffer.source
File.open('Gemfile', 'a') do |f|
f.puts "gem 'rspec-puppet', :path => '#{gem_root}'"
end
else
File.open('Gemfile', 'w') do |f|
f.puts modified_gemfile
end
end
puts 'Done'
print ' Installing dependencies... '
_, status = Open3.capture2e('bundle', 'install', '--path', '../vendor/gems')
if status.success?
puts 'Done'
else
puts "FAILED"
next
end
print ' Running tests against rspec-puppet HEAD... '
head_output, _, status = Open3.capture3({'SPEC_OPTS' => '--format json'}, 'bundle', 'exec', 'rake', 'spec')
if status.success?
puts 'Done'
else
puts 'Done (tests failed)'
end
print ' Restoring Gemfile... '
_, status = Open3.capture2e('git', 'checkout', '--', 'Gemfile')
if status.success?
puts 'Done'
else
puts 'FAILED'
end
json_regex = %r{\{(?:[^{}]|(?:\g<0>))*\}}x
baseline_results = JSON.parse(baseline_output.scan(json_regex).find { |r| r.include?('summary_line') })
head_results = JSON.parse(head_output.scan(json_regex).find { |r| r.include?('summary_line') })
if head_results['summary_line'] == baseline_results['summary_line']
puts " PASS: #{head_results['summary_line']}"
else
puts "!!FAILED: baseline:(#{baseline_results['summary_line']}) head:(#{head_results['summary_line']})"
end
end
end
end
end
end
class GemfileRewrite < Parser::TreeRewriter
def on_send(node)
_, method_name, *args = *node
if method_name == :gem
gem_name = args.first
if gem_name.type == :str && gem_name.children.first == 'rspec-puppet'
gem_root = File.expand_path(File.join(__FILE__, '..', '..', '..', '..'))
replace(node.location.expression, "gem 'rspec-puppet', :path => '#{gem_root}'")
end
end
super
end
end
|