1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102
|
#!/bin/sh
# PCP QA Test No. 1355
# Exercise pmproxy key server reconnect.
#
# Copyright (c) 2021 Red Hat. All Rights Reserved.
#
seq=`basename $0`
echo "QA output created by $seq"
# get standard environment, filters and checks
. ./common.python
. ./common.keys
_check_python3 # needed by ./src/key_server_proxy.py
_check_key_server_version_offline
_cleanup()
{
cd $here
echo "_cleanup ..." >>$seq_full
$PCP_PS_PROG $PCP_PS_ALL_FLAGS | grep "$key_server[ ]" >>$seq_full
echo "key_server_pid=$key_server_pid pmproxy_pid=$pmproxy_pid keysproxy_pid=$keysproxy_pid" >>$seq_full
[ -n "$key_server_pid" ] && $signal -s TERM $key_server_pid
[ -n "$pmproxy_pid" ] && $signal -s TERM $pmproxy_pid
[ -n "$keysproxy_pid" ] && $signal -s TERM $keysproxy_pid
$PCP_PS_PROG $PCP_PS_ALL_FLAGS | grep "$key_server[ ]" >>$seq_full
$sudo rm -rf $tmp $tmp.*
}
status=0 # success is the default!
signal=$PCP_BINADM_DIR/pmsignal
username=`id -u -n`
trap "_cleanup; exit \$status" 0 1 2 3 15
_filter_pmproxy_log()
{
sed -e 's/, command keys//g' | \
sed -e 's/^.*Info: Key /key /g' | \
sed -e 's/LOADING .* is loading/loading/g' | \
grep -oE "Lost connection.+|Trying to connect to .+|Cannot connect to .+|.+ setup"
}
# real QA test starts here
echo "Start key server"
key_server_port=`_find_free_port`
$key_server --port $key_server_port --save "" > $tmp.keys.log 2>&1 &
key_server_pid=$!
_wait_for_port $key_server_port || _exit 1
echo "Start key server proxy to fake loading error for first 3 seconds"
keysproxyport=`_find_free_port`
$python src/key_server_proxy.py --loading_delay 3 127.0.0.1:$keysproxyport 127.0.0.1:$key_server_port > $tmp.keysproxy.log &
keysproxy_pid=$!
_wait_for_port $keysproxyport || _exit 1
echo "Start pmproxy"
pmproxyport=`_find_free_port`
pmproxy -f -U $username -x $tmp.err -l $tmp.pmproxy.log -p $pmproxyport -r $keysproxyport -t &
pmproxy_pid=$!
_wait_for_port $pmproxyport || _exit 1
echo
echo "== Observe a loading error and reconnect"
curl -m 1 -o /dev/null -s "http://localhost:$pmproxyport/series/query?expr=hinv.ncpu"
sleep 5
lineno=1
tail -n +$lineno $tmp.pmproxy.log | _filter_pmproxy_log
lineno=$((`wc -l < $tmp.pmproxy.log` + 1))
echo
echo "Stop key server proxy"
$signal -s TERM $keysproxy_pid
echo
echo "== Observe a connection lost error and failed reconnect"
curl -m 1 -o /dev/null -s "http://localhost:$pmproxyport/series/query?expr=hinv.ncpu"
sleep 5
tail -n +$lineno $tmp.pmproxy.log | _filter_pmproxy_log
lineno=$((`wc -l < $tmp.pmproxy.log` + 1))
echo
echo "Start key server proxy again (loading error for first 3 seconds)"
$python src/key_server_proxy.py --loading_delay 3 127.0.0.1:$keysproxyport 127.0.0.1:$key_server_port > $tmp.keysproxy.log &
keysproxy_pid=$!
_wait_for_port $keysproxyport || _exit 1
echo
echo "== Observe a reconnect"
curl -m 1 -o /dev/null -s "http://localhost:$pmproxyport/series/query?expr=hinv.ncpu"
sleep 5
tail -n +$lineno $tmp.pmproxy.log | _filter_pmproxy_log
lineno=$((`wc -l < $tmp.pmproxy.log` + 1))
# store all logs in $seq_full
tail -n +1 $tmp.*.log > $seq_full
# success, all done
exit
|