PERFORMANCETEST SUMMARY FOR PROJECT foo

Testrun ID: 2020.07.10.01.51.24

 Help on report evaluation

Specification

CommentGegenereerd vanuit de TestStraat
 
Application version
Workloadproductie
LoadgeneratorJMeter
Start of the test2020.07.10.01.51.24
Report generated2020.07.10.02.53.01
 
Baseline version
Baseline used2019.02.27.02.34.38
Baseline reasonspecified
 
Max trend items14

Thresholds

Transaction name patternWARNINGHIGH
generic0,10,8
foo_T\d\d0,81,0
foo_Beheer_\d\d0,81,0
foo_02_bar_large120,0180,0
foo_03_bar_large120,0180,0
foo_04_bar_large120,0180,0
foo_02_bar2,43,0
foo_03_bar_small2,43,0
foo_04_bar_small2,43,0
foo_05_bar_small2,43,0
foo_02_bar_medium4,05,0
foo_03_bar_medium4,05,0
foo_04_bar_medium4,05,0
foo_05_bar_medium4,05,0
foo_05_bar_large120,0180,0
*

History

TestrunBaselineVersionDurationFaults (%)
2020.06.18.01.54.362019.02.27.02.34.38-01:00:010,00
2020.06.19.01.54.452019.02.27.02.34.38-01:00:010,00
2020.06.23.02.08.512019.02.27.02.34.38-01:00:000,00
2020.06.24.01.54.432019.02.27.02.34.38-00:10:250,00
2020.06.25.01.54.352019.02.27.02.34.38-01:00:000,00
2020.06.26.02.07.462019.02.27.02.34.38-01:00:000,00
2020.06.30.01.54.402019.02.27.02.34.38-01:00:010,00
2020.07.01.01.54.442019.02.27.02.34.38-00:35:240,00
2020.07.02.01.54.402019.02.27.02.34.38-01:00:010,00
2020.07.03.02.30.362019.02.27.02.34.38-01:00:010,00
2020.07.07.02.33.522019.02.27.02.34.38-01:00:010,00
2020.07.08.01.55.542019.02.27.02.34.38-00:16:240,00
2020.07.09.02.32.402019.02.27.02.34.38-01:00:000,00
2020.07.10.01.51.242019.02.27.02.34.38-01:00:010,00

Legend

Paragraph Summary Only transactions containing pattern '<2 digit number>_' are evaluated
Metric Threshold violations Number of transactions exceeding 'red' threshold
Metric Baseline warnings Number of 'red' transactions in column Delta%
Metric Trendbreak 'scalability' Percentage of (max) users at which ramp-up of throughput breaks
Metric Trendbreak 'stability' Progress of test at which stability of throughput or errorcount breaks
Paragraph Response timesOnly transactions in Transactions.csv are evaluated
Column EvaluatedRequirements are evaluated against this value
Column BaselineBaseline's measurement (evaluated value)
Column CurrentThis session's measurement (evaluated value)
Column Delta % Difference between current and baseline, in % compared to the baseline
Shows if current or baseline exceeds YELLOW or RED a threshold
AND difference is >15%
Shows RED if slower or GREEN if faster compared to baseline
Paragraph TrendResponse times only colymn 'evaluated' of previous 14 testruns
Separator charactersdecimal: ',' thousand: '' (none)

Summary

Transactions failed (%)0,00
Threshold violations0
Baseline warnings0
Trendbreak 'scalability' (%)63
Trendbreak 'stability' (%)10
 
Duration01:00:01
Virtual users8
Transactions executed1250
Transactions success1250
Transactions failed0
Min of minima (s)0,043
Avg of averages (s)1,058
Avg of 90 percentiles (s)1,538
Max of maxima (s)13,877
Avg of StdDev (s)0,512

Trend last 14 testruns

Response times (s)

EvaluatedBaselineCurrent
TransactionSuccessMinAvg90 percMaxStDevFailed2019.02.27.02.34.38
2020.07.10.01.51.24
Delta %
foo_01_bar 147 0,075 0,122 0,144 0,201 0,0210 1,1090,144-87,0
foo_02_bar 49 0,204 0,500 0,693 1,070 0,1580 0,693
foo_02_bar_medium 49 0,417 0,967 1,201 2,250 0,3320 1,201
foo_02_bar_large 49 0,807 1,819 2,703 7,237 1,1780 2,703
foo_03_bar_small 49 0,535 0,978 1,283 1,698 0,2580 1,283
foo_03_bar_medium 49 0,727 1,302 1,756 2,242 0,3380 1,756
foo_03_bar_large 49 0,930 1,880 2,768 5,235 0,8770 2,768
foo_04_bar_small 49 0,081 0,342 0,554 0,850 0,1590 0,554
foo_04_bar_medium 49 0,349 0,741 1,076 2,035 0,3390 1,076
foo_04_bar_large 49 0,343 1,457 2,288 5,383 0,9810 2,288
foo_05_bar_small 49 0,674 1,779 2,715 3,977 0,7380 2,715
foo_05_bar_medium 49 0,826 2,525 3,882 6,901 1,2340 3,882
foo_05_bar_large 49 1,163 4,077 6,014 13,877 2,6040 6,014
TransactionSuccessMinAvg90 percMaxStDevFailed2019.02.27.02.34.382020.07.10.01.51.24Delta %
foo_01_baz 74 0,043 0,097 0,109 0,678 0,0710 0,2600,109
foo_02_baz 74 0,330 0,527 0,780 1,042 0,1590 0,9060,780
foo_03_baz 74 0,167 0,323 0,483 0,928 0,1540 0,6050,483
foo_04_baz 73 0,158 0,196 0,203 0,430 0,0550 1,5320,203-86,7
foo_05_baz 73 0,133 0,192 0,228 0,265 0,0260 0,5520,228
TransactionSuccessMinAvg90 percMaxStDevFailed2019.02.27.02.34.382020.07.10.01.51.24Delta %

Trend (s)

Transaction
2020.06.18.01.54.36
2020.06.19.01.54.45
2020.06.23.02.08.51
2020.06.24.01.54.43
2020.06.25.01.54.35
2020.06.26.02.07.46
2020.06.30.01.54.40
2020.07.01.01.54.44
2020.07.02.01.54.40
2020.07.03.02.30.36
2020.07.07.02.33.52
2020.07.08.01.55.54
2020.07.09.02.32.40
2020.07.10.01.51.24
foo_01_bar0,1440,1550,1510,1470,1570,1440,1620,1480,1480,1450,1450,1540,1540,144
foo_02_bar0,7390,7520,7300,6870,7730,6840,7580,7510,6990,6770,7570,7980,7940,693
foo_02_bar_medium1,3401,4731,3941,2471,3721,3691,3891,4241,1791,3181,4341,3781,3441,201
foo_02_bar_large2,8523,0742,9634,9642,7873,0602,9303,0422,9932,7642,7394,9182,9922,703
foo_03_bar_small1,2701,2751,5871,0831,3721,3361,4911,4061,3901,3401,5081,6491,3531,283
foo_03_bar_medium1,8391,9961,9621,8421,9481,8771,9392,0961,7241,6961,8191,9341,9301,756
foo_03_bar_large2,6922,7442,6534,8612,6282,7092,7953,1302,7782,7342,7035,1932,7182,768
foo_04_bar_small0,6010,5710,6110,4890,6150,5420,5650,5900,5400,6090,5600,6390,7670,554
foo_04_bar_medium1,0521,0591,0350,9061,0711,0331,0621,0921,0841,0790,9551,0391,0211,076
foo_04_bar_large2,5192,5232,5033,6252,4162,4292,4122,8302,3822,4722,3933,7212,6162,288
foo_05_bar_small3,0292,6272,9592,0662,9652,7982,9662,6212,7292,8602,7923,1983,1652,715
foo_05_bar_medium4,2244,1364,2023,5134,1593,4613,8913,8123,8043,9394,0653,7174,2113,882
foo_05_bar_large5,6887,2196,27012,7896,3856,3136,78410,1276,4235,9805,84513,0266,7606,014
Transaction
foo_01_baz0,1100,0900,1030,1320,0980,0950,1030,1150,1050,1090,1090,0920,1090,109
foo_02_baz0,7790,7380,7770,6670,7120,8130,7940,8670,7370,7620,7100,7300,7860,780
foo_03_baz0,4400,4470,4470,5620,4500,5690,4400,3980,4450,4550,4630,4220,4490,483
foo_04_baz0,2480,3980,2160,3910,2490,2590,3900,3970,3770,2510,2070,1990,2020,203
foo_05_baz0,2260,2070,2200,2270,2080,2380,2190,2250,2270,2470,2170,2200,2180,228
Transaction

end of report