1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
|
[/
Copyright (c) 2019 Nick Thompson
Copyright (c) 2021 Matt Borland
Use, modification and distribution are subject to the
Boost Software License, Version 1.0. (See accompanying file
LICENSE_1_0.txt or copy at http://www.boost.org/LICENSE_1_0.txt)
]
[section:t_test /t/-tests]
[heading Synopsis]
```
#include <boost/math/statistics/t_test.hpp>
namespace boost::math::statistics {
template<typename Real, typename Size = Real>
std::pair<Real, Real> one_sample_t_test(Real sample_mean, Real sample_variance, Size num_samples, Real assumed_mean);
template<typename ForwardIterator, typename Real = typename std::iterator_traits<ForwardIterator>::value_type>
std::pair<Real, Real> one_sample_t_test(ForwardIterator begin, ForwardIterator end, Real assumed_mean);
template<typename Container>
std::pair<Real, Real> one_sample_t_test(Container const & v, typename Container::value_type assumed_mean);
template<typename ForwardIterator, typename Real = typename std::iterator_traits<ForwardIterator>::value_type>
std::pair<Real, Real> two_sample_t_test(ForwardIterator begin_1, ForwardIterator end_1, ForwardIterator begin_2, ForwardIterator begin_2);
template<typename Container, typename Real = typename Container::value_type>
std::pair<Real, Real> two_sample_t_test(Container const & u, Container const & v);
template<typename ForwardIterator, typename Real = typename std::iterator_traits<ForwardIterator>::value_type>
std::pair<Real, Real> paired_samples_t_test(ForwardIterator begin_1, ForwardIterator end_1, ForwardIterator begin_2, ForwardIterator begin_2);
template<typename Container, typename Real = typename Container::value_type>
std::pair<Real, Real> paired_samples_t_test(Container const & u, Container const & v);
}
```
[heading Background]
A set of C++11 compatible functions for various [@https://en.wikipedia.org/wiki/Student's_t-test Student's t-tests].
The input can be any real number or set of real numbers.
In the event that the input is an integer or a set of integers typename Real will be deduced as a double precision type.
[heading One-sample /t/-test]
A one-sample /t/-test attempts to answer the question "given a sample mean, is it likely that the population mean of my data is a certain value?"
The test statistic is
[$../graphs/one_sample_t_test_statistic.svg]
where µ[sub 0] is the assumed mean, /s/[super 2] is the sample variance, and /n/ is the number of samples.
If the absolute value of the test statistic is large, then we have low confidence that the population mean is equal to µ[sub 0], and if the absolute value of the test statistic is small, we have high confidence.
We now ask the question "what constitutes large and small in this context?"
Under reasonable assumptions, the test statistic /t/ can be assumed to come from a Student's /t/-distribution.
Since we wish to know if the sample mean deviates from the true mean in either direction, the test is two-tailed.
Hence the /p/-value is straightforward to calculate from the Student's /t/-distribution on /n/ - 1 degrees of freedom, but nonetheless it is convenient to have it computed here.
An example usage is as follows:
```
#include <vector>
#include <random>
#include <boost/math/statistics/t_test.hpp>
std::random_device rd;
std::mt19937 gen{rd()};
std::normal_distribution<double> dis{0,1};
std::vector<double> v(1024);
for (auto & x : v) {
x = dis(gen);
}
auto [t, p] = boost::math::statistics::one_sample_t_test(v, 0.0);
```
The test statistic is the first element of the pair, and the /p/-value is the second element.
[heading Independent two-sample /t/-test]
A two-sample /t/-test determines if the means of two sets of data have a statistically significant difference from each other.
There are two underlying implementations based off the variances of the sets of data.
If /s/[sub 1] and /s/[sub 2] are within a factor of 2 of each other the following formulas will be used:
[$../graphs/two_sample_t_statistic.svg]
where
[$../graphs/two_sample_pooled_variance.svg]
If /s/[sub 1] and /s/[sub 2] are not within a factor of 2 of each other Welch's t-test will be used:
[$../graphs/welchs_t_statistic.svg]
where
[$../graphs/welchs_t_variance.svg]
and
[$../graphs/welchs_t_dof.svg]
An example of usage is as follows:
```
#include <vector>
#include <random>
#include <boost/math/statistics/t_test.hpp>
std::random_device rd;
std::mt19937 gen{rd()};
std::normal_distribution<double> dis{0,1};
std::vector<double> u(1024);
std::vector<double> v(1024);
for(std::size_t i = 0; i < u.size(); ++i)
{
u[i] = dis(gen);
v[i] = dis(gen);
}
auto [t, p] = boost::math::statistics::two_sample_t_test(u, v);
```
/Nota bene:/ The sample sizes for the two sets of data do not need to be equal.
/Nota bene:/ std::distance is used in the implementation leading to lower performance with ForwardIterator than RandomAccessIterator.
[heading Dependent /t/-test for paired samples]
This test is used when the samples are dependent such as when one sample has been tested twice, or when two samples have been paired.
Much like the independent t-test it is used to determine if the means of two sets of data have a statistically significant difference from each other.
[$../graphs/paired_sample_t_statistic.svg]
where /X/[sub D] and /s/[sub D] are the mean and standard deviation of the differences between all pairs.
An example of usage is as follows:
```
#include <vector>
#include <random>
#include <boost/math/statistics/t_test.hpp>
std::vector<int> first_test {35, 50, 90, 78};
std::vector<int> second_test {67, 46, 86, 91};
auto [t, p] = boost::math::statistics::paired_samples_t_test(first_test, second_test);
```
[heading Performance]
There are two cases: Where the mean and sample variance have already been computed, and the case where the mean and sample variance must be computed on the fly.
```
----------------------------------------------
Benchmark Time
----------------------------------------------
OneSampleTTest<double>/8 291 ns bytes_per_second=210.058M/s
OneSampleTTest<double>/16 1064 ns bytes_per_second=114.697M/s
OneSampleTTest<double>/32 407 ns bytes_per_second=599.213M/s
OneSampleTTest<double>/64 595 ns bytes_per_second=821.086M/s
OneSampleTTest<double>/128 1475 ns bytes_per_second=662.071M/s
OneSampleTTest<double>/256 1746 ns bytes_per_second=1118.85M/s
OneSampleTTest<double>/512 3303 ns bytes_per_second=1.15492G/s
OneSampleTTest<double>/1024 6404 ns bytes_per_second=1.19139G/s
OneSampleTTest<double>/2048 12461 ns bytes_per_second=1.2245G/s
OneSampleTTest<double>/4096 24805 ns bytes_per_second=1.23029G/s
OneSampleTTest<double>/8192 49639 ns bytes_per_second=1.22956G/s
OneSampleTTest<double>/16384 98685 ns bytes_per_second=1.23698G/s
OneSampleTTest<double>/32768 197434 ns bytes_per_second=1.23656G/s
OneSampleTTest<double>/65536 393929 ns bytes_per_second=1.23952G/s
OneSampleTTest<double>/131072 790967 ns bytes_per_second=1.23466G/s
OneSampleTTest<double>/262144 1582366 ns bytes_per_second=1.23434G/s
OneSampleTTest<double>/524288 3141112 ns bytes_per_second=1.24358G/s
OneSampleTTest<double>/1048576 6260407 ns bytes_per_second=1.24792G/s
OneSampleTTest<double>/2097152 12521811 ns bytes_per_second=1.24784G/s
OneSampleTTest<double>/4194304 25076257 ns bytes_per_second=1.24619G/s
OneSampleTTest<double>/8388608 50226183 ns bytes_per_second=1.2444G/s
OneSampleTTest<double>/16777216 100522789 ns bytes_per_second=1.24353G/s
OneSampleTTest<double>_BigO 5.99 N
OneSampleTTest<double>_RMS 0 %
OneSampleTTestKnownMeanAndVariance<double> 207 ns
```
[endsect]
[/section:t_test]
|
