1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
|
\name{kkmeans}
\alias{kkmeans}
\alias{kkmeans,matrix-method}
\alias{kkmeans,formula-method}
\alias{kkmeans,list-method}
\alias{kkmeans,kernelMatrix-method}
\title{Kernel k-means}
\description{
A weighted kernel version of the famous k-means algorithm.
}
\usage{
\S4method{kkmeans}{formula}(x, data = NULL, na.action = na.omit, ...)
\S4method{kkmeans}{matrix}(x, centers, kernel = "rbfdot", kpar = "automatic",
alg="kkmeans", p=1, na.action = na.omit, ...)
\S4method{kkmeans}{kernelMatrix}(x, centers, ...)
\S4method{kkmeans}{list}(x, centers, kernel = "stringdot",
kpar = list(length=4, lambda=0.5),
alg ="kkmeans", p = 1, na.action = na.omit, ...)
}
\arguments{
\item{x}{the matrix of data to be clustered, or a symbolic
description of the model to be fit, or a kernel Matrix of class
\code{kernelMatrix}, or a list of character vectors.}
\item{data}{an optional data frame containing the variables in the model.
By default the variables are taken from the environment which
`kkmeans' is called from.}
\item{centers}{Either the number of clusters or a matrix of initial cluster
centers. If the first a random initial partitioning is used.}
\item{kernel}{the kernel function used in training and predicting.
This parameter can be set to any function, of class kernel, which
computes a inner product in feature space between two
vector arguments (see \code{link{kernels}}). \pkg{kernlab} provides the most popular kernel functions
which can be used by setting the kernel parameter to the following
strings:
\itemize{
\item \code{rbfdot} Radial Basis kernel "Gaussian"
\item \code{polydot} Polynomial kernel
\item \code{vanilladot} Linear kernel
\item \code{tanhdot} Hyperbolic tangent kernel
\item \code{laplacedot} Laplacian kernel
\item \code{besseldot} Bessel kernel
\item \code{anovadot} ANOVA RBF kernel
\item \code{splinedot} Spline kernel
\item \code{stringdot} String kernel
}
Setting the kernel parameter to "matrix" treats \code{x} as a kernel
matrix calling the \code{kernelMatrix} interface.\cr
The kernel parameter can also be set to a user defined function of
class kernel by passing the function name as an argument.
}
\item{kpar}{a character string or the list of hyper-parameters (kernel parameters).
The default character string \code{"automatic"} uses a heuristic the determine a
suitable value for the width parameter of the RBF kernel.\cr
A list can also be used containing the parameters to be used with the
kernel function. Valid parameters for existing kernels are :
\itemize{
\item \code{sigma} inverse kernel width for the Radial Basis
kernel function "rbfdot" and the Laplacian kernel "laplacedot".
\item \code{degree, scale, offset} for the Polynomial kernel "polydot"
\item \code{scale, offset} for the Hyperbolic tangent kernel
function "tanhdot"
\item \code{sigma, order, degree} for the Bessel kernel "besseldot".
\item \code{sigma, degree} for the ANOVA kernel "anovadot".
\item \code{length, lambda, normalized} for the "stringdot" kernel
where length is the length of the strings considered, lambda the
decay factor and normalized a logical parameter determining if the
kernel evaluations should be normalized.
}
Hyper-parameters for user defined kernels can be passed through the
kpar parameter as well.}
\item{alg}{the algorithm to use. Options currently include
\code{kkmeans} and \code{kerninghan}. }
\item{p}{a parameter used to keep the affinity matrix positive semidefinite}
\item{na.action}{The action to perform on NA}
\item{\dots}{additional parameters}
}
\details{
\code{kernel k-means} uses the 'kernel trick' (i.e. implicitly projecting all data
into a non-linear feature space with the use of a kernel) in order to
deal with one of the major drawbacks of \code{k-means} that is that it cannot
capture clusters that are not linearly separable in input space. \cr
The algorithm is implemented using the triangle inequality to avoid
unnecessary and computational expensive distance calculations.
This leads to significant speedup particularly on large data sets with
a high number of clusters. \cr
With a particular choice of weights this algorithm becomes
equivalent to Kernighan-Lin, and the norm-cut graph partitioning
algorithms. \cr
The function also support input in the form of a kernel matrix
or a list of characters for text clustering.\cr
The data can be passed to the \code{kkmeans} function in a \code{matrix} or a
\code{data.frame}, in addition \code{kkmeans} also supports input in the form of a
kernel matrix of class \code{kernelMatrix} or as a list of character
vectors where a string kernel has to be used.
}
\value{
An S4 object of class \code{specc} which extends the class \code{vector}
containing integers indicating the cluster to which
each point is allocated. The following slots contain useful information
\item{centers}{A matrix of cluster centers.}
\item{size}{The number of point in each cluster}
\item{withinss}{The within-cluster sum of squares for each cluster}
\item{kernelf}{The kernel function used}
}
\references{
Inderjit Dhillon, Yuqiang Guan, Brian Kulis\cr
A Unified view of Kernel k-means, Spectral Clustering and Graph
Partitioning\cr
UTCS Technical Report\cr
\url{https://people.bu.edu/bkulis/pubs/spectral_techreport.pdf}
}
\author{ Alexandros Karatzoglou \cr \email{alexandros.karatzoglou@ci.tuwien.ac.at}}
\seealso{\code{\link{specc}}, \code{\link{kpca}}, \code{\link{kcca}} }
\examples{
## Cluster the iris data set.
data(iris)
sc <- kkmeans(as.matrix(iris[,-5]), centers=3)
sc
centers(sc)
size(sc)
withinss(sc)
}
\keyword{cluster}
|
