1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622
|
/////////////////////////////////////////////////////////////////////////////
/// @file topic_matcher.h
/// Declaration of MQTT topic_matcher class
/// @date April 23, 2022
/// @author Frank Pagliughi
/////////////////////////////////////////////////////////////////////////////
/*******************************************************************************
* Copyright (c) 2022-2025 Frank Pagliughi <fpagliughi@mindspring.com>
*
* All rights reserved. This program and the accompanying materials
* are made available under the terms of the Eclipse Public License v2.0
* and Eclipse Distribution License v1.0 which accompany this distribution.
*
* The Eclipse Public License is available at
* http://www.eclipse.org/legal/epl-v20.html
* and the Eclipse Distribution License is available at
* http://www.eclipse.org/org/documents/edl-v10.php.
*
* Contributors:
* Frank Pagliughi - initial implementation and documentation
*******************************************************************************/
#ifndef __mqtt_topic_matcher_h
#define __mqtt_topic_matcher_h
#include <forward_list>
#include <initializer_list>
#include <map>
#include <memory>
#include <string>
#include <vector>
#include "mqtt/topic.h"
#include "mqtt/types.h"
namespace mqtt {
/////////////////////////////////////////////////////////////////////////////
/**
* A collection of MQTT topic filters mapped to arbitrary values.
*
* This can be used to get an iterator to all filters in the collection that
* match a topic. A typical use case might be to match incoming messages to
* specific callback functions based on topics, such as
*
* To test against a single filter, see
* [`TopicFilter`](crate::TopicFilter). This collection is more commonly
* used when there are a number of filters and each needs to be associated
* with a particular action or piece of data. Note, however, that a single
* incoming topic could match against several items in the collection. For
* example, the topic:
*
* @code
* data/temperature/engine
* @endcode
*
* Could match against the filters:
* @code
* data/temperature/engine
* data/temperature/#
* data/+/engine
* @endcode
*
* Thus, the collection gives an iterator for the items matching a topic.
*
* A common use for this would be to store callbacks to process incoming
* messages based on topics.
*
* This code was adapted from the Eclipse Python `MQTTMatcher` class:
*
*<https://github.com/eclipse/paho.mqtt.python/blob/master/src/paho/mqtt/matcher.py>
*
* which use a prefix tree (trie) to store the values.
*
* For example, if you had a `topic_mapper<int>` and you inserted:
* @code
* topic_matcher<int> tm{
* {"some/random/topic", 42},
* {"some/#", 99},
* {"some/+/topic", 33}
* };
* @endcode
*
* The collection would be built like:
* @code
* "some" -> <null>
* "random" -> <null>
* "topic" -> <42>
* "#" -> <99>
* "+" -> <null>
* "topic" -> <33>
* @endcode
*
* Note that the collection has two types of iterators. The basic `iterator`
* is a normal C++ iterator over *all* the items in the collection. It will
* visit every node in the collection and produce all items. This is not the
* typical use case for the collection, but can be used for diagnostics,
* etc, to show the full contents of the collection.
*
* The more common use case is the `match_iterator`, returned by the
* `topic_matcher::matches(string)` method. This is an optimized search
* iterator for finding all the filters and values that match the specified
* topic string.
*/
template <typename T>
class topic_matcher
{
public:
using key_type = string;
using mapped_type = T;
using value_type = std::pair<key_type, mapped_type>;
using reference = value_type;
using const_reference = const value_type&;
using value_ptr = std::unique_ptr<value_type>;
using mapped_ptr = std::unique_ptr<mapped_type>;
private:
/**
* The nodes of the collection.
*/
struct node
{
using ptr_t = std::unique_ptr<node>;
using map_t = std::map<string, ptr_t>;
/** The value that matches the topic at this node, if any */
value_ptr content;
/** Child nodes mapped by the next field of the topic */
map_t children;
/** Creates a new, empty node */
static ptr_t create() { return std::make_unique<node>(); }
/** Determines if this node is empty (no content or children) */
bool empty() const { return !content && children.empty(); }
/** Removes the empty nodes under this one. */
void prune() {
for (auto& child : children) {
child.second->prune();
}
for (auto child = children.cbegin(); child != children.cend();) {
if (child->second->empty()) {
child = children.erase(child);
}
else {
++child;
}
}
}
};
using node_ptr = typename node::ptr_t;
using node_map = typename node::map_t;
/** The root node of the collection */
node_ptr root_;
public:
/** Generic iterator over all items in the collection. */
class iterator
{
/** The last-found value */
value_type* pval_;
/** The nodes still to be checked, used as a stack */
std::vector<node*> nodes_;
void next() {
// If there are no nodes left to search, we're done.
if (nodes_.empty()) {
pval_ = nullptr;
return;
}
// Get the next node to search.
auto snode = std::move(nodes_.back());
nodes_.pop_back();
// Push the children onto the stack for later
for (auto const& child : snode->children) {
nodes_.push_back(child.second.get());
}
// If there's a value in this node, use it;
// otherwise keep looking.
pval_ = snode->content.get();
if (!pval_)
this->next();
}
friend class topic_matcher;
iterator(value_type* pval) : pval_{pval} {}
iterator(node* root) : pval_{nullptr} {
nodes_.push_back(root);
next();
}
public:
/**
* Gets a reference to the current value.
* @return A reference to the current value.
*/
reference operator*() noexcept { return *pval_; }
/**
* Gets a const reference to the current value.
* @return A const reference to the current value.
*/
const_reference operator*() const noexcept { return *pval_; }
/**
* Get a pointer to the current value.
* @return A pointer to the current value.
*/
value_type* operator->() noexcept { return pval_; }
/**
* Get a const pointer to the current value.
* @return A const pointer to the current value.
*/
const value_type* operator->() const noexcept { return pval_; }
/**
* Postfix increment operator.
* @return An iterator pointing to the previous matching item.
*/
iterator operator++(int) noexcept {
auto tmp = *this;
this->next();
return tmp;
}
/**
* Prefix increment operator.
* @return An iterator pointing to the next matching item.
*/
iterator& operator++() noexcept {
this->next();
return *this;
}
/**
* Compares two iterators to see if they don't refer to the same
* node.
*
* @param other The other iterator to compare against this one.
* @return @em true if they don't match, @em false if they do
*/
bool operator!=(const iterator& other) const noexcept { return pval_ != other.pval_; }
};
/** A const iterator over all itemsin the collection. */
class const_iterator : public iterator
{
using base = iterator;
friend class topic_matcher;
const_iterator(iterator it) : base(it) {}
public:
/**
* Gets a const reference to the current value.
* @return A const reference to the current value.
*/
const_reference operator*() const noexcept { return base::operator*(); }
/**
* Get a const pointer to the current value.
* @return A const pointer to the current value.
*/
const value_type* operator->() const noexcept { return base::operator->(); }
};
/**
* Iterator that efficiently searches the collection for topic
* matches.
*/
class match_iterator
{
/** Information about a node that needs to be searched. */
struct search_node
{
/** The current node being searched. */
node* node_;
/** The fields of the topic still to be searched. */
std::forward_list<string> fields_;
/** Whether this is the first/root node */
bool first_;
search_node(node* nd, const std::forward_list<string>& sy, bool first = false)
: node_{nd}, fields_{sy}, first_{first} {}
search_node(node* nd, std::forward_list<string>&& sy, bool first = false)
: node_{nd}, fields_{std::move(sy)}, first_{first} {}
};
/** The last-found value */
value_type* pval_;
/** The nodes still to be checked, used as a stack */
std::vector<search_node> nodes_;
/**
* Move the next iterator to the next value, or to end(), if none
* left.
*
* This will keep recursing until it finds a matching node that
* contains a value or it reaches the end.
*/
void next() {
pval_ = nullptr;
// If there are no nodes left to search, we're done.
if (nodes_.empty())
return;
// Get the next node to search.
auto snode = std::move(nodes_.back());
nodes_.pop_back();
// If we're at the end of the topic fields, we either have a value,
// or need to move on to the next node to search.
if (snode.fields_.empty()) {
pval_ = snode.node_->content.get();
if (!pval_)
this->next();
return;
}
// Get the next field of the topic to search
auto field = std::move(snode.fields_.front());
snode.fields_.pop_front();
typename node_map::iterator child;
const auto map_end = snode.node_->children.end();
// Look for an exact match
if ((child = snode.node_->children.find(field)) != map_end) {
nodes_.push_back({child->second.get(), snode.fields_});
}
// Topics starting with '$' don't match wildcards in the first field
// MQTT v5 Spec, Section 4.7.2:
// https://docs.oasis-open.org/mqtt/mqtt/v5.0/os/mqtt-v5.0-os.html#_Toc3901246
if (!snode.first_ || field.empty() || field[0] != '$') {
// Look for a single-field wildcard match
if ((child = snode.node_->children.find("+")) != map_end) {
nodes_.push_back({child->second.get(), snode.fields_});
}
// Look for a terminating match
if ((child = snode.node_->children.find("#")) != map_end) {
// By definition, a '#' is a terminating leaf
pval_ = child->second->content.get();
return;
}
}
this->next();
}
friend class topic_matcher;
match_iterator() : pval_{nullptr} {}
match_iterator(value_type* pval) : pval_{pval} {}
match_iterator(node* root, const string& topic) : pval_{nullptr} {
auto v = topic::split(topic);
std::forward_list<string> fields{v.begin(), v.end()};
nodes_.push_back(search_node{root, std::move(fields), true});
next();
}
public:
/**
* Gets a reference to the current value.
* @return A reference to the current value.
*/
reference operator*() noexcept { return *pval_; }
/**
* Gets a const reference to the current value.
* @return A const reference to the current value.
*/
const_reference operator*() const noexcept { return *pval_; }
/**
* Get a pointer to the current value.
* @return A pointer to the current value.
*/
value_type* operator->() noexcept { return pval_; }
/**
* Get a const pointer to the current value.
* @return A const pointer to the current value.
*/
const value_type* operator->() const noexcept { return pval_; }
/**
* Postfix increment operator.
* @return An iterator pointing to the previous matching item.
*/
match_iterator operator++(int) noexcept {
auto tmp = *this;
this->next();
return tmp;
}
/**
* Prefix increment operator.
* @return An iterator pointing to the next matching item.
*/
match_iterator& operator++() noexcept {
this->next();
return *this;
}
/**
* Compares two iterators to see if they don't refer to the same
* node.
*
* @param other The other iterator to compare against this one.
* @return @em true if they don't match, @em false if they do
*/
bool operator!=(const match_iterator& other) const noexcept {
return pval_ != other.pval_;
}
};
/**
* A const match iterator.
*/
class const_match_iterator : public match_iterator
{
using base = match_iterator;
friend class topic_matcher;
const_match_iterator(match_iterator it) : base(it) {}
public:
/**
* Gets a const reference to the current value.
* @return A const reference to the current value.
*/
const_reference operator*() const noexcept { return base::operator*(); }
/**
* Get a const pointer to the current value.
* @return A const pointer to the current value.
*/
const value_type* operator->() const noexcept { return base::operator->(); }
};
/**
* Creates new, empty collection.
*/
topic_matcher() : root_(node::create()) {}
/**
* Creates a new collection with a list of key/value pairs.
*
* This can be used to create a connection from a table of entries, as
* key/value pairs, like:
*
* topic_matcher<int> matcher {
* { "#", -1 },
* { "some/random/topic", 42 },
* { "some/#", 99 }
* }
*
* @param lst The list of key/value pairs to populate the collection.
*/
topic_matcher(std::initializer_list<value_type> lst) : root_(node::create()) {
for (const auto& v : lst) {
insert(v);
}
}
/**
* Determines if the collection is empty.
* @return @em true if the collection is empty, @em false if it contains
* any filters.
*/
bool empty() const { return root_.empty(); }
/**
* Inserts a new key/value pair into the collection.
* @param val The value to place in the collection.
*/
void insert(value_type&& val) {
auto nd = root_.get();
auto fields = topic::split(val.first);
for (const auto& field : fields) {
auto it = nd->children.find(field);
if (it == nd->children.end()) {
nd->children[field] = node::create();
it = nd->children.find(field);
}
nd = it->second.get();
}
nd->content = std::make_unique<value_type>(std::move(val));
}
/**
* Inserts a new value into the collection.
* @param key The topic/filter entry
* @param val The value to associate with that entry.
*/
void insert(const value_type& val) {
value_type v{val};
this->insert(std::move(v));
}
/**
* Removes an entry from the collection.
*
* This removes the value from the internal node, but leaves the node in
* the collection, even if it is empty.
* @param filter The topic filter to remove.
* @return A unique pointer to the value, if any.
*/
mapped_ptr remove(const key_type& filter) {
auto nd = root_.get();
auto fields = topic::split(filter);
for (auto& field : fields) {
auto it = nd->children.find(field);
if (it == nd->children.end())
return mapped_ptr{};
nd = it->second.get();
}
value_ptr valpair;
nd->content.swap(valpair);
return (valpair) ? std::make_unique<mapped_type>(valpair->second) : mapped_ptr{};
}
/**
* Removes the empty nodes in the collection.
*/
void prune() { root_->prune(); }
/**
* Gets an iterator to the full collection of filters.
* @return An iterator to the full collection of filters.
*/
iterator begin() { return iterator{root_.get()}; }
/**
* Gets an iterator to the end of the collection of filters.
* @return An iterator to the end of collection of filters.
*/
iterator end() { return iterator{static_cast<value_type*>(nullptr)}; }
/**
* Gets an iterator to the end of the collection of filters.
* @return An iterator to the end of collection of filters.
*/
const_iterator end() const noexcept {
return const_iterator{static_cast<value_type*>(nullptr)};
}
/**
* Gets a const iterator to the full collection of filters.
* @return A const iterator to the full collection of filters.
*/
const_iterator cbegin() const { return const_iterator{root_.get()}; }
/**
* Gets a const iterator to the end of the collection of filters.
* @return A const iterator to the end of collection of filters.
*/
const_iterator cend() const noexcept { return end(); }
/**
* Gets a pointer to the value at the requested key.
* @param filter The topic filter entry to find.
* @return An iterator to the value if found, @em end() if not found.
*/
iterator find(const key_type& filter) {
auto nd = root_.get();
auto fields = topic::split(filter);
for (auto& field : fields) {
auto it = nd->children.find(field);
if (it == nd->children.end())
return end();
nd = it->second.get();
}
return iterator{nd->content.get()};
}
/**
* Gets a const pointer to the value at the requested key.
* @param filter The topic filter entry to find.
* @return A const pointer to the value if found, @em nullptr if not
* found.
*/
const_iterator find(const key_type& filter) const {
return const_cast<topic_matcher*>(this)->find(filter);
}
/**
* Gets an match_iterator that can find the matches to the topic.
* @param topic The topic to search for matches.
* @return An iterator that can find the matches to the topic.
*/
match_iterator matches(const string& topic) { return match_iterator(root_.get(), topic); }
/**
* Gets a const iterator that can find the matches to the topic.
* @param topic The topic to search for matches.
* @return A const iterator that can find the matches to the topic.
*/
const_match_iterator matches(const string& topic) const {
return match_iterator(root_.get(), topic);
}
/**
* Gets an iterator for the end of the collection.
*
* This simply returns an empty/null iterator which we can use to signal
* the end of the collection.
*
* @return An empty/null iterator indicating the end of the collection.
*/
const_match_iterator matches_end() const noexcept { return match_iterator{}; }
/**
* Gets an iterator for the end of the collection.
*
* This simply returns an empty/null iterator which we can use to signal
* the end of the collection.
*
* @return An empty/null iterator indicating the end of the collection.
*/
const_match_iterator matches_cend() const noexcept { return match_iterator{}; }
/**
* Determines if there are any matches for the specified topic.
* @param topic The topic to search for matches.
* @return Whether there are any matches for the topic in the
* collection.
*/
bool has_match(const string& topic) { return matches(topic) != matches_cend(); }
};
/////////////////////////////////////////////////////////////////////////////
} // namespace mqtt
#endif // __mqtt_topic_matcher_h
|