File: README.v8

package info (click to toggle)
chromium 138.0.7204.183-1
  • links: PTS, VCS
  • area: main
  • in suites: trixie
  • size: 6,071,908 kB
  • sloc: cpp: 34,937,088; ansic: 7,176,967; javascript: 4,110,704; python: 1,419,953; asm: 946,768; xml: 739,971; pascal: 187,324; sh: 89,623; perl: 88,663; objc: 79,944; sql: 50,304; cs: 41,786; fortran: 24,137; makefile: 21,806; php: 13,980; tcl: 13,166; yacc: 8,925; ruby: 7,485; awk: 3,720; lisp: 3,096; lex: 1,327; ada: 727; jsp: 228; sed: 36
file content (26 lines) | stat: -rw-r--r-- 1,013 bytes parent folder | download | duplicates (6) 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
 
Name: DFA UTF-8 Decoder
Short Name: utf8-decoder
URL: http://bjoern.hoehrmann.de/utf-8/decoder/dfa/
Version: N/A
Date: 2010-06-25
License: MIT
License File: LICENSE
Security Critical: yes
Shipped: yes

Description:
Decodes UTF-8 bytes using a fast and simple definite finite automata.

Local modifications:
- Rejection state has been mapped to row 0 (instead of row 1) of the DFA,
  saving some 50 bytes and making the table easier to reason about.
- The transitions have been remapped to represent both a state transition and a
  bit mask for the incoming byte.
- The caller must now zero out the code point buffer after successful or
  unsuccessful state transitions.
- Specifically for generalized-utf8-decoder.h: we adapt the original
  decoder to decode and validate "generalized UTF-8", a variant of UTF-8
  used in WTF-8 that can encode surrogates.  See
  https://simonsapin.github.io/wtf-8/#generalized-utf8.  There is one
  fewer state and so the transition table is smaller by one in both
  dimensions.