1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
|
ht://Dig contributed scripts
This directory tree contains perl and shell programs that attempt to
do things with the generated databases. Most of these were written
for a very specific purpose for the specific version of ht://Dig that
was current at that point. This means that some of these programs
will be severely broken! Do not expect them to work; use them only as
examples of the types of things you can do with the ht://Dig
databases.
More contributed work is available on the ht://Dig website:
<https://htdig.sourceforge.net/contrib/>
What's here:
acroconv.pl An external converter script that uses acroread to parse PDFs
autorun An example of automating the database building
changehost A script to change hostnames of URLs in the databases
conv_doc.pl A sample script to use the conversion features of external_parsers
doclist List the information in the doc db (or after a certain date)
ewswrap Two sample htsearch wrappers to emulate Excite for Web
Servers (EWS) and to simplify queries
handler.pl A sample external_protocols script to handle HTTP/HTTPS using curl
htparsedoc A sample shell script to parse Word documents
multidig A set of scripts to simplify updating multiple databases
parse_doc.pl A general external parser script that handles MS Word documents
(among others)
run-robot.sh Another example of automating the database building
scriptname An example of using htsearch within dynamic SSI pages
status.pl Build a status page of last 5 runs and top 10
servers (by # URLs)
urlindex Build an index of all the URLs in the database
whatsnew Build a "what's new" page with custom header and footer
wordfreq Build a list of words and frequency in the database
|
