1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
|
COMMENT ON TABLE fact_loader.fact_table_dep_queue_table_deps IS
$$Data in this table is by default auto-generated by refresh_fact_table_dep_queue_table_deps() only for queue-based fact tables that depend on other fact table changes.
Each row represents a parent's queue_table_dep, updates of which will trickle down to this dependent fact table. Even though the default proids
from fact_table_deps are used initially, they may not be appropriate as generalized across all of these queue_table_deps.
The proids may need to be overridden for individual fact_table_dep_queue_table_deps if that generalization isn't possible.
See the regression suite in ./sql and ./expected for examples of this.
$$;
COMMENT ON COLUMN fact_loader.fact_table_dep_queue_table_deps.fact_table_dep_queue_table_dep_id IS 'Unique identifier';
COMMENT ON COLUMN fact_loader.fact_table_dep_queue_table_deps.fact_table_dep_id IS 'fact_table_dep for this specific dependency.';
COMMENT ON COLUMN fact_loader.fact_table_dep_queue_table_deps.queue_table_dep_id IS 'Inherited queue_table_dep that this dependent fact table depends on.';
COMMENT ON COLUMN fact_loader.fact_table_dep_queue_table_deps.last_cutoff_id IS
$$This is unique and maintained separately from last_cutoff_id in queue_table_deps,
as it refers to the last_cutoff_id for this dependent fact table. It is the last fact_loader_batch_id of
the queue table that was processed for this queue table - dependent fact table pair.
After this job runs, records that have this id and lower are eligible to be pruned,
assuming no other fact tables also depend on those same records.
The next time the job runs, only records after this id are considered.$$;
COMMENT ON COLUMN fact_loader.fact_table_dep_queue_table_deps.last_cutoff_source_time IS
$$This is unique and maintained separately from last_cutoff_source_time in queue_table_deps,
as it refers to the last_cutoff_source_time for this dependent fact table. It is the source data
change time of the last queue table record that was processed for this queue table - dependent fact table pair.
This helps pg_fact_loader synchronize time across multiple queue tables and only pull changes
that are early enough, and not purge records that are later than these cutoff times. It will also
never go past its parent(s) in time. THIS DOES NOT DETERMINE filter conditions
for the starting point at which to pull new records as does last_cutoff_id - it is only
used as an ending-point barrier.
$$;
COMMENT ON COLUMN fact_loader.fact_table_dep_queue_table_deps.insert_merge_proid IS
$$Initially populated by default_insert_merge_proid from fact_table_deps, but can be
overridden if a different proid is required. This is the function oid to execute on
INSERT events *for this dependent fact table* - it accepts a single value as its arg
which is typically the key that has changed and needs to be updated.
The way to retrieve this key for this queue table - dependent fact table pair
is configured in key_retrieval_sequences *for the parent(s)*. NULL to ignore insert events.
See the regression suite in ./sql and ./expected for examples of this.$$;
COMMENT ON COLUMN fact_loader.fact_table_dep_queue_table_deps.update_merge_proid IS
$$Initially populated by default_update_merge_proid from fact_table_deps, but can be
overridden if a different proid is required. This is the function oid to execute on
UPDATE events *for this dependent fact table* - it accepts a single value as its arg
which is typically the key that has changed and needs to be updated.
The way to retrieve this key for this queue table - dependent fact table pair
is configured in key_retrieval_sequences *for the parent(s)*. NULL to ignore insert events.
See the regression suite in ./sql and ./expected for examples of this.$$;
COMMENT ON COLUMN fact_loader.fact_table_dep_queue_table_deps.delete_merge_proid IS
$$Initially populated by default_delete_merge_proid from fact_table_deps, but can be
overridden if a different proid is required. This is the function oid to execute on
DELETE events *for this dependent fact table* - it accepts a single value as its arg
which is typically the key that has changed and needs to be updated.
The way to retrieve this key for this queue table - dependent fact table pair
is configured in key_retrieval_sequences *for the parent(s)*. NULL to ignore insert events.
See the regression suite in ./sql and ./expected for examples of this.$$;
COMMENT ON COLUMN fact_loader.fact_table_dep_queue_table_deps.row_created_at IS 'Timestamp of when this row was first created.';
COMMENT ON COLUMN fact_loader.fact_table_dep_queue_table_deps.row_updated_at IS 'Timestamp of when this row was last updated (this is updated via trigger).';
|
