1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
|
.. _using-pre-commit:
Using :code:`pre-commit`
========================
`pre-commit`_ is a framework to manage git "hooks"
triggered right before a commit is made.
A `git hook`_ is a git feature to "fire off custom scripts"
when specific actions occur.
Using `pre-commit`_ with SQLFluff is a good way
to provide automated linting to SQL developers.
With `pre-commit`_, you also get the benefit of
only linting/fixing the files that changed.
SQLFluff comes with two `pre-commit`_ hooks:
* ``sqlfluff-lint``: returns linting errors.
* ``sqlfluff-fix``: attempts to fix rule violations.
.. warning::
For safety reasons, ``sqlfluff-fix`` by default will not make any fixes in
files that had templating or parse errors, even if those errors were ignored
using ``noqa`` or `--ignore``.
Although it is not advised, you *can* tell SQLFluff to try and fix
these files by overriding the ``fix_even_unparsable`` setting
in ``.sqlfluff`` config file or using the ``sqlfluff fix --FIX-EVEN-UNPARSABLE``
command line option.
*Overriding this behavior may break your SQL. If you use this override,
always be sure to review any fixes applied to files with templating or parse
errors to verify they are okay.*
You should create a file named ``.pre-commit-config.yaml``
at the root of your git project, which should look
like this:
.. code-block:: yaml
repos:
- repo: https://github.com/sqlfluff/sqlfluff
rev: |release|
hooks:
- id: sqlfluff-lint
# For dbt projects, this installs the dbt "extras".
# You will need to select the relevant dbt adapter for your dialect
# (https://docs.getdbt.com/docs/available-adapters):
# additional_dependencies: ['<dbt-adapter>', 'sqlfluff-templater-dbt']
- id: sqlfluff-fix
# Arbitrary arguments to show an example
# args: [--rules, "LT02,CP02"]
# additional_dependencies: ['<dbt-adapter>', 'sqlfluff-templater-dbt']
When trying to use the `dbt templater`_, uncomment the
``additional_dependencies`` to install the extras.
This is equivalent to running ``pip install <dbt-adapter> sqlfluff-templater-dbt``.
You can specify the version of ``dbt-adapter`` used in `pre-commit`_,
for example:
.. code-block:: yaml
additional_dependencies : ['dbt-bigquery==1.0.0', 'sqlfluff-templater-dbt']
See the list of available `dbt-adapters`_.
Note that you can pass the same arguments available
through the CLI using ``args:``.
.. _`pre-commit`: https://pre-commit.com/
.. _`git hook`: https://git-scm.com/book/en/v2/Customizing-Git-Git-Hooks
.. _`dbt templater`: `dbt-project-configuration`
.. _`dbt-adapters`: https://docs.getdbt.com/docs/available-adapters
Ignoring files while using :code:`pre-commit`
---------------------------------------------
Under the hood, `pre-commit`_ works by passing specific files to *SQLFluff*.
For example, if the only two files that are modified in your commit are
:code:`file_a.sql` and :code:`file_b.sql`, then the command which is called
in the background is :code:`sqlfluff lint file_a.sql file_b.sql`. While this
is efficient, it does produce some unwanted noise when also
using :ref:`sqlfluffignore`. This is because *SQLFluff* is designed to allow
users to override an *ignore* configuration by passing the name of the file
directly. This makes a lot of sense in a CLI context, but less so in the context
of being invoked by `pre-commit`_.
To avoid noisy logs when using both `pre-commit`_ and :ref:`sqlfluffignore`,
we recommend also setting the :code:`exclude` argument in your
:code:`.pre-commit-config.yaml` file (either the `top level config`_ or the
`hook specific config`_). This will prevent files matching the given pattern
being passed to *SQLFluff* and so silence any warnings about the
:ref:`sqlfluffignore` being overridden.
.. _`top level config`: https://pre-commit.com/#top_level-exclude
.. _`hook specific config`: https://pre-commit.com/#config-exclude
|
