1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
|
============
Contributing
============
Contributions are welcome, and they are greatly appreciated! Every
little bit helps, and credit will always be given.
You can contribute in many ways:
Types of Contributions
----------------------
Report Bugs
~~~~~~~~~~~
Report bugs at https://github.com/scrapinghub/dateparser/issues.
If you are reporting a bug, please include:
* Your operating system name and version.
* Any details about your local setup that might be helpful in troubleshooting.
* Detailed steps to reproduce the bug.
Fix Bugs and Implement Features
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Look through the GitHub issues for bugs and feature requests. To avoid
duplicate efforts, try to choose issues without related PRs or with staled PRs.
We also encourage you to add new languages to the existing stack.
Write Documentation
~~~~~~~~~~~~~~~~~~~
Dateparser could always use more documentation, whether as part of the
official Dateparser docs, in docstrings, or even on the web in blog posts,
articles, and such.
After you make local changes to the documentation, you will be able to build the
project running::
tox -e docs
Then open ``.tox/docs/tmp/html/index.html`` in a web browser to see your local
build of the documentation.
.. note::
If you don't have ``tox`` installed, you need to install it first using
``pip install tox``.
Submit Feedback
~~~~~~~~~~~~~~~
The best way to send feedback is to file an issue at https://github.com/scrapinghub/dateparser/issues.
If you are proposing a feature:
* Explain in detail how it would work.
* Keep the scope as narrow as possible, to make it easier to implement.
* Remember that contributions are welcome :)
Get Started!
------------
Ready to contribute? Here's how to set up `dateparser` for local development.
1. Fork the `dateparser` repo on GitHub.
2. Clone your fork locally::
$ git clone git@github.com:your_name_here/dateparser.git
3. Install your local copy into a virtualenv. Assuming you have virtualenvwrapper
installed, this is how you set up your fork for local development::
$ mkvirtualenv dateparser
$ cd dateparser/
$ python setup.py develop
4. Create a branch for local development::
$ git checkout -b name-of-your-bugfix-or-feature
Now you can make your changes locally.
5. When you're done making changes, check that your changes pass flake8 and the
tests, including testing other Python versions with tox::
$ tox
To get ``tox``, just ``pip install`` it into your virtualenv. In addition to tests, ``tox`` checks for code style and maximum line length (119 characters).
6. Commit your changes and push your branch to GitHub::
$ git add .
$ git commit -m "Your detailed description of your changes."
$ git push origin name-of-your-bugfix-or-feature
7. Submit a pull request through the GitHub website.
Pull Request Guidelines
-----------------------
Before you submit a pull request, check that it meets these guidelines:
1. The pull request should include tests.
2. If the pull request adds functionality, the docs should be updated. Put
your new functionality into a function with a docstring, and add the
feature to the list in *README.rst*.
3. Check the pipelines (Github Actions) in the PR comments (or in
https://github.com/scrapinghub/dateparser/actions) and make sure that the
tests pass for all supported Python versions.
4. Check the new project coverage in the PR comments (or in
https://app.codecov.io/gh/scrapinghub/dateparser/pulls) and make sure that
it remained equal or higher than previously.
5. Follow the core developers' advice which aims to ensure code's consistency
regardless of the variety of approaches used by many contributors.
6. In case you are unable to continue working on a PR, please leave a short
comment to notify us. We will be pleased to make any changes required to get
it done.
Guidelines for Editing Translation Data
---------------------------------------
English is the primary language of Dateparser. Dates in all other languages are
translated into English equivalents before they are parsed.
The language data that Dateparser uses to parse dates is in
``dateparser/data/date_translation_data``. For each supported language, there
is a Python file containing translation data.
Each translation data Python files contains different kinds of translation data
for date parsing: month and week names - and their abbreviations, prepositions,
conjunctions, frequently used descriptive words and phrases (like “today”),
etc.
Translation data Python files are generated from the following sources:
- `Unicode CLDR <http://cldr.unicode.org/>`_ data in JSON format, located at
``dateparser_data/cldr_language_data/date_translation_data``
- Additional data from the Dateparser community in YAML format, located at
``dateparser_data/supplementary_language_data/date_translation_data``
If you wish to extend the data of an existing language, or add data for a new
language, you must:
#. Edit or create the corresponding file within
``dateparser_data/supplementary_language_data/date_translation_data``
See existing files to learn how they are defined, and see
:ref:`language-data-template` for details.
#. Regenerate the corresponding file within
``dateparser/data/date_translation_data`` running the following script::
dateparser_scripts/write_complete_data.py
#. Write tests that cover your changes
You should be able to find tests that cover the affected data, and use
copy-and-paste to create the corresponding new test.
If in doubt, ask Dateparser maintainers for help.
.. toctree::
:maxdepth: 2
:hidden:
template
Updating the List of Supported Languages and Locales
----------------------------------------------------
Whenever the content of
``dateparser.data.languages_info.language_locale_dict`` is modified, use
``dateparser_scripts/update_supported_languages_and_locales.py`` to update
the corresponding documentation table::
dateparser_scripts/update_supported_languages_and_locales.py
Updating the Timezone Cache
----------------------------------------------------
Whenever the content of
``dateparser/timezones.py`` is modified you need to rebuild the timezone cache.
Run this command:
``BUILD_TZ_CACHE=1 python -c "import dateparser"``
which should update
``dateparser/data/dateparser_tz_cache.pkl``
|
