Mathieu Dupuy
|
c49016e67c
|
fix comma location in various places (GH-19233)
|
2020-03-30 14:28:25 -07:00 |
|
Windson yang
|
4b09dc79f4
|
bpo-36654: Add examples for using tokenize module programmically (#12947)
|
2020-01-25 22:23:00 +03:00 |
|
Anthony Sottile
|
2a58b0636d
|
bpo-5028: Fix up rest of documentation for tokenize documenting line (GH-13686)
https://bugs.python.org/issue5028
|
2019-05-30 15:06:32 -07:00 |
|
Andrew Carr
|
1e36f75d63
|
bpo-5028: fix doc bug for tokenize (GH-11683)
https://bugs.python.org/issue5028
|
2019-05-30 12:31:51 -07:00 |
|
Thomas Kluyver
|
c56b17bd8c
|
bpo-12486: Document tokenize.generate_tokens() as public API (#6957)
* Document tokenize.generate_tokens()
* Add news file
* Add test for generate_tokens
* Document behaviour around ENCODING token
* Add generate_tokens to __all__
|
2018-06-05 10:26:39 -07:00 |
|
Serhiy Storchaka
|
46936d5a71
|
Improve highlighting of some code blocks. (GH-6401)
|
2018-04-08 19:18:04 +03:00 |
|
Mariatta
|
ea0f7c26ce
|
bpo-31394: Make tokenize.rst PEP 8-compliant (GH-3526)
The last commit contained lines longer than 80 characters.
|
2017-09-12 21:00:00 -07:00 |
|
Aivar Annamaa
|
5f8fbf917e
|
bpo-31394: Clarify documentation about token type attribute (GH-3469)
Make it clear that Ellipsis tokens also have type attribute set to token.OP.
|
2017-09-12 20:24:03 -07:00 |
|
Serhiy Storchaka
|
5cefb6cfdd
|
bpo-25324: Move the description of tokenize tokens to token.rst. (#1911)
|
2017-06-06 18:43:35 +03:00 |
|
Terry Jan Reedy
|
fa089b9b0b
|
Issue #22558: Add remaining doc links to source code for Python-coded modules.
Reformat header above separator line (added if missing) to a common format.
Patch by Yoni Lavi.
|
2016-06-11 15:02:54 -04:00 |
|
Serhiy Storchaka
|
dba903993a
|
Issue #23921: Standardized documentation whitespace formatting.
Original patch by James Edwards.
|
2016-05-10 12:01:23 +03:00 |
|
Martin Panter
|
20b1bfa6fb
|
Issue #26127: Fix links in tokenize documentation; patch by Silent Ghost
|
2016-01-16 04:32:52 +00:00 |
|
Serhiy Storchaka
|
d65c9496da
|
Issue #25523: Further a-to-an corrections.
|
2015-11-02 14:10:23 +02:00 |
|
Benjamin Peterson
|
96e0430dfb
|
document TokenError and unclosed expression behavior (closes #12063)
Patch by Amandine Lee.
|
2014-06-07 17:47:41 -07:00 |
|
Meador Inge
|
00c7f85298
|
Issue #2134: Add support for tokenize.TokenInfo.exact_type.
|
2012-01-19 00:44:45 -06:00 |
|
Meador Inge
|
14c0f03b58
|
Issue #12943: python -m tokenize support has been added to tokenize.
|
2011-10-07 08:53:38 -05:00 |
|
Raymond Hettinger
|
4f707fd316
|
Separate source link from main text.
|
2011-01-10 19:54:11 +00:00 |
|
Raymond Hettinger
|
1048094037
|
Move source links to consistent location and remove wordy, big yellow boxes.
|
2011-01-10 03:26:08 +00:00 |
|
Éric Araujo
|
6e6cb8e0e4
|
Provide links to Python source where the code is short, readable and
informative adjunct to the docs. Forward-port of Raymond's r86225 and
r86245 using the new source reST role added in #10334.
|
2010-11-16 19:13:50 +00:00 |
|
Victor Stinner
|
58c0752a33
|
Issue #10335: Add tokenize.open(), detect the file encoding using
tokenize.detect_encoding() and open it in read only mode.
|
2010-11-09 01:08:59 +00:00 |
|
Raymond Hettinger
|
6c60d099e5
|
Improve the repr for the TokenInfo named tuple.
|
2010-09-09 04:32:39 +00:00 |
|
Benjamin Peterson
|
b3a482962d
|
show a common usage of detect_encoding
|
2010-03-18 22:43:41 +00:00 |
|
Benjamin Peterson
|
689a558098
|
in tokenize.detect_encoding(), return utf-8-sig when a BOM is found
|
2010-03-18 22:29:52 +00:00 |
|
Antoine Pitrou
|
4adb288f4e
|
Issue #7631: Fix undefined references to the "built-in file object", which
has ceased to be.
|
2010-01-04 18:50:53 +00:00 |
|
Ezio Melotti
|
a8f6f1e2d6
|
Fixed capitalization and markup; added imports in the example
|
2009-12-20 12:24:57 +00:00 |
|