Benjamin Peterson
88623d76b4
use our own locale independent ctype macros
...
requires building pyctype.o into pgen
2010-04-03 23:03:35 +00:00
Benjamin Peterson
4ceeeb09d8
ensure that the locale does not affect the tokenization of identifiers
2010-04-03 22:48:51 +00:00
Victor Stinner
6664426d7c
Issue #3137 : Don't ignore errors at startup, especially a keyboard interrupt
...
(SIGINT). If an error occurs while importing the site module, the error is
printed and Python exits. Initialize the GIL before importing the site
module.
2010-03-10 22:30:19 +00:00
Victor Stinner
d23d3930ff
Issue #7820 : The parser tokenizer restores all bytes in the right if the BOM
...
check fails.
Fix an assertion in pydebug mode.
2010-03-02 23:20:02 +00:00
Benjamin Peterson
42d63847c3
rewrite translate_newlines for clarity
2009-12-06 17:37:48 +00:00
Benjamin Peterson
e36199b49d
fix several compile() issues by translating newlines in the tokenizer
2009-11-12 23:39:44 +00:00
Benjamin Peterson
e3383b8e8f
spelling
2009-11-07 01:04:38 +00:00
Benjamin Peterson
9586cf8677
fix some coding style
2009-10-09 21:48:14 +00:00
Benjamin Peterson
08a0bbc846
don't mask encoding errors when decoding a string #6289
2009-06-16 00:29:31 +00:00
Andrew M. Kuchling
110a48cf60
#3367 : revert rev. 65539: this change causes test_parser to fail
2008-08-05 02:05:23 +00:00
Andrew M. Kuchling
efa61bc15f
#3367 from Kristjan Valur Jonsson:
...
If a PyTokenizer_FromString() is called with an empty string, the
tokenizer's line_start member never gets initialized. Later, it is
compared with the token pointer 'a' in parsetok.c:193 and that behavior
can result in undefined behavior.
2008-08-05 01:38:08 +00:00
Gregory P. Smith
dd96db63f6
This reverts r63675 based on the discussion in this thread:
...
http://mail.python.org/pipermail/python-dev/2008-June/079988.html
Python 2.6 should stick with PyString_* in its codebase. The PyBytes_* names
in the spirit of 3.0 are available via a #define only. See the email thread.
2008-06-09 04:58:54 +00:00
Christian Heimes
593daf545b
Renamed PyString to PyBytes
2008-05-26 12:51:38 +00:00
Amaury Forgeot d'Arc
5216721a53
Issue2681: the literal 0o8 was wrongly accepted, and evaluated as float(0.0).
...
This happened only when 8 is the first digit.
Credits go to Lukas Meuser.
2008-04-24 18:07:05 +00:00
Neal Norwitz
d183bdd6fb
Revert r61969 which added casts to Py_CHARMASK to avoid compiler warnings.
...
Rather than sprinkle casts throughout the code, change Py_CHARMASK to
always cast it's result to an unsigned char. This should ensure we
do the right thing when accessing an array with the result.
2008-03-28 04:58:51 +00:00
Georg Brandl
d5b635f196
Make Py3k warnings consistent w.r.t. punctuation; also respect the
...
EOL 80 limit and supply more alternatives in warning messages.
2008-03-25 08:29:14 +00:00
Eric Smith
9ff19b5434
Finished backporting PEP 3127, Integer Literal Support and Syntax.
...
Added 0b and 0o literals to tokenizer.
Modified PyOS_strtoul to support 0b and 0o inputs.
Modified PyLong_FromString to support guessing 0b and 0o inputs.
Renamed test_hexoct.py to test_int_literal.py and added binary tests.
Added upper and lower case 0b, 0O, and 0X tests to test_int_literal.py
2008-03-17 17:32:20 +00:00
Neal Norwitz
c44af337ce
Add assertion that we do not blow out newl
2008-01-27 17:10:29 +00:00
Christian Heimes
082c9b0267
Fixed bug #1915 : Python compiles with --enable-unicode=no again. However several extension methods and modules do not work without unicode support.
2008-01-23 14:20:50 +00:00
Georg Brandl
898f1879e1
Add a "const" to make gcc happy.
2008-01-21 21:14:21 +00:00
Georg Brandl
38d1715b0d
Issue #1882 : when compiling code from a string, encoding cookies in the
...
second line of code were not always recognized correctly.
2008-01-21 18:35:49 +00:00
Georg Brandl
14404b68d8
Fix #1679 : "0x" was taken as a valid integer literal.
...
Fixes the tokenizer, tokenize.py and int() to reject this.
Patches by Malte Helmert.
2008-01-19 19:27:05 +00:00
Christian Heimes
288e89acfc
Added bytes and b'' as aliases for str and ''
2008-01-18 18:24:07 +00:00
Georg Brandl
76b30d1688
Fix #define ordering.
2008-01-07 18:41:34 +00:00
Georg Brandl
dfe5dc8455
Make Python compile with --disable-unicode.
2008-01-07 18:16:36 +00:00
