2387 Commits

Author	SHA1	Message	Date
Glenn Moloney	6367099f83	py/objstr: Skip whitespace in bytes.fromhex(). ... Skip whitespace characters between pairs of hex numbers. This makes `bytes.fromhex()` compatible with cpython. Includes simple test in `tests/basic/builtin_str_hex.py`. Signed-off-by: Glenn Moloney <glenn.moloney@gmail.com>	2024-08-19 14:18:34 +10:00
Angus Gratton	fb4ae1eeec	test/extmod: Fix machine_spi_rate test on ESP32-C3. ... Update to the test added in 1e98c4cb75, changes the SPI pins for ESP32-C3 (IO 18 and 19 are the native USB pins). Signed-off-by: Angus Gratton <angus@redyak.com.au>	2024-08-14 15:03:27 +10:00
Angus Gratton	a6fa85d8f9	unix: Switch stack limit check to new cstack API. ... Necessary to pass CI when testing the V2 preview APIs. Also adds an extra coverage test for the legacy stackctrl API, to maintain coverage and check for any regression. This work was funded through GitHub Sponsors. Signed-off-by: Angus Gratton <angus@redyak.com.au>	2024-08-14 12:57:27 +10:00
Angus Gratton	80616aee71	tests/run-tests.py: Enable stress tests on esp32 port. ... Now passing on ESP32-S3 and ESP32-C3. This work was funded through GitHub Sponsors. Signed-off-by: Angus Gratton <angus@redyak.com.au>	2024-08-14 12:56:56 +10:00
Peter Züger	1473ed4c64	tests/extmod/ssl_keycert.py: Add test for PKCS8 formatted DER key. ... Signed-off-by: Peter Züger <zueger.peter@icloud.com>	2024-08-13 17:32:32 +10:00
Angus Gratton	1e98c4cb75	tests/extmod: Add machine_spi_rate test. ... Based on machine_i2s_rate, allows testing basic SPI functionality and timings. Implemented and confirmed working for rp2, esp32, and pyboard. This work was funded through GitHub Sponsors. Signed-off-by: Angus Gratton <angus@redyak.com.au>	2024-08-07 15:07:13 +10:00
Damien George	a4b3825bd4	tests/extmod: Rename machine_timer exp file to machine_soft_timer. ... This was missed in 9ba04cc756 Signed-off-by: Damien George <damien@micropython.org>	2024-08-07 15:02:52 +10:00
Angus Gratton	6d05424754	tests/extmod: Add esp32 support to the machine_i2s_rate test. ... This work was funded through GitHub Sponsors. Signed-off-by: Angus Gratton <angus@redyak.com.au>	2024-08-02 10:31:19 +10:00
Angus Gratton	9ba04cc756	tests/extmod: Skip soft machine.Timer test on esp32 port. ... Also rename the test to reflect that it's a soft timer test. Signed-off-by: Angus Gratton <angus@redyak.com.au>	2024-08-02 10:27:53 +10:00
Damien George	e1fe62f4fc	tests/multi_net: Fix skipping of SSLContext tests when .der don't exist. ... The `sslcontext_server_client_ciphers.py` test was using stat to test for the .der files after it already tried to open them for reading. That is now fixed. And `sslcontext_server_client.py` is adjusted to use the same pattern for skipping the test. Signed-off-by: Damien George <damien@micropython.org>	2024-07-25 18:14:52 +10:00
stijn	1f907a2f5c	tests/run-tests.py: Make Windows test skipping more granular. ... Signed-off-by: stijn <stijn@ignitron.net>	2024-07-25 16:24:04 +10:00
stijn	a0c7bf12d2	github/workflows: Improve MSYS2-based CI builds. ... Install the mingw variant of Python since it behaves more like a 'real' Windows CPython than the msys2 variant: os.name == 'nt', not 'posix'. Note that os.sep is still '/' though so we don't actually need to skip the import_file test. This way one single Python version can be used both for running run-tests.py and getting the expected test output. Signed-off-by: stijn <stijn@ignitron.net>	2024-07-25 16:22:21 +10:00
Damien George	233f5ce661	py/runtime: Fix self arg passed to classmethod when accessed via super. ... Thanks to @AJMansfield for the original test case. Signed-off-by: Damien George <damien@micropython.org>	2024-07-25 13:07:42 +10:00
stijn	093d0c0a17	py/objtype: Validate super() arguments. ... This fixes various null dereferencing and out-of-bounds access because super_attr assumes the held obj is effectively an object of the held type, which is now verified. Fixes issue #12830. Signed-off-by: stijn <stijn@ignitron.net>	2024-07-25 12:27:33 +10:00
David Lechner	d1bf0eeb0f	tests/cpydiff: Add diff for overriding __init__. ... This adds a CPython diff that explains why calling `super().__init__()` is required in MicroPython when subclassing a native type (because `__new__` and `__init__` are not separate functions). Signed-off-by: David Lechner <david@pybricks.com>	2024-07-25 12:01:43 +10:00
Laurens Valk	9ca668f881	py/objtype: Avoid crash on calling members of uninitialized native type. ... When subclassing a native type, calling native members in `__init__` before `super().__init__()` has been called could cause a crash. In this situation, `self` in `mp_convert_member_lookup` is the `native_base_init_wrapper_obj`. The check added in this commit ensures that an `AttributeError` is raised before this happens, which is consistent with other failed lookups. Also fix a typo in a related comment. Signed-off-by: Laurens Valk <laurens@pybricks.com>	2024-07-25 12:01:43 +10:00
Laurens Valk	19b1333cb1	examples/usercmodule/cexample: Add more advanced native class. ... This adds a separate `AdvancedTimer` class that demonstrates a few more advanced concepts usch as custom handlers for printing and attributes. Signed-off-by: Laurens Valk <laurens@pybricks.com>	2024-07-25 11:57:13 +10:00
Angus Gratton	ba98533454	rp2: Stop machine.idle() blocking indefinitely. ... Updates rp2 port to always resume from idle within 1ms max. When rp2 port went tickless the behaviour of machine.idle() changed as there is no longer a tick interrupt to wake it up every millisecond. On a quiet system it would now block indefinitely. No other port does this. See parent commit for justification of why this change is useful. Also adds a test case that fails without this change. This work was funded through GitHub Sponsors. Signed-off-by: Angus Gratton <angus@redyak.com.au>	2024-07-23 16:46:27 +10:00
Angus Gratton	46c3df0229	tests/run-tests.py: Enable thread tests on esp32. ... Before the fix in parent commit, some of these tests hung indefinitely. After, they seem to consistently pass. This work was funded through GitHub Sponsors. Signed-off-by: Angus Gratton <angus@redyak.com.au>	2024-07-23 12:34:14 +10:00
Angus Gratton	337742f6c7	esp32/mpthreadport: Fix uneven GIL allocation between Python threads. ... Explicitly yield each time a thread mutex is unlocked. Key to understanding this bug is that Python threads run at equal RTOS priority, and although ESP-IDF FreeRTOS (and I think vanilla FreeRTOS) scheduler will round-robin equal priority tasks in the ready state it does not make a similar guarantee for tasks moving between ready and waiting. The pathological case of this bug is when one Python thread task is busy (i.e. never blocks) it will hog the CPU more than expected, sometimes for an unbounded amount of time. This happens even though it periodically unlocks the GIL to allow another task to run. Assume T1 is busy and T2 is blocked waiting for the GIL. T1 is executing and hits a condition to yield execution: 1. T1 calls MP_THREAD_GIL_EXIT 2. FreeRTOS sees T2 is waiting for the GIL and moves it to the Ready list (but does not preempt, as T2 is same priority, so T1 keeps running). 3. T1 immediately calls MP_THREAD_GIL_ENTER and re-takes the GIL. 4. Pre-emptive context switch happens, T2 wakes up, sees GIL is not available, and goes on the waiting list for the GIL again. To break this cycle step 4 must happen before step 3, but this may be a very narrow window of time so it may not happen regularly - and quantisation of the timing of the tick interrupt to trigger a context switch may mean it never happens. Yielding at the end of step 2 maximises the chance for another task to run. Adds a test that fails on esp32 before this fix and passes afterwards. Fixes issue #15423. This work was funded through GitHub Sponsors. Signed-off-by: Angus Gratton <angus@redyak.com.au>	2024-07-23 12:33:19 +10:00
stijn	444d7bacbe	extmod/moductypes: Validate the descriptor tuple. ... Fixes various null dereferencing, out-of-bounds memory accesses and `assert(0)` failures in the case of an invalid `uctypes` descriptor. By design `uctypes` can crash because it accesses arbitrary memory, but at least describing the descriptor layout should be forced to be correct and not crash. Fixes issue #12702. Signed-off-by: stijn <stijn@ignitron.net>	2024-07-22 14:40:45 +10:00
Michael Vornovitsky	6db91dfefb	extmod/modbtree: Add checks for already-closed database. ... Fixes use-after-free when accessing the database after it is closed with `btree_close`. `btree_close` always succeeds when called with an already-closed database. The new test checks that operations that access the underlying database (get, set, flush, seq) fail with a `ValueError` when the btree is already closed. It also checks that closing and printing the btree succeed when the btree is already closed. Fixes issue #12543. Signed-off-by: Michael Vornovitsky <michaelvornovitskiy@outlook.com>	2024-07-22 10:42:29 +10:00
Damien George	847ee20d9b	tests/multi_bluetooth/perf_gatt_notify.py: Reduce connection interval. ... To test that the notification ping-pong can be low latency. Signed-off-by: Damien George <damien@micropython.org>	2024-07-19 22:28:31 +10:00
Damien George	77bd8fe5b8	webassembly: Reuse PyProxy objects when they are the same Python object. ... This commit makes it so that PyProxy objects are reused (on the JavaScript side) when they correspond to an existing Python object that is the same object. For example, proxying the same Python function to JavaScript, the same PyProxy instance is now used. This means that if `foo` is a Python function then accessing it on the JavaScript side such as `api.globals().get("foo")` has the property that: api.globals().get("foo") === api.globals().get("foo") Prior to this commit the above was not true because new PyProxy instances were created each time `foo` was accessed. Signed-off-by: Damien George <damien@micropython.org>	2024-07-19 11:55:24 +10:00
Damien George	fce3cea244	tests/extmod: Make get_event_loop tests compatible with CPython 3.12. ... Follow up to 2e852522b1: instead of having .exp files for the get_event_loop tests, tweak them so they are compatible with CPython 3.12. This requires calling `asyncio.set_event_loop()` so there is an active event loop and `asyncio.get_event_loop()` succeeds without a warning. Signed-off-by: Damien George <damien@micropython.org>	2024-07-18 11:08:48 +10:00
Damien George	358e501e75	tests/stress/bytecode_limit.py: Make test more robust with low memory. ... A target may have enough RAM to run the n=433 test but then run out of RAM on the n=432 test. So allow the test to skip on the n=432 case before it prints any output. Signed-off-by: Damien George <damien@micropython.org>	2024-07-05 17:07:30 +10:00
Damien George	633586a716	tests/thread/stress_aes.py: Fix logic waiting for finished threads. ... Because the main thread executes `thread_entry()` it means there's an additional one added to `count`, so the test must wait for the count to reach `n_thread + 1`. Signed-off-by: Damien George <damien@micropython.org>	2024-07-05 17:07:27 +10:00
Sylvain Zimmer	838794ebcc	extmod/mbedtls: Enable GCM and ECDHE-RSA in common mbedtls config. ... Enable support for cipher suites like TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256, as suggested in https://github.com/micropython/micropython/issues/14204#issuecomment-2024366349 and https://github.com/micropython/micropython/issues/10485#issuecomment-1396426824 Tests have been run on the top 500 domains from moz.com. Without this patch, 155 out of 500 fail to connect because of TLS issues. This patch fixes them all. And it seems all existing mbedtls flags are needed to get good coverage of those top 500 domains. The `ssl_poll.py` test has the cipher bits increased from 512 to 1024 in its test key/cert so that it can work with ECDHE-RSA which is now the chosen cipher. Signed-off-by: Sylvain Zimmer <sylvain@sylvainzimmer.com> Signed-off-by: Damien George <damien@micropython.org>	2024-07-02 13:19:17 +10:00
Jim Mussared	557d31ed2c	py/objint: Try to convert big-int back to small-int after binary op. ... Before this change, long/mpz ints propagated into all future calculations, even if their value could fit in a small-int object. With this change, the result of a big-int binary op will now be converted to a small-int object if the value fits in a small-int. For example, a relatively common operation like `x = a * b // c` where a,b,c all small ints would always result in a long/mpz int, even if it didn't need to, and then this would impact all future calculations with x. This adds +24 bytes on PYBV11 but avoids heap allocations and potential surprises (e.g. `big-big` is now a small `0`, and can safely be accessed with MP_OBJ_SMALL_INT_VALUE). Performance tests are unchanged on PYBV10, except for `bm_pidigits.py` which makes heavy use of big-ints and gains about 8% in speed. Unix coverage tests have been updated to cover mpz code that is now unreachable by normal Python code (removing the unreachable code would lead to some surprising gaps in the internal C functions and the functionality may be needed in the future, so it is kept because it has minimal overhead). This work was funded through GitHub Sponsors. Signed-off-by: Jim Mussared <jim.mussared@gmail.com>	2024-07-01 13:52:59 +10:00
Damien George	95c19e05ff	webassembly/objjsproxy: Lookup attributes without testing they exist. ... In JavaScript when accessing an attribute such as `obj.attr` a value of `undefined` is returned if the attribute does not exist. This is unlike Python semantics where an `AttributeError` is raised. Furthermore, in some cases in JavaScript (eg a Proxy instance) `attr in obj` can return false yet `obj.attr` is still valid and returns something other than `undefined`. So the source of truth for whether a JavaScript attribute exists is to just right away attempt `obj.attr`. To more closely match these JavaScript semantics when proxying a JavaScript object through to Python, change the attribute lookup logic on a `JsProxy` so that it immediately attempts `obj.attr` instead of first testing if the attribute exists via `attr in obj`. This allows JavaScript objects which dynamically create attributes to work correctly on the Python side, with both `obj.attr` and `obj["attr"]`. Note that `obj["attr"]` already works in all cases because it immediately does the subscript access without first testing if the attribute exists. As a benefit, this new behaviour matches the Pyodide behaviour. Signed-off-by: Damien George <damien@micropython.org>	2024-06-28 11:40:24 +10:00
Angus Gratton	068d9bf2cf	rp2: Fix USB PLL glitch during wake from light sleep. ... Follow-up to a84c7a0ed9, this commit works most of the time but has an intermittent bug where USB doesn't resume as expected after waking from light sleep. Turns out waking calls clocks_init() which will re-initialise the USB PLL. Most of the time this is OK but occasionally it seems like the clock glitches the USB peripheral and it stops working until the next hard reset. Adds a machine.lightsleep() test that consistently hangs in the first two dozen iterations on rp2 without this fix. Passed over 100 times in a row with this fix. The test is currently rp2-only as it seems similar lightsleep USB issues exist on other ports (both pyboard and ESP32-S3 native USB don't send any data to the host after waking, until they receive something from the host first.) This work was funded through GitHub Sponsors. Signed-off-by: Angus Gratton <angus@redyak.com.au>	2024-06-25 16:25:19 +10:00
Angus Gratton	cfa55b4ca1	rp2: Fix recursive atomic sections when core1 is active. ... mp_thread_begin_atomic_section() is expected to be recursive (i.e. for nested machine.disable_irq() calls, or if Python code calls disable_irq() and then the Python runtime calls mp_handle_pending() which also enters an atomic section to check the scheduler state). On rp2 when not using core1 the atomic sections are recursive. However when core1 was active (i.e. _thread) then there was a bug that caused the core to live-lock if an atomic section recursed. Adds a test case specifically for mutual exclusion and recursive atomic sections when using two threads. Without this fix the test immediately hangs on rp2. This work was funded through GitHub Sponsors. Signed-off-by: Angus Gratton <angus@redyak.com.au>	2024-06-25 11:01:25 +10:00
Angus Gratton	908ab1ceca	py/objint: Fix int.to_bytes() buffer size checks. ... Fixes and improvements to `int.to_bytes()` are: - No longer overflows if byte size is 0 (closes #13041). - Raises OverflowError in any case where number won't fit into byte length (now matches CPython, previously MicroPython would return a truncated bytes object). - Document that `micropython int.to_bytes()` doesn't implement the optional signed kwarg, but will behave as if `signed=True` when the integer is negative (this is the current behaviour). Add tests for this also. Requires changes for small ints, MPZ large ints, and "long long" large ints. Adds a new set of unit tests for ints between 32 and 64 bits to increase coverage of "long long" large ints, which are otherwise untested. Tested on unix port (64 bit small ints, MPZ long ints) and Zephyr STM32WB board (32 bit small ints, long long large ints). This work was funded through GitHub Sponsors. Signed-off-by: Angus Gratton <angus@redyak.com.au>	2024-06-24 14:07:00 +10:00
Damien George	0619f261a8	tests/basics: Add tests to test repeated throw into the same generator. ... Signed-off-by: Damien George <damien@micropython.org>	2024-06-21 16:23:08 +10:00
Damien George	038125be79	py/emitnative: Fix native async with. ... The code generating the entry to the finally handler of an async-with statement was simply wrong for the case of the native emitter. Among other things the layout of the stack was incorrect. This is fixed by this commit. The setup of the async-with finally handler is now put in a dedicated emit function, for both the bytecode and native emitters to implement in their own way (the bytecode emitter is unchanged, just factored to a function). With this fix all of the async-with tests now work when using the native emitter. Signed-off-by: Damien George <damien@micropython.org>	2024-06-21 16:21:33 +10:00
Damien George	a19214d897	py/emitnative: Place thrown value in dedicated local variable. ... A value thrown/injected into a native generator needs to be stored in a dedicated variable outside `nlr_buf_t`, following the `inject_exc` variable in `py/vm.c`. Signed-off-by: Damien George <damien@micropython.org>	2024-06-21 16:21:29 +10:00
Angus Gratton	5a778ebc37	tests/thread: Re-enable GC before stress_schedule test ends. ... Otherwise GC stays disabled (not re-enabled by soft reset) and later test runs fail with MemoryError. Signed-off-by: Angus Gratton <angus@redyak.com.au>	2024-06-21 14:45:59 +10:00
Damien George	407464348d	tests/cpydiff: Remove deque difference test. ... Because `collections.deque` is now a built-in type in MicroPython. Signed-off-by: Damien George <damien@micropython.org>	2024-06-21 14:35:43 +10:00
Damien George	88513d1226	webassembly/api: Allow specifying the pystack size. ... This allows increasing the Python recursion depth if needed. Also increase the default to 2k words. There is enough RAM in the browser/node context for this to be increased, and having a larger pystack allows more complex code to run without hitting the limit. Signed-off-by: Damien George <damien@micropython.org>	2024-06-20 00:26:08 +10:00
Damien George	13195a678d	webassembly/asyncio: Schedule run loop when tasks are pushed to queue. ... In the webassembly port there is no asyncio run loop running at the top level. Instead the Python asyncio run loop is scheduled through setTimeout and run by the outer JavaScript event loop. Because tasks can become runable from an external (to Python) event (eg a JavaScript callback), the run loop must be scheduled whenever a task is pushed to the asyncio task queue, otherwise tasks may be waiting forever on the queue. Signed-off-by: Damien George <damien@micropython.org>	2024-06-20 00:11:54 +10:00
Damien George	e9c898cb33	webassembly/asyncio: Support top-level await of asyncio Task and Event. ... This change allows doing a top-level await on an asyncio primitive like Task and Event. This feature enables a better interaction and synchronisation between JavaScript and Python, because `api.runPythonAsync` can now be used (called from JavaScript) to await on the completion of asyncio primitives. Signed-off-by: Damien George <damien@micropython.org>	2024-06-18 22:23:16 +10:00
Damien George	a053e63914	webassembly/objjsproxy: Implement proxying of JS iterable protocol. ... This allows Python to iterate over JavaScript objects that provide Symbol.iterator. Signed-off-by: Damien George <damien@micropython.org>	2024-06-18 22:14:34 +10:00
Alessandro Gatti	2d69aab7b3	qemu-riscv: Add new QEMU RV32 port. ... This adds a QEMU-based bare metal RISC-V 32 bits port. For the time being only QEMU's "virt" 32 bits board is supported, using the ilp32 ABI and the RV32IMC architecture. The top-level README and the run-tests.py files are updated for this new port. Signed-off-by: Alessandro Gatti <a.gatti@frob.it>	2024-06-17 12:06:09 +10:00
Damien George	df0d7e9429	extmod/modlwip: Make socket.connect raise ETIMEDOUT on non-zero timeout. ... If the socket timeout is 0 then a failed socket.connect() raises EINPROGRESS (which is what the lwIP bindings already did), but if the socket timeout is non-zero then a failed socket.connect() should raise ETIMEDOUT. The latter is fixed in this commit. A test is added for these timeout cases. Signed-off-by: Damien George <damien@micropython.org>	2024-06-08 09:02:01 +10:00
Damien George	3c8089d1b1	py/lexer: Support raw f-strings. ... Support for raw str/bytes already exists, and extending that to raw f-strings is easy. It also reduces code size because it eliminates an error message. Signed-off-by: Damien George <damien@micropython.org>	2024-06-06 17:34:28 +10:00
Damien George	a066f2308f	py/lexer: Support concatenation of adjacent f-strings. ... This is quite a simple and small change to support concatenation of adjacent f-strings, and improve compatibility with CPython. Signed-off-by: Damien George <damien@micropython.org>	2024-06-06 14:58:46 +10:00
Damien George	30a9ccf4ca	tests/basics: Move str/bytes tests that give SyntaxWarning to sep file. ... In CPython 3.12 these invalid str/bytes/fstring escapes will issue a SyntaxWarning, and so differ to MicroPython. Signed-off-by: Damien George <damien@micropython.org>	2024-05-28 10:58:37 +10:00
Damien George	dd4767a7d1	tests/basics: Add .exp file for slice_op test. ... CPython 3.12 implemented hashing for slices, so now differs to MicroPython. Signed-off-by: Damien George <damien@micropython.org>	2024-05-28 10:50:57 +10:00
Damien George	ad6750b22e	tests/float: Use "not" instead of ~ to invert bool value. ... Otherwise CPython gives a deprecation warning. This test is not actually testing inversion of bools, rather that bit of the test is used to compute the pass/fail result. Signed-off-by: Damien George <damien@micropython.org>	2024-05-28 10:49:22 +10:00
Damien George	a34b5d1b79	tests/net_inet/tls_text_errors.py: Tweak test for newer CPython version. ... Signed-off-by: Damien George <damien@micropython.org>	2024-05-27 13:56:55 +10:00