77 Commits

Author	SHA1	Message	Date
Damien George	a563592b11	webassembly/asyncio: Fix ThenableEvent to handle rejected thenables. ... Prior to this fix, if a JavaScript thenable/Promise that was part of an asyncio chain was rejected it would be ignored because the Python-side `ThenableEvent` did not register a handler for the rejection. That's fixed by this commit, and a corresponding test added. Signed-off-by: Damien George <damien@micropython.org>	2025-09-30 17:39:15 +10:00
Damien George	094000d418	webassembly/objjsproxy: Fix logic that determines if asyncio is active. ... `cur_task` can never be `None` in the webassembly port, so test it for the top-level task to see if an asyncio Task is active or not. This fixes a bug where await'ing on a JavaScript awaitable that ends up raising an error would not be caught on the Python side. The fix here makes sure it is caught by Python, as tested by the new test. Signed-off-by: Damien George <damien@micropython.org>	2025-09-30 17:39:15 +10:00
Damien George	68ca22bbc8	tests/ports/webassembly: Expand test for registerJsModule. ... This tests `from mod import foo` where `mod` is a module registered using the webassembly API `registerJsModule(mod)`, and where `foo` is a JavaScript function. Prior to the parent commit, this would fail. Signed-off-by: Damien George <damien@micropython.org>	2025-09-30 11:04:05 +10:00
Damien George	a319ddefa6	webassembly: Improve identity and fix bug with lost JsProxy refs. ... Commit ffa98cb014 improved equality for `JsProxy` objects so that, eg, `js.Object == js.Object` is true. As mentioned in #17758, a further optimisation is to make identity work in that case, eg `js.Object is js.Object` should be true (on the Python side). This commit implements that, by keeping track of all `JsProxy` Python objects and reusing them where possible: where the underlying JS ref is equal, ie they point to the same JS object. That reduces memory churn and gives better identity behaviour of JS objects proxied over to Python. As part of this, a bug is fixed where JS objects can be freed while there's still a `JsProxy` referring to that JS object. A test is added for that exact scenario, and the test now passes. Signed-off-by: Damien George <damien@micropython.org>	2025-09-26 14:07:07 +10:00
Damien George	24f395b5db	tests/ports/webassembly: Move JsProxy identity test to separate file. ... This test is not a PyProxy test, rather it's a JsProxy test. Signed-off-by: Damien George <damien@micropython.org>	2025-09-26 14:02:11 +10:00
Damien George	b44c4de4fd	tests/ports/unix: Add coverage test for readinto1 stream method. ... And expand the test for `readinto()` to test the difference between trying to read the requested amount by doing multiple underlying IO calls, and only doing one call. Signed-off-by: Damien George <damien@micropython.org>	2025-09-26 00:24:08 +10:00
Chris Webb	ccc954256f	tests: Generalise rp2 timer test into a cross-port test. ... Now all ports with machine.Timer except nrf support both hard and soft callbacks, generalise tests/ports/rp2_machine_timer.py into tests/extmod/machine_timer.py. There is an existing machine_soft_timer.py which varies period= and covers the nrf port but skips esp32/esp8266 because they don't support software timers. In our new test, we try varying freq= instead of period=, and cover esp32/esp8266 (with a fixed choice of hardware timer) but skip nrf because it doesn't support hard= or freq=. Add a check that the heap is locked (so allocation fails) in hard callbacks and it is unlocked (so allocation succeeds) in soft callbacks, to ensure we're getting the right kind of callback, not falling back to the default. Signed-off-by: Chris Webb <chris@arachsys.com>	2025-09-25 23:59:24 +10:00
Damien George	b3c8ed6c33	tests/ports/rp2: Decrease test lower bound for thread lightsleep time. ... This makes the rp2-specific lightsleep test more lenient, so it passes. This test was added in PR #16454 / 69993daa5c and even back then it did not pass reliably on RP2040. The issue is that threads can race each other to enter lightsleep mode, and when one of them actually stops the CPU clock the other thread is stopped as well. Depending on whether the other thread was just entering or just exiting lightsleep itself, the total duration of all sleeps can vary and can be as small as 2*T. Therefore, adjust the minimum to allow 2*T. `machine.lightsleep()` is anyway 1) specified only to wait at most the given time; and 2) not well specified when multiple threads call it at the same time. So it seems OK to make the test more lenient. Work done in collaboration with @projectgus. Signed-off-by: Damien George <damien@micropython.org>	2025-09-08 11:07:36 +10:00
Yoctopuce dev	dbbaa959c8	py/formatfloat: Improve accuracy of float formatting code. ... Following discussions in PR #16666, this commit updates the float formatting code to improve the `repr` reversibility, i.e. the percentage of valid floating point numbers that do parse back to the same number when formatted by `repr` (in CPython it's 100%). This new code offers a choice of 3 float conversion methods, depending on the desired tradeoff between code size and conversion precision: - BASIC method is the smallest code footprint - APPROX method uses an iterative method to approximate the exact representation, which is a bit slower but but does not have a big impact on code size. It provides `repr` reversibility on >99.8% of the cases in double precision, and on >98.5% in single precision (except with REPR_C, where reversibility is 100% as the last two bits are not taken into account). - EXACT method uses higher-precision floats during conversion, which provides perfect results but has a higher impact on code size. It is faster than APPROX method, and faster than the CPython equivalent implementation. It is however not available on all compilers when using FLOAT_IMPL_DOUBLE. Here is the table comparing the impact of the three conversion methods on code footprint on PYBV10 (using single-precision floats) and reversibility rate for both single-precision and double-precision floats. The table includes current situation as a baseline for the comparison: PYBV10 REPR_C FLOAT DOUBLE current = 364688 12.9% 27.6% 37.9% basic = 364812 85.6% 60.5% 85.7% approx = 365080 100.0% 98.5% 99.8% exact = 366408 100.0% 100.0% 100.0% Signed-off-by: Yoctopuce dev <dev@yoctopuce.com>	2025-08-01 00:47:33 +10:00
Damien George	ffa98cb014	webassembly/proxy_js: Reuse JsProxy ref if object matches. ... This reduces memory use by reusing objects, and improves identity/equality relationships of JavaScript objects on the Python side. In 77bd8fe5b8 PyProxy's were reused when the same Python object was proxied across to JavaScript. This commit does the same thing but for JsProxy's going from JS to Python. If an existing JsProxy reference exists for the JS object about to be proxied across, then it's reused. This helps reduce the number of alive objects (memory use), and, more importantly, improves equality relationships of JavaScript objects on the Python side. Eg we now get, on the Python side: import js print(js.Object == js.Object) that prints True. Previously it was False. Note that this change does not make identity work with `is`, for example `js.Object is js.Object` is actually False. With more work that could be made True but for now we leave that as-is. The behaviour with this commit matches Pyodide semantics. Signed-off-by: Damien George <damien@micropython.org>	2025-07-31 11:40:50 +10:00
TianShuang Ke	ca9916968c	esp32: Add support for ESP32-C2 (aka ESP8684). ... Includes: esp32/esp32c2: Adapt to target chip ESP32C2. esp32/esp32c2: Fix heap size is too small to enable Bluetooth. Signed-off-by: TianShuangKe <qinyun575@gmail.com> Signed-off-by: Angus Gratton <angus@redyak.com.au>	2025-07-30 10:51:29 +10:00
Damien George	45aa65b67d	webassembly/objjsproxy: Fix binding of self to JavaScript methods. ... Fixes a bug in the binding of self/this to JavaScript methods. The new semantics match Pyodide's behaviour, at least for the included tests. Signed-off-by: Damien George <damien@micropython.org>	2025-07-24 14:38:08 +10:00
webreflection	c72a3e528d	webassembly/objpyproxy: Avoid throwing on implicit symbols access. ... This commit improves get handling by guarding against implicit unknown symbols accessed directly by specific JS native APIs. Fixes issue #17657. Signed-off-by: Andrea Giammarchi <andrea.giammarchi@gmail.com>	2025-07-17 14:37:53 +10:00
Jeff Epler	628d53d23c	unix/coverage: Expand mp_printf coverage tests. ... Test 'l' and 'll' sized objects. When the platform's `mp_int_t` is not 64 bits, dummy values are printed instead so the test result can match across all platforms. Ensure hex test values have a letter so 'x' vs 'X' is tested. And test 'p' and 'P' pointer printing. Signed-off-by: Jeff Epler <jepler@gmail.com>	2025-07-16 11:13:08 +10:00
Yoctopuce dev	c4a88f2ce7	py/obj: Add functions to retrieve large integers from mp_obj_t. ... This commit provides helpers to retrieve integer values from mp_obj_t when the content does not fit in a 32 bits integer, without risking an implicit wrap due to an int overflow. Signed-off-by: Yoctopuce dev <dev@yoctopuce.com>	2025-07-09 11:54:21 +10:00
Damien George	b680011d91	tests/ports/stm32: Tweak tests to run on a wider set of boards. ... There should be no change to these tests for existing PYBV1x and PYBD_SFx boards. Signed-off-by: Damien George <damien@micropython.org>	2025-07-08 13:18:55 +10:00
Jeff Epler	fcfed6a0ea	unix/variants/coverage: Enable sys.settrace. ... The unix coverage variant should have all features enabled, so they can be tested for coverage. Therefore, enabled `MICROPY_PY_SYS_SETTRACE`. Signed-off-by: Jeff Epler <jepler@gmail.com>	2025-07-06 00:04:18 +10:00
Andrea Giammarchi	e33a0f4682	webassembly/objpyproxy: Avoid throwing on symbol or iterator has-check. ... JavaScript code uses "Symbol in object" to brand check its own proxies, and such checks should also work on the Python side. Signed-off-by: Andrea Giammarchi <andrea.giammarchi@gmail.com>	2025-07-04 15:08:03 +10:00
Andrew Leech	09541b7896	py/repl: Skip private variables when printing tab completion options. ... Any '_' variables/functions in frozen modules are currently printed, when they shouldn't be. That's due to underscore names possibly existing between the start and end qstrs which are used to print the auto-complete matches. The underscore names should be skipped when iterating between the two boundary qstrs. The underscore attributes are removed from the extra coverage exp file because tab completing "import <tab>" no longer lists modules beginning with an underscore. Signed-off-by: Andrew Leech <andrew.leech@planetinnovation.com.au>	2025-06-19 17:23:42 +10:00
Chris Webb	8f85edad86	tests/ports/rp2: Add tests for rp2-specific timer options. ... Add tests for both one-shot and periodic timers using the rp2-specific tick_hz= and hard= parameters. Signed-off-by: Chris Webb <chris@arachsys.com>	2025-06-16 12:35:51 +01:00
Jeff Epler	fc6205c4f0	unix/coverage: Add coverage test for left adjusted print. ... Signed-off-by: Jeff Epler <jepler@gmail.com>	2025-06-16 13:59:57 +10:00
Jeff Epler	0ef5ede382	py/mpz: Avoid undefined behavior decrementing NULL. ... In the case where an mpz number is zero, its `len` is 0 and its `dig` is NULL. In that case, decrementing NULL via `d--` is undefined behavior according to the C specification. Restructuring the loops in this way avoids undefined behavior. Also, ensure that these cases are tested in the coverage test. This doesn't make much difference now, but would otherwise cause errors later when the undefined behavior sanitizer is employed in CI. Signed-off-by: Jeff Epler <jepler@gmail.com>	2025-06-16 12:11:07 +10:00
Andrew Leech	820485358d	unix/coverage: Add coverage test for mp_sched_schedule_node. ... Test modified to reschedule itself based on a flag setting. Without the change in the parent commit, this test executes the callback indefinitely and hangs but with the change it runs only once each time mp_handle_pending() is called. Modified-by: Angus Gratton <angus@redyak.com.au> Signed-off-by: Andrew Leech <andrew.leech@planetinnovation.com.au>	2025-06-04 11:31:12 +10:00
Angus Gratton	69993daa5c	rp2/modmachine: Add mutual exclusion for machine.lightsleep(). ... There's no specified behaviour for what should happen if both CPUs call `lightsleep()` together, but the latest changes could cause a permanent hang due to a race in the timer cleanup code. Add a flag to prevent hangs if two threads accidentally lightsleep, at least. This allows the new lightsleep test to pass on RPI_PICO and RPI_PICO2, and even have much tighter time deltas. However, the test still fails on wireless boards where the lwIP tick wakes them up too frequently. This work was funded through GitHub Sponsors. Signed-off-by: Angus Gratton <angus@redyak.com.au>	2025-05-12 16:30:46 +10:00
Angus Gratton	977fd94856	tests/ports/rp2: Add a test case for light sleeping from CPU1. ... Not currently passing. This work was funded through GitHub Sponsors. Signed-off-by: Angus Gratton <angus@redyak.com.au>	2025-05-12 16:30:38 +10:00
Peter Harper	03da15575f	tests/ports/rp2: Update machine idle test to revert skip for RP2350. ... This reverts commit b42bb911c6. Signed-off-by: Peter Harper <peter.harper@raspberrypi.com>	2025-05-12 16:29:51 +10:00
Damien George	00a0cd70f5	tests/ports/rp2: Tune rp2.DMA test so it runs in all configurations. ... Changes in this commit: - Allow the DMA instance to be any instance, not just DMA(0); eg WLAN may be using DMA(0). - Make the DMA timing test run a little faster by preloading `dma.active`. - Run the DMA timing test 10 times and take the average time taken as the test result, to eliminate any big effects of caching. - Change the expected time to `range(30, 80)` to cover RP2040, RP2350, RISC-V variants, and both bytecode and native emitter. - Add a `sleep_ms(1)` after waiting for the IRQ to fire, so that any scheduled code gets a chance to run when the test is compiled with the native emitter. With these changes this test passes reliably on RPI_PICO, RPI_PICO_W, RPI_PICO2, RPI_PICO2_W, RPI_PICO2-RISCV and RPI_PICO2_W-RISCV, in both bytecode and native emitter mode, with and without WLAN enabled. Signed-off-by: Damien George <damien@micropython.org>	2025-05-01 13:18:28 +10:00
Damien George	ffd7e0e28d	tests/ports/rp2: Convert rp2.DMA test to a unittest. ... This test is rather complicated and benefits from being a unittest. Signed-off-by: Damien George <damien@micropython.org>	2025-05-01 13:18:28 +10:00
Damien George	2ad5925302	tests/ports/alif_hardware: Add flash testing script. ... This test is not intended to be run automatically and does not have a corresponding .exp file. Signed-off-by: Damien George <damien@micropython.org>	2025-04-09 00:22:33 +10:00
Christian Clauss	8ce7a58be2	tests: Four typos in tests directory. ... Found by codespell. Signed-off-by: Christian Clauss <cclauss@me.com>	2025-02-25 23:34:53 +11:00
Christian Clauss	dc2fcfcc55	all: Upgrade to ruff v0.9.6. ... Signed-off-by: Christian Clauss <cclauss@me.com>	2025-02-25 13:02:49 +01:00
Damien George	c3a18d74eb	extmod/modmarshal: Add new marshal module. ... This commit implements a small subset of the CPython `marshal` module. It implements `marshal.dumps()` and `marshal.loads()`, but only supports (un)marshalling code objects at this stage. The semantics match CPython, except that the actual marshalled bytes is not compatible with CPython's marshalled bytes. The module is enabled at the everything level (only on the unix coverage build at this stage). Signed-off-by: Damien George <damien@micropython.org>	2025-02-11 16:54:20 +11:00
Mike Bell	3699cf5f38	rp2/rp2_flash: Workaround multicore lockout not being reset. ... With regression test. See upstream bug https://github.com/raspberrypi/pico-sdk/issues/2201 Tested-by: Angus Gratton <angus@redyak.com.au> Signed-off-by: Mike Bell <mdb036@gmail.com>	2025-02-07 12:13:34 +11:00
Damien George	81ab49a607	tests/ports/rp2: Add test for SLEEP_ENx registers over lightsleep. ... Signed-off-by: Damien George <damien@micropython.org>	2025-02-07 11:53:16 +11:00
Alessandro Gatti	268acb714d	py/emitinlinerv32: Add inline assembler support for RV32. ... This commit adds support for writing inline assembler functions when targeting a RV32IMC processor. Given that this takes up a bit of rodata space due to its large instruction decoding table and its extensive error messages, it is enabled by default only on offline targets such as mpy-cross and the qemu port. Signed-off-by: Alessandro Gatti <a.gatti@frob.it>	2025-01-02 11:49:10 +11:00
Alessandro Gatti	a5270c84cf	tests/inlineasm: Make room for RV32IMC inline asm tests. ... Thumb/Thumb2 tests are now into their own subdirectory, as RV32IMC-specific tests will be added as part of the RV32 inline assembler support. Signed-off-by: Alessandro Gatti <a.gatti@frob.it>	2025-01-01 10:44:50 +01:00
Peter Harper	a93762a762	rp2/modmachine: Fix USB sleep on RP2350 MCUs. ... Signed-off-by: Peter Harper <peter.harper@raspberrypi.com>	2024-12-19 16:54:30 +11:00
Damien George	f62df1a2c2	tests/ports/stm32_hardware: Convert DMA test to use unittest. ... Signed-off-by: Damien George <damien@micropython.org>	2024-12-06 13:48:23 +11:00
Damien George	b42bb911c6	tests/ports/rp2: Update lightsleep/machine_idle to skip on RP2350. ... Signed-off-by: Damien George <damien@micropython.org>	2024-10-15 12:23:06 +11:00
Damien George	651b63cd79	tests/ports/rp2: Add simple rp2-specific UART test. ... To test construction of UART instances. Signed-off-by: Damien George <damien@micropython.org>	2024-10-15 12:23:06 +11:00
Damien George	fda7ae83a8	tests/ports/rp2: Update DMA test to work on RP2350. ... Signed-off-by: Damien George <damien@micropython.org>	2024-10-15 12:21:10 +11:00
Andrew Leech	7e14680a83	py/objringio: Add micropython.RingIO() interface for general use. ... This commit adds a new `RingIO` type which exposes the internal ring-buffer code for general use in Python programs. It has the stream interface making it similar to `StringIO` and `BytesIO`, except `RingIO` has a fixed buffer size and is automatically safe when reads and writes are in different threads or an IRQ. This new type is enabled at the "extra features" ROM level. Signed-off-by: Andrew Leech <andrew.leech@planetinnovation.com.au>	2024-09-19 18:00:44 +10:00
Michael Sawyer	230e521515	tests/ports/unix: Update and extend the modffi integer tests. ... Added the "long" modffi tests. The tests could not be added to the existing ffi_types test because two .exp files were required for the 32-bit and 64-bit results. Code common to both the ffi_types and type "long" tests was factored into ffi_int_base. ffi_types was renamed to ffi_int_types to group the related tests under the "ffi_int" prefix. Signed-off-by: Michael Sawyer <mjfsawyer@gmail.com>	2024-09-19 15:00:17 +10:00
Damien George	659113825d	qemu: Rename qemu-arm port to qemu. ... Because this port now supports multiple architectures. Signed-off-by: Damien George <damien@micropython.org>	2024-09-06 11:08:39 +10:00
Angus Gratton	a6fa85d8f9	unix: Switch stack limit check to new cstack API. ... Necessary to pass CI when testing the V2 preview APIs. Also adds an extra coverage test for the legacy stackctrl API, to maintain coverage and check for any regression. This work was funded through GitHub Sponsors. Signed-off-by: Angus Gratton <angus@redyak.com.au>	2024-08-14 12:57:27 +10:00
Angus Gratton	ba98533454	rp2: Stop machine.idle() blocking indefinitely. ... Updates rp2 port to always resume from idle within 1ms max. When rp2 port went tickless the behaviour of machine.idle() changed as there is no longer a tick interrupt to wake it up every millisecond. On a quiet system it would now block indefinitely. No other port does this. See parent commit for justification of why this change is useful. Also adds a test case that fails without this change. This work was funded through GitHub Sponsors. Signed-off-by: Angus Gratton <angus@redyak.com.au>	2024-07-23 16:46:27 +10:00
Damien George	77bd8fe5b8	webassembly: Reuse PyProxy objects when they are the same Python object. ... This commit makes it so that PyProxy objects are reused (on the JavaScript side) when they correspond to an existing Python object that is the same object. For example, proxying the same Python function to JavaScript, the same PyProxy instance is now used. This means that if `foo` is a Python function then accessing it on the JavaScript side such as `api.globals().get("foo")` has the property that: api.globals().get("foo") === api.globals().get("foo") Prior to this commit the above was not true because new PyProxy instances were created each time `foo` was accessed. Signed-off-by: Damien George <damien@micropython.org>	2024-07-19 11:55:24 +10:00
Jim Mussared	557d31ed2c	py/objint: Try to convert big-int back to small-int after binary op. ... Before this change, long/mpz ints propagated into all future calculations, even if their value could fit in a small-int object. With this change, the result of a big-int binary op will now be converted to a small-int object if the value fits in a small-int. For example, a relatively common operation like `x = a * b // c` where a,b,c all small ints would always result in a long/mpz int, even if it didn't need to, and then this would impact all future calculations with x. This adds +24 bytes on PYBV11 but avoids heap allocations and potential surprises (e.g. `big-big` is now a small `0`, and can safely be accessed with MP_OBJ_SMALL_INT_VALUE). Performance tests are unchanged on PYBV10, except for `bm_pidigits.py` which makes heavy use of big-ints and gains about 8% in speed. Unix coverage tests have been updated to cover mpz code that is now unreachable by normal Python code (removing the unreachable code would lead to some surprising gaps in the internal C functions and the functionality may be needed in the future, so it is kept because it has minimal overhead). This work was funded through GitHub Sponsors. Signed-off-by: Jim Mussared <jim.mussared@gmail.com>	2024-07-01 13:52:59 +10:00
Damien George	95c19e05ff	webassembly/objjsproxy: Lookup attributes without testing they exist. ... In JavaScript when accessing an attribute such as `obj.attr` a value of `undefined` is returned if the attribute does not exist. This is unlike Python semantics where an `AttributeError` is raised. Furthermore, in some cases in JavaScript (eg a Proxy instance) `attr in obj` can return false yet `obj.attr` is still valid and returns something other than `undefined`. So the source of truth for whether a JavaScript attribute exists is to just right away attempt `obj.attr`. To more closely match these JavaScript semantics when proxying a JavaScript object through to Python, change the attribute lookup logic on a `JsProxy` so that it immediately attempts `obj.attr` instead of first testing if the attribute exists via `attr in obj`. This allows JavaScript objects which dynamically create attributes to work correctly on the Python side, with both `obj.attr` and `obj["attr"]`. Note that `obj["attr"]` already works in all cases because it immediately does the subscript access without first testing if the attribute exists. As a benefit, this new behaviour matches the Pyodide behaviour. Signed-off-by: Damien George <damien@micropython.org>	2024-06-28 11:40:24 +10:00
Angus Gratton	068d9bf2cf	rp2: Fix USB PLL glitch during wake from light sleep. ... Follow-up to a84c7a0ed9, this commit works most of the time but has an intermittent bug where USB doesn't resume as expected after waking from light sleep. Turns out waking calls clocks_init() which will re-initialise the USB PLL. Most of the time this is OK but occasionally it seems like the clock glitches the USB peripheral and it stops working until the next hard reset. Adds a machine.lightsleep() test that consistently hangs in the first two dozen iterations on rp2 without this fix. Passed over 100 times in a row with this fix. The test is currently rp2-only as it seems similar lightsleep USB issues exist on other ports (both pyboard and ESP32-S3 native USB don't send any data to the host after waking, until they receive something from the host first.) This work was funded through GitHub Sponsors. Signed-off-by: Angus Gratton <angus@redyak.com.au>	2024-06-25 16:25:19 +10:00