2705 Commits

Author	SHA1	Message	Date
Daniël van de Giessen	9287a1e6ea	lib/littlefs: Update LittleFS to v2.10.2. ... Going above the root directory (/../foo) now gives an error. This is an intentional change made by LittleFS. It required a update of the testsuite and is a (minor) compatibility break. Signed-off-by: Daniël van de Giessen <daniel@dvdgiessen.nl>	2025-05-07 17:01:16 +10:00
Yoctopuce dev	bdb7e036d2	extmod/asyncio: Fix early exit of asyncio scheduler. ... This commit fixes three open issues related to the asyncio scheduler exiting prematurely when the main task queue is empty, in cases where CPython would not exit (for example, because the main task is not done because it's on a different queue). In the first case, the scheduler exits because running a task via `run_until_complete` did not schedule any dependent tasks. In the other two cases, the scheduler exits because the tasks are queued in an event queue. Tests have been added which reproduce the original issues. These test cases document the unauthorized use of `Event.set()` from a soft IRQ, and are skipped in unsupported environments (webassembly and native emitter). Fixes issues #16759, #16569 and #16318. Signed-off-by: Yoctopuce dev <dev@yoctopuce.com>	2025-05-07 14:56:47 +10:00
Angus Gratton	79abdad9e9	tests/extmod: Rename ssl tests that only use the tls module. ... Signed-off-by: Angus Gratton <angus@redyak.com.au>	2025-05-02 17:24:58 +10:00
Angus Gratton	70ed315193	py/malloc: Add mutex for tracked allocations. ... Fixes thread safety issue that could cause memory corruption on ports with (MICROPY_PY_THREAD && !MICROPY_PY_THREAD_GIL) - currently only rp2 and unix have this configuration. Adds unit test for TLS sockets that exercises this code path. I wasn't able to make this fail on rp2, the race condition window is pretty narrow and may not have a direct impact on a quiet system. This work was funded through GitHub Sponsors. Signed-off-by: Angus Gratton <angus@redyak.com.au>	2025-05-02 17:24:16 +10:00
Damien George	00a0cd70f5	tests/ports/rp2: Tune rp2.DMA test so it runs in all configurations. ... Changes in this commit: - Allow the DMA instance to be any instance, not just DMA(0); eg WLAN may be using DMA(0). - Make the DMA timing test run a little faster by preloading `dma.active`. - Run the DMA timing test 10 times and take the average time taken as the test result, to eliminate any big effects of caching. - Change the expected time to `range(30, 80)` to cover RP2040, RP2350, RISC-V variants, and both bytecode and native emitter. - Add a `sleep_ms(1)` after waiting for the IRQ to fire, so that any scheduled code gets a chance to run when the test is compiled with the native emitter. With these changes this test passes reliably on RPI_PICO, RPI_PICO_W, RPI_PICO2, RPI_PICO2_W, RPI_PICO2-RISCV and RPI_PICO2_W-RISCV, in both bytecode and native emitter mode, with and without WLAN enabled. Signed-off-by: Damien George <damien@micropython.org>	2025-05-01 13:18:28 +10:00
Damien George	ffd7e0e28d	tests/ports/rp2: Convert rp2.DMA test to a unittest. ... This test is rather complicated and benefits from being a unittest. Signed-off-by: Damien George <damien@micropython.org>	2025-05-01 13:18:28 +10:00
Damien George	3f1df4bacb	tests/net_hosted: Only run network loopback test on supported targets. ... Only a few ports have TCP/IP loopback enabled in their network stack, and this test will only pass on those ports. There's not really any good way to do a feature check for loopback mode without actually running the test and seeing if it passes/fails, so add an explicit check that the test is running on a port known to support loopback. (Enabling loopback on lwIP, eg RPI_PICO_W, costs +568 code and +272 bss and is a rarely used feature, so not worth unconditionally enabling.) Signed-off-by: Damien George <damien@micropython.org>	2025-05-01 11:16:29 +10:00
Alessandro Gatti	ce7f65f967	tests/extmod/vfs_posix.py: Fix test on Android. ... This commit makes a slight change to the vfs_posix test suite to let it pass on Android. On Android, non-root processes can perform most filesystem operations only on a restricted set of directories. The vfs_posix test suite attempted to enumerate the filesystem root directory, and said directory happens to be restricted for non-root processes. This would raise an EACCES OSError and terminate the test with a unexpected failure. To fix this, rather than enumerating the filesystem root directory the enumeration target is the internal shared storage area root - which doesn't have enumeration restrictions for non-root processes. The path is hardcoded because it is guaranteed to be there on pretty much any recent-ish device for now (it stayed the same for more than a decade for compatibility reasons). The proper way would be to query the storage subsystem via a JNI round-trip call, but this introduces too much complexity for something that is unlikely to break going forward. Signed-off-by: Alessandro Gatti <a.gatti@frob.it>	2025-04-24 22:11:42 +10:00
Damien George	898c04ae0e	tests/extmod/vfs_mountinfo.py: Don't import unused errno module. ... Signed-off-by: Damien George <damien@micropython.org>	2025-04-24 22:06:11 +10:00
Damien George	a081b2e151	tests/extmod/vfs_lfs_ilistdir_del.py: Skip test if not enough memory. ... Signed-off-by: Damien George <damien@micropython.org>	2025-04-24 22:06:11 +10:00
Damien George	c83e907d9d	tests/extmod: Skip binascii tests when hexlify/unhexlify don't exist. ... These functions are only available when `MICROPY_PY_BUILTINS_BYTES_HEX` is enabled. Signed-off-by: Damien George <damien@micropython.org>	2025-04-24 22:06:11 +10:00
Yoctopuce dev	0d2c18c299	py/objstr: Fix handling of OP_MODULO with namedtuple. ... This fix handles attrtuple as well, eg. os.uname(). A test case has been added in basics/attrtuple2.py. Fixes issue #16969. Signed-off-by: Yoctopuce dev <dev@yoctopuce.com>	2025-04-21 17:37:39 +10:00
Jeff Epler	760b962924	tests/basics/builtin_range.py: Add more tests for range slicing. ... Signed-off-by: Jeff Epler <jepler@gmail.com>	2025-04-21 17:09:37 +10:00
Damien George	037f2dad72	tests: Update UART and SPI tests to work on Alif boards. ... Signed-off-by: Damien George <damien@micropython.org>	2025-04-09 00:22:33 +10:00
Damien George	2ad5925302	tests/ports/alif_hardware: Add flash testing script. ... This test is not intended to be run automatically and does not have a corresponding .exp file. Signed-off-by: Damien George <damien@micropython.org>	2025-04-09 00:22:33 +10:00
Angus Gratton	e9a80fc9a0	tests/cpydiff: Remove types_str_endswith. ... MicroPython support for this behaviour was added in eb45d97898. This work was funded through GitHub Sponsors. Signed-off-by: Angus Gratton <angus@redyak.com.au>	2025-04-07 16:10:05 +10:00
Angus Gratton	57f1e60dd0	tests/cpydiff: Update CPy diff for assign expr in nested comprehensions. ... Since 7c1584aef1 MicroPython matches CPython in most cases, aside from nested comprehensions. This work was funded through GitHub Sponsors. Signed-off-by: Angus Gratton <angus@redyak.com.au>	2025-04-07 15:43:03 +10:00
Damien George	e4051a1ca6	extmod/vfs_rom: Implement minimal VfsRom.getcwd() method. ... This is needed if you chdir to a ROMFS and want to query your current directory. Prior to this change, using `os.getcwd()` when in a ROMFS would raise: AttributeError: 'VfsRom' object has no attribute 'getcwd' Signed-off-by: Damien George <damien@micropython.org>	2025-03-27 17:04:12 +11:00
Anson Mansfield	9fcc25b9d7	tests/extmod/vfs_mountinfo.py: Add test for no-args mount output. ... Signed-off-by: Anson Mansfield <amansfield@mantaro.com>	2025-03-27 16:37:04 +11:00
Damien George	fa42487e45	extmod/moddeflate: Keep DeflateIO state consistent on window alloc fail. ... Allocation of a large compression window may fail, and in that case keep the `DeflateIO` state consistent so its other methods (such as `close()`) still work. Consistency is kept by only updating the `self->write` member if the window allocation succeeds. Thanks to @jimmo for finding the bug. Signed-off-by: Damien George <damien@micropython.org>	2025-03-27 11:58:59 +11:00
Damien George	994751c251	tests/cpydiff: Remove builtin_next_arg2.py difference. ... Because 2-arg `next()` is implemented, and now enabled at the basic feature level. Signed-off-by: Damien George <damien@micropython.org>	2025-03-27 11:52:29 +11:00
Angus Gratton	dbda43b9e1	tests/multi_pyb_can: Add multitests for pyboard CAN controller. ... Currently only classic CAN, but tests run on both the stm32 classic CAN controller and the FD-CAN controller with the same results. Signed-off-by: Angus Gratton <angus@redyak.com.au>	2025-03-14 14:52:38 +11:00
Damien George	f5b4545761	py/modsys: Add sys.implementation._build entry. ... For a given MicroPython firmware/executable it can be sometimes important to know how it was built, which variant/board configuration it came from. This commit adds a new field `sys.implementation._build` that can help identify the configuration that MicroPython was built with. For now it's either: * <VARIANT> for unix, webassembly and windows ports * <BOARD>-<VARIANT> for microcontroller ports (the variant is optional) In the future additional elements may be added to this string, separated by a hyphen. Resolves issue #16498. Signed-off-by: Damien George <damien@micropython.org>	2025-03-05 12:23:40 +11:00
Angus Gratton	b4cf82b2d6	test/run-tests: Print a note if it looks like unittest.main() missing. ... This work was funded through GitHub Sponsors. Signed-off-by: Angus Gratton <angus@redyak.com.au>	2025-03-04 10:45:23 +11:00
Angus Gratton	5f01232dd7	tests/run-tests: Remove any 'expected' file from a unittest run. ... This won't be generated normally, but a failed run (for example, from a unittest with an error or which doesn't call unittest.main()) will generate one. This work was funded through GitHub Sponsors. Signed-off-by: Angus Gratton <angus@redyak.com.au>	2025-03-04 10:45:23 +11:00
Glenn Moloney	eb45d97898	py/objstr: Support tuples and start/end args in startswith and endswith. ... This change allows tuples to be passed as the prefix/suffix argument to the `str.startswith()` and `str.endswith()` methods. The methods will return `True` if the string starts/ends with any of the prefixes/suffixes in the tuple. Also adds full support for the `start` and `end` arguments to both methods for compatibility with CPython. Tests have been updated for the new behaviour. Signed-off-by: Glenn Moloney <glenn.moloney@gmail.com>	2025-03-02 22:15:31 +11:00
Yoctopuce dev	5fdd249c55	py/parsenum: Reduce code footprint of mp_parse_num_float. ... The mantissa parsing code uses a floating point variable to accumulate digits. Using an `mp_float_uint_t` variable instead and casting to `mp_float_t` at the very end reduces code size. In some cases, it also improves the rounding behaviour as extra digits are taken into account by the int-to-float conversion code. An extra test case handles the special case where mantissa overflow occurs while processing deferred trailing zeros. Signed-off-by: Yoctopuce dev <dev@yoctopuce.com>	2025-02-28 13:35:12 +11:00
Damien George	14ba32bb20	extmod/vfs_rom: Add bounds checking for all filesystem accesses. ... Testing with ROMFS shows that it is relatively easy to end up with a corrupt filesystem on the device -- eg due to the ROMFS deploy process stopping half way through -- which could lead to hard crashes. Notably, there can be boot loops trying to mount a corrupt filesystem, crashes when importing modules like `os` that first scan the filesystem for `os.py`, and crashing when deploying a new ROMFS in certain cases because the old one is removed while still mounted. The main problem is that `mp_decode_uint()` has an loop that keeps going as long as it reads 0xff byte values, which can happen in the case of erased and unwritten flash. This commit adds full bounds checking in the new `mp_decode_uint_checked()` function, and that makes all ROMFS filesystem accesses robust. Signed-off-by: Damien George <damien@micropython.org>	2025-02-26 16:11:19 +11:00
Christian Clauss	8ce7a58be2	tests: Four typos in tests directory. ... Found by codespell. Signed-off-by: Christian Clauss <cclauss@me.com>	2025-02-25 23:34:53 +11:00
Christian Clauss	dc2fcfcc55	all: Upgrade to ruff v0.9.6. ... Signed-off-by: Christian Clauss <cclauss@me.com>	2025-02-25 13:02:49 +01:00
Damien George	8987b39e0b	tests/multi_net: Add test for DTLS server and client. ... This adds a multi-test for DTLS server and client behaviour. It works on all ports that enable this feature (eg unix, esp32, rp2, stm32), but bare-metal ports that use lwIP are not reliable as the DTLS server because the lwIP bindings only support queuing one UDP packet at a time (that needs to be fixed). Also, to properly implement a DTLS server sockets need to support `socket.recvfrom(n, MSG_PEEK)`. That can be implemented in the future. Signed-off-by: Damien George <damien@micropython.org>	2025-02-14 12:56:47 +11:00
Keenan Johnson	321b30ca56	extmod/modtls_mbedtls: Wire in support for DTLS. ... This commit enables support for DTLS, i.e. TLS over datagram transport protocols like UDP. While support for DTLS is absent in CPython, it is worth supporting it in MicroPython because it is the basis of the ubiquitous CoAP protocol, used in many IoT projects. To select DTLS, a new set of "protocols" are added to SSLContext: - ssl.PROTOCOL_DTLS_CLIENT - ssl.PROTOCOL_DTLS_SERVER If one of these is set, the library assumes that the underlying socket is a datagram-like socket (i.e. UDP or similar). Our own timer callbacks are implemented because the out of the box implementation relies on `gettimeofday()`. This new DTLS feature is enabled on all ports that use mbedTLS. This commit is an update to a previous PR #10062. Addresses issue #5270 which requested DTLS support. Signed-off-by: Keenan Johnson <keenan.johnson@gmail.com>	2025-02-14 12:55:25 +11:00
Damien George	30acb16ad3	extmod/vfs_rom: Remove ability to create VfsRom from an address. ... It's not necessary to support this, which allows an arbitrary memory address to be specified and potentially allows invalid memory accesses. Requiring an object with the buffer protocol is safer, and also means that the length of the region is always specified. Signed-off-by: Damien George <damien@micropython.org>	2025-02-11 17:56:13 +11:00
Damien George	c3a18d74eb	extmod/modmarshal: Add new marshal module. ... This commit implements a small subset of the CPython `marshal` module. It implements `marshal.dumps()` and `marshal.loads()`, but only supports (un)marshalling code objects at this stage. The semantics match CPython, except that the actual marshalled bytes is not compatible with CPython's marshalled bytes. The module is enabled at the everything level (only on the unix coverage build at this stage). Signed-off-by: Damien George <damien@micropython.org>	2025-02-11 16:54:20 +11:00
Damien George	ceb8ba60b4	py/objfun: Implement function.__code__ and function constructor. ... This allows retrieving the code object of a function using `function.__code__`, and then reconstructing a function from a code object using `FunctionType(code_object)`. This feature is controlled by `MICROPY_PY_FUNCTION_ATTRS_CODE` and is enabled at the full-features level. Signed-off-by: Damien George <damien@micropython.org>	2025-02-11 16:51:50 +11:00
Damien George	372ecfef02	tests/run-tests.py: Give more information when CPython crashes. ... To make it easier to diagnose why CPython crashed. Signed-off-by: Damien George <damien@micropython.org>	2025-02-11 16:41:48 +11:00
Alessandro Gatti	dfd1d69a72	tests/run-natmodtests.py: Autodetect the test target architecture. ... This commit lets the natmod tests runner to automatically detect the architecture of the test target. This allows to avoid to explicitly pass the architecture name to the runner in test scripts. However, the ability to manually specify a target was not removed but it was made optional. This way the user is able to override the architecture name if needed (like if one wants to test an armv6 MPY on an armv7 board). Signed-off-by: Alessandro Gatti <a.gatti@frob.it>	2025-02-07 17:37:04 +11:00
Angus Gratton	921f19fc9d	tests/multi_wlan: Remove esp8266 port workaround. ... Not needed due to parent commit. Signed-off-by: Angus Gratton <angus@redyak.com.au>	2025-02-07 13:03:26 +11:00
Mike Bell	3699cf5f38	rp2/rp2_flash: Workaround multicore lockout not being reset. ... With regression test. See upstream bug https://github.com/raspberrypi/pico-sdk/issues/2201 Tested-by: Angus Gratton <angus@redyak.com.au> Signed-off-by: Mike Bell <mdb036@gmail.com>	2025-02-07 12:13:34 +11:00
Damien George	81ab49a607	tests/ports/rp2: Add test for SLEEP_ENx registers over lightsleep. ... Signed-off-by: Damien George <damien@micropython.org>	2025-02-07 11:53:16 +11:00
Angus Gratton	195bf05115	tests: Add a test for SSL socket memory leaks. ... Test is for an issue reported on the micropython-lib Discord as effecting the rp2 port umqtt.simple interface when reconnecting with TLS, however it's a more generic problem. Currently this test fails on RPI_PICO_W and ESP32_GENERIC_C3 (and no doubt others). Fixes are in the subsequent commits. This work was funded through GitHub Sponsors. Signed-off-by: Angus Gratton <angus@redyak.com.au>	2025-02-03 15:02:02 +11:00
Jeff Epler	13b13d1fdd	py/parsenum: Throw an exception for invalid int literals like "01". ... This includes making int("01") parse in base 10 like standard Python. When a base of 0 is specified it means auto-detect based on the prefix, and literals begining with 0 (except when the literal is all 0's) like "01" are then invalid and now throw an exception. The new error message is different from CPython. It says e.g., `SyntaxError: invalid syntax for integer with base 0: '09'` Additional test cases were added to cover the changed & added code. Co-authored-by: Damien George <damien@micropython.org> Signed-off-by: Jeff Epler <jepler@gmail.com>	2025-01-26 22:54:58 +11:00
Jeff Epler	7b3f189b17	tests/basics/nanbox_smallint.py: Fix incorrect use of int() in test. ... The literal is in base 16 but int()'s default radix in CPython is 10, not 0. Signed-off-by: Jeff Epler <jepler@gmail.com>	2025-01-26 22:51:50 +11:00
Alessandro Gatti	e73cf71a24	tests/extmod/re_sub.py: Fix test execution on Python 3.13. ... This commit fixes a test failure for `extmod/re_sub.py` where the code, whilst being correct, would not make the test pass due to a newer Python version than expected. On Python 3.13, running `tests/extmod/re_sub.py` would yield a deprecation warning about `re.sub` not providing the match count as a keyword parameter. This warning would be embedded in the expected test result and thus the test would always fail. Co-authored-by: stijn <stijn@ignitron.net> Signed-off-by: Alessandro Gatti <a.gatti@frob.it>	2025-01-15 07:46:09 +11:00
Damien George	1b4c969ce0	tests/multi_net: Update TLS test certificates and keys. ... They expired in early January 2025. Signed-off-by: Damien George <damien@micropython.org>	2025-01-14 14:55:30 +11:00
Damien George	6dbb7ab18f	tests/README: Update TLS certificate generation instructions. ... Fix the command that converts `ec_key.pem` to `ec_key.der`, and increase the certificate validity to 10 years. Signed-off-by: Damien George <damien@micropython.org>	2025-01-14 14:38:41 +11:00
Damien George	fca8ea6c39	tests/extmod/vfs_rom.py: Import errno for test. ... It's needed by the test. This previously passed because the compiler (actually parser) optimises away errno constants. Signed-off-by: Damien George <damien@micropython.org>	2025-01-06 17:55:11 +11:00
Damien George	966eb00394	tests/run-tests.py: Implement getcwd on __FS hook filesystem. ... This method is needed by tests like `extmod/vfs_rom.py`. Signed-off-by: Damien George <damien@micropython.org>	2025-01-06 17:55:11 +11:00
Damien George	91e30df5f2	tests/run-tests.py: Set __main__ module to __injected_test. ... When using unittest (for example) with injected mpy files, not only does the name of the main test module need to be `__main__`, but also the `__main__` module should correspond to this injected module. Otherwise the unittest test won't be detected. Signed-off-by: Damien George <damien@micropython.org>	2025-01-06 17:48:22 +11:00
Alessandro Gatti	931a768f55	tests/run-tests.py: Detect inlineasm support and add tests if needed. ... This commit implements a method to detect at runtime if inline assembler support is enabled, and if so which platform it targets. This allows clean test runs even on modified version of ARM-based ports where inline assembler support is disabled, running inline assembler tests on ports that have such feature not enabled by default and manually enabled, and allows to always run the correct inlineasm tests for ports that support more than one architecture (esp32, qemu, rp2). Signed-off-by: Alessandro Gatti <a.gatti@frob.it>	2025-01-02 11:52:28 +11:00