2468 Commits

Author	SHA1	Message	Date
Angus Gratton	921f19fc9d	tests/multi_wlan: Remove esp8266 port workaround. ... Not needed due to parent commit. Signed-off-by: Angus Gratton <angus@redyak.com.au>	2025-02-07 13:03:26 +11:00
Mike Bell	3699cf5f38	rp2/rp2_flash: Workaround multicore lockout not being reset. ... With regression test. See upstream bug https://github.com/raspberrypi/pico-sdk/issues/2201 Tested-by: Angus Gratton <angus@redyak.com.au> Signed-off-by: Mike Bell <mdb036@gmail.com>	2025-02-07 12:13:34 +11:00
Damien George	81ab49a607	tests/ports/rp2: Add test for SLEEP_ENx registers over lightsleep. ... Signed-off-by: Damien George <damien@micropython.org>	2025-02-07 11:53:16 +11:00
Angus Gratton	195bf05115	tests: Add a test for SSL socket memory leaks. ... Test is for an issue reported on the micropython-lib Discord as effecting the rp2 port umqtt.simple interface when reconnecting with TLS, however it's a more generic problem. Currently this test fails on RPI_PICO_W and ESP32_GENERIC_C3 (and no doubt others). Fixes are in the subsequent commits. This work was funded through GitHub Sponsors. Signed-off-by: Angus Gratton <angus@redyak.com.au>	2025-02-03 15:02:02 +11:00
Jeff Epler	13b13d1fdd	py/parsenum: Throw an exception for invalid int literals like "01". ... This includes making int("01") parse in base 10 like standard Python. When a base of 0 is specified it means auto-detect based on the prefix, and literals begining with 0 (except when the literal is all 0's) like "01" are then invalid and now throw an exception. The new error message is different from CPython. It says e.g., `SyntaxError: invalid syntax for integer with base 0: '09'` Additional test cases were added to cover the changed & added code. Co-authored-by: Damien George <damien@micropython.org> Signed-off-by: Jeff Epler <jepler@gmail.com>	2025-01-26 22:54:58 +11:00
Jeff Epler	7b3f189b17	tests/basics/nanbox_smallint.py: Fix incorrect use of int() in test. ... The literal is in base 16 but int()'s default radix in CPython is 10, not 0. Signed-off-by: Jeff Epler <jepler@gmail.com>	2025-01-26 22:51:50 +11:00
Alessandro Gatti	e73cf71a24	tests/extmod/re_sub.py: Fix test execution on Python 3.13. ... This commit fixes a test failure for `extmod/re_sub.py` where the code, whilst being correct, would not make the test pass due to a newer Python version than expected. On Python 3.13, running `tests/extmod/re_sub.py` would yield a deprecation warning about `re.sub` not providing the match count as a keyword parameter. This warning would be embedded in the expected test result and thus the test would always fail. Co-authored-by: stijn <stijn@ignitron.net> Signed-off-by: Alessandro Gatti <a.gatti@frob.it>	2025-01-15 07:46:09 +11:00
Damien George	1b4c969ce0	tests/multi_net: Update TLS test certificates and keys. ... They expired in early January 2025. Signed-off-by: Damien George <damien@micropython.org>	2025-01-14 14:55:30 +11:00
Damien George	6dbb7ab18f	tests/README: Update TLS certificate generation instructions. ... Fix the command that converts `ec_key.pem` to `ec_key.der`, and increase the certificate validity to 10 years. Signed-off-by: Damien George <damien@micropython.org>	2025-01-14 14:38:41 +11:00
Damien George	fca8ea6c39	tests/extmod/vfs_rom.py: Import errno for test. ... It's needed by the test. This previously passed because the compiler (actually parser) optimises away errno constants. Signed-off-by: Damien George <damien@micropython.org>	2025-01-06 17:55:11 +11:00
Damien George	966eb00394	tests/run-tests.py: Implement getcwd on __FS hook filesystem. ... This method is needed by tests like `extmod/vfs_rom.py`. Signed-off-by: Damien George <damien@micropython.org>	2025-01-06 17:55:11 +11:00
Damien George	91e30df5f2	tests/run-tests.py: Set __main__ module to __injected_test. ... When using unittest (for example) with injected mpy files, not only does the name of the main test module need to be `__main__`, but also the `__main__` module should correspond to this injected module. Otherwise the unittest test won't be detected. Signed-off-by: Damien George <damien@micropython.org>	2025-01-06 17:48:22 +11:00
Alessandro Gatti	931a768f55	tests/run-tests.py: Detect inlineasm support and add tests if needed. ... This commit implements a method to detect at runtime if inline assembler support is enabled, and if so which platform it targets. This allows clean test runs even on modified version of ARM-based ports where inline assembler support is disabled, running inline assembler tests on ports that have such feature not enabled by default and manually enabled, and allows to always run the correct inlineasm tests for ports that support more than one architecture (esp32, qemu, rp2). Signed-off-by: Alessandro Gatti <a.gatti@frob.it>	2025-01-02 11:52:28 +11:00
Alessandro Gatti	268acb714d	py/emitinlinerv32: Add inline assembler support for RV32. ... This commit adds support for writing inline assembler functions when targeting a RV32IMC processor. Given that this takes up a bit of rodata space due to its large instruction decoding table and its extensive error messages, it is enabled by default only on offline targets such as mpy-cross and the qemu port. Signed-off-by: Alessandro Gatti <a.gatti@frob.it>	2025-01-02 11:49:10 +11:00
Alessandro Gatti	a5270c84cf	tests/inlineasm: Make room for RV32IMC inline asm tests. ... Thumb/Thumb2 tests are now into their own subdirectory, as RV32IMC-specific tests will be added as part of the RV32 inline assembler support. Signed-off-by: Alessandro Gatti <a.gatti@frob.it>	2025-01-01 10:44:50 +01:00
Damien George	c73204128e	tests/extmod: Add VfsRom test. ... Provides full coverage of the VfsRom driver. Signed-off-by: Damien George <damien@micropython.org>	2024-12-23 13:04:55 +11:00
Damien George	a3128f89cc	tests: Fix all file ioctl's to support only MP_STREAM_CLOSE. ... A return value of 0 from Python-level `ioctl()` means success, but if that's returned unconditionally it means that the method supports all ioctl calls, which is not true. Returning 0 without doing anything can potentially lead to a crash, eg for MP_STREAM_SEEK which requires returning a value in the passed-in struct pointer. This commit makes it so that all `ioctl()` methods respond only to MP_STREAM_CLOSE, ie they return -1 (indicating error) for all other ioctl calls. Signed-off-by: Damien George <damien@micropython.org>	2024-12-20 21:52:19 +11:00
Peter Harper	a93762a762	rp2/modmachine: Fix USB sleep on RP2350 MCUs. ... Signed-off-by: Peter Harper <peter.harper@raspberrypi.com>	2024-12-19 16:54:30 +11:00
Damien George	e323da7291	tests/run-tests.py: Set name of injected test module to '__main__'. ... Running unittest-based tests with --via-mpy is currently broken, because the unittest test needs the module to be named `__main__`, whereas it's actually called `__injected_test`. Fix this by changing the name when the file is opened. Signed-off-by: Damien George <damien@micropython.org>	2024-12-19 15:12:04 +11:00
Damien George	d10cda66dc	tests/extmod: Add test for uctypes.addressof function. ... Signed-off-by: Damien George <damien@micropython.org>	2024-12-18 11:01:23 +11:00
Damien George	bdda91fe74	tests/extmod_hardware: Add a test for machine.PWM freq and duty. ... This adds a hardware test for `machine.PWM`. It requires a jumper wire between two pins, uses `machine.PWM` to output on one of them, and `machine.time_pulse_us()` to time the PWM on the other pin (some boards test more than one pair of pins). It times both the high and low duty cycle (and hence the frequency) for a range of PWM frequencies and duty cycles (including full on and full off). Currently supported on: - esp32 (needs a minor hack for initialisation, and some tests still fail) - esp8266 (passes for frequencies 1kHz and less) - mimxrt / Teensy 4.0 (passes) - rp2 (passes) - samd21 (passes for frequencies 2kHz and less) Signed-off-by: Damien George <damien@micropython.org>	2024-12-11 12:22:15 +11:00
Damien George	2c80d36998	tests/extmod: Convert machine1.py test to use unittest. ... Signed-off-by: Damien George <damien@micropython.org>	2024-12-06 13:48:23 +11:00
Damien George	c7c3ffa45f	tests/net_hosted: Convert connect-nonblock-xfer test to use unittest. ... This allows it to run parts of the test on esp8266 (or any target using axTLS). Signed-off-by: Damien George <damien@micropython.org>	2024-12-06 13:48:23 +11:00
Damien George	f62df1a2c2	tests/ports/stm32_hardware: Convert DMA test to use unittest. ... Signed-off-by: Damien George <damien@micropython.org>	2024-12-06 13:48:23 +11:00
Damien George	a8422439ab	tests/run-tests.py: Print .out file when there is no .exp file. ... So that a failing unittest-based test has its entire log printed when using `run-tests.py --print-failures`. Signed-off-by: Damien George <damien@micropython.org>	2024-12-06 13:47:21 +11:00
Damien George	a2554f0957	tests/run-tests.py: Add support for tests to use unittest. ... All the existing tests require a .exp file (either manually specified or generated running the test first under CPython) that is used to check the output of running the test under MicroPython. The test passes if the output matches the expected output exactly. This has worked very well for a long time now. But some of the newer hardware tests (eg UART, SPI, PWM) don't really fit this model, for the following main reasons: - Some but not all parts of the test should be skipped on certain hardware targets. With the expected-output approach, skipping tests is either all or nothing. - It's often useful to output diagnostics as part of the test, which should not affect the result of the test (eg the diagnostics change from run to run, like timing values, or from target to target). - Sometimes a test will do a complex check and then print False/True if it passed or not, which obscures the actual test result. To improve upon this, this commit adds support to `run-tests.py` for a test to use `unittest`. It detects this by looking at the end of the output after running the test, looking for the test summary printed by `unittest` (or an error message saying `unittest` was not found). If the test uses `unittest` then it should not have a .exp file, and it's not run under CPython. A `unittest` based test passes or fails based on the summary printed by `unittest`. Note that (as long as `unittest` is installed on the target) the tests are still fully independent and you can still run them without `run-tests.py`: you just run it as usual, eg `mpremote run <test.py>`. This is very useful when creating and debugging tests. Note also that the standard test suite testing Python semantics (eg everything in `tests/basics/`) will probably never use unittest. Only more advanced tests will, and ones that are not runnable under CPython. Signed-off-by: Damien George <damien@micropython.org>	2024-12-06 13:41:52 +11:00
Angus Gratton	eb80b04944	tests/extmod: Workaround CPython warning in asyncio_new_event_loop test. ... This started failing in CI on the mingw build, after CPython updated to 3.12.7. The test prints two warnings during interpreter shutdown of "Task was destroyed but it is pending!". This didn't happen on other CPython builds, and I think that's because of finalizer order in CPython interpreter shutdown but not certain (the loop finalizer calls loop.close() if not already closed). Adding explicit calls to loop.close() causes the warning to be printed on every run with CPython 3.12.7 on Linux. Next, added the workaround exception handler to swallow this exception as MicroPython doesn't produce an equivalent. This work was funded through GitHub Sponsors. Signed-off-by: Angus Gratton <angus@redyak.com.au>	2024-11-28 23:12:34 +11:00
Angus Gratton	8e11e5f1a1	tests/misc/sys_settrace_features.py: Add note about CPython 3.12 issue. ... CPython 3.12 has a documented issue with settrace for opcodes, apparently due to PEP 669. "This behavior will be changed back in 3.13 to be consistent with previous versions." No easy way to make the test pass on CPython 3.12, but at least this helps signal what the problem is to anyone who runs into a failure. This work was funded through GitHub Sponsors. Signed-off-by: Angus Gratton <angus@redyak.com.au>	2024-11-28 23:11:36 +11:00
Corran Webster	e70048cf59	extmod/modframebuf: Fix 0 radius bug in FrameBuffer.ellipse. ... This fixes a bug in FrameBuffer.ellipse where it goes into an infinite loop if both radii are 0. This fixes the bug with a simple pre-check to see if both radii are 0, and in that case sets a single pixel at the center. This is consistent with the behaviour of the method when called with just one of the radii set to 0, where it will draw a horizontal or vertical line of 1 pixel width. The pixel is set with setpixel_checked so it should handle out-of-bounds drawing correctly. This fix also includes three new tests: one for the default behaviour, one for drawing out-of-bounds, and one for when the sector mask is 0. Fixes issue #16053. Signed-off-by: Corran Webster <cwebster@unital.dev>	2024-11-28 22:56:44 +11:00
Angus Gratton	0e383a31b9	tests: Add basic wlan test. ... Includes adding some ESP8266 port output to the ignored output list for the multitest runner. This test passes on ESP8266 and various ESP32s (including talking to each other). Without the fix in the parent commit, ESP32 AP will fail if the station can report its channel (i.e. channel is wrong). Testing with a CYW43 (RPI_PICO_W) currently fails but I have some fixes to submit so it can pass as well. Signed-off-by: Angus Gratton <angus@redyak.com.au>	2024-11-28 15:39:06 +11:00
Angus Gratton	7647c828de	tests/multi_espnow: Add channel setting test, add some docs. ... Test currently passes. It was added so it can be used to check for regressions when fixing channel selection for AP mode in a follow-up commit. Also add some docs about how channel setting is observed to work for ESP-NOW. This work was funded through GitHub Sponsors. Signed-off-by: Angus Gratton <angus@redyak.com.au>	2024-11-28 15:39:06 +11:00
Damien George	69023622ee	tests/net_hosted: Improve and simplify non-block-xfer test. ... CPython changed its non-blocking socket behaviour recently and this test would not run under CPython anymore. So the following steps were taken to get the test working again and then simplify it: - Run the test against CPython 3.10.10 and capture the output into the .exp file for the test. - Run this test on unix port of MicroPython and verify that the output matches the CPython 3.10.10 output in the new .exp file (it did). From now on take unix MicroPython as the source of truth for this test when modifying it. - Remove all code that was there for CPython compatibility. - Make it print out more useful information during the test run, including names of the OSError errno values. - Add polling of the socket before the send/write/recv/read to verify that the poll gives the correct result in non-blocking mode. Tested on unix MicroPython, ESP32_GENERIC, PYBD_SF2 and RPI_PICO_W boards. Signed-off-by: Damien George <damien@micropython.org>	2024-11-13 11:44:09 +11:00
Jeff Epler	3844733d60	tests/cpydiff: Fix test case for modules_json_nonserializable. ... The test case was producing the following error: Traceback (most recent call last): File "<stdin>", line 12, in <module> UnicodeError: which did not demonstrate the intended difference (this particular non-json-serializable object DID throw an exception! just not TypeError). The updated test uses a byte string with all ASCII bytes inside, which better illustrates the diference. Signed-off-by: Jeff Epler <jepler@gmail.com>	2024-11-11 12:35:03 +11:00
Angus Gratton	5dfbd43714	tests: Use the recommended network.WLAN.IF_[AP|STA] constants. ... Removes the deprecated network.[AP|STA]_IF form from unit tests. This work was funded through GitHub Sponsors. Signed-off-by: Angus Gratton <angus@redyak.com.au>	2024-11-08 12:03:50 +11:00
Damien George	85053adb24	tests/run-tests.py: Add mimxrt and samd platforms. ... Signed-off-by: Damien George <damien@micropython.org>	2024-11-04 12:48:10 +11:00
Damien George	8978102f35	tests/run-tests.py: Change --target/--device options to --test-instance. ... Previously to this commit, running the test suite on a bare-metal board required specifying the target (really platform) and device, eg: $ ./run-tests.py --target pyboard --device /dev/ttyACM1 That's quite a lot to type, and you also need to know what the target platform is, when a lot of the time you either don't care or it doesn't matter. This commit makes it easier to run the tests by replacing both of these options with a single `--test-instance` (`-t` for short) option. That option specifies the executable/port/device to test. Then the target platform is automatically detected. The `--test-instance` can be passed: - "unix" (the default) to use the unix version of MicroPython - "webassembly" to test the webassembly port - anything else is considered a port/device to pass to Pyboard There are also some shortcuts to specify a port/device, following `mpremote`: - a<n> is short for /dev/ttyACM<n> - u<n> is short for /dev/ttyUSB<n> - c<n> is short for COM<n> For example: $ ./run-tests.py -t a1 Note that the default test instance is "unix" and so this commit does not change the standard way to run tests on the unix port, by just doing `./run-tests.py`. As part of this change, the platform (and it's native architecture if it supports importing native .mpy files) is show at the start of the test run. Signed-off-by: Damien George <damien@micropython.org>	2024-11-04 12:47:47 +11:00
Damien George	f2ac471989	tests/run-tests.py: Simplify the way target-specific tests are given. ... Signed-off-by: Damien George <damien@micropython.org>	2024-11-04 12:02:55 +11:00
Damien George	c88a9d60a1	tests/basics/deque2.py: Add tests for deque subscript-from-end. ... Signed-off-by: Damien George <damien@micropython.org>	2024-11-04 11:22:43 +11:00
Damien George	09ea901317	tests/extmod: Add test to compare time_ns with time. ... They should be close together. Signed-off-by: Damien George <damien@micropython.org>	2024-10-24 23:24:09 +11:00
Damien George	1ec0c9b886	tests/extmod: Use time_ns instead of time in lfs mtime test. ... Because VfsLfs2 uses time_ns to create timestamps for files, and for the test to give consistent results it also needs to use this same function. Signed-off-by: Damien George <damien@micropython.org>	2024-10-24 23:24:09 +11:00
Damien George	ca6aed7649	tests/extmod: Fix access of RTC class in machine.RTC test. ... This previously passed on some targets that automatically import the `machine` module in `boot.py`. Signed-off-by: Damien George <damien@micropython.org>	2024-10-24 16:29:43 +11:00
Damien George	6d98280fda	tests/extmod: Add a simple test for machine.RTC. ... Tests at least that the datetime can be set and get correctly. Signed-off-by: Damien George <damien@micropython.org>	2024-10-24 11:43:03 +11:00
Damien George	3f54e5dff2	tests/extmod: Support esp32,mimxrt,stm32,samd ports in UART TX test. ... Getting this test running on stm32- and mimxrt-based boards requires adding a small delay after constructing the UART so that the initial idle frame has time to be transmitted before the test starts. Also, the timing margin needs to account for an additional 1-bit worth of time on some MCUs. Thanks to @robert-hh for the esp32, mimxrt and samd settings. Signed-off-by: Damien George <damien@micropython.org>	2024-10-22 22:21:17 +11:00
Damien George	0646177997	tests/extmod: Make invalid-blockdev test work consistently on all ports. ... Some ports (eg stm32) configure the FAT driver differently (eg with multi-partition support) and that leads to a slightly different sequence of block reads, compared to other configurations (eg rp2). Comment out the printing in `readblocks()` so the tests are deterministic (the printing is still useful for debugging). Signed-off-by: Damien George <damien@micropython.org>	2024-10-22 14:32:51 +11:00
Damien George	f7abb52847	tests/run-tests.py: Skip large viper test on esp8266. ... Signed-off-by: Damien George <damien@micropython.org>	2024-10-22 14:31:13 +11:00
Damien George	52f2ba5677	tests/micropython: Tweak ringio test for targets with terse errors. ... Signed-off-by: Damien George <damien@micropython.org>	2024-10-22 14:31:13 +11:00
Damien George	1e3b24238e	tests/extmod: Adjust ssl/tls tests to run on targets with axTLS. ... Signed-off-by: Damien George <damien@micropython.org>	2024-10-22 14:31:13 +11:00
Damien George	7d442373af	tests/extmod: Config SPI test for esp8266 and skip SoftTimer test. ... Signed-off-by: Damien George <damien@micropython.org>	2024-10-22 14:31:13 +11:00
Corran Webster	d1574de3b6	extmod/modframebuf: Fix FrameBuffer size check for stride corner-cases. ... This is a fix for issue #15944, and handles corner cases in the FrameBuffer code when using stride values where the last line's stride may extend past the end of the underlying buffer. This commit includes extra tests for these corner cases. For example a GS8 format FrameBuffer with a width of 8, height of 2 and stride of 10 should be able to fit into a buffer of size 18 (10 bytes for the first horizontal line, and 8 bytes for the second -- the full 10 bytes are not needed). Similarly a 1 by 9 FrameBuffer in MONO_VLSB format with a stride of 10 should be able to fit into a buffer of length 11 (10 bytes for the first 8 lines, and then one byte for the 9th line. Being able to do this is particularly important when cropping the corner of an existing FrameBuffer, either to copy a sprite or to clip drawing. Signed-off-by: Corran Webster <cwebster@unital.dev>	2024-10-22 13:05:31 +11:00
Damien George	97af1001ae	rp2/machine_uart: Make it so TX is done only when no longer busy. ... Prior to this commit, when flushing a UART on the rp2 port, it returns just before the last character is sent out the wire. Fix this by waiting until the BUSY flag is cleared. This also fixes the behaviour of `UART.txdone()` to return `True` only when the last byte has gone out. Updated docs and tests to match. The test now checks that UART TX time is very close to the expected time (prior, it was just testing that the TX time was less than the expected time). Signed-off-by: Damien George <damien@micropython.org>	2024-10-22 10:17:05 +11:00