17128 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Alessandro Gatti	e8c92240e2	tools/ci.sh: Remove natmod build restrictions for Xtensa. ... This commit lets the CI pipeline build all natmods for the Xtensa target, now that ROM symbols can be used in the linking process. The restriction was put in place due to build failures on certain natmods for Xtensa, as ROM symbols would not be used, causing undefined symbol errors at build time. Signed-off-by: Alessandro Gatti <a.gatti@frob.it>	2025-06-04 22:35:39 +10:00
Alessandro Gatti	e4c0e2b73d	esp8266/main: Print error information on crash-induced reboots. ... This commit adds an optional configuration option for the ESP8266 port that, if the board rebooted due to a crash, will print to stdout some information about the error that triggered the issue. It is not possible using regular SDK functions to intercept errors and print information at that stage, and the only error response from the board is to reboot itself. This is the next best thing, print some error information just once at boot time after the crash - the least invasive option given the situation we're in. This is disabled by default, and can be enabled by enabling MICROPY_HW_HARD_FAULT_DEBUG in the port configuration - obviously with a small increase in the firmware code footprint. Signed-off-by: Alessandro Gatti <a.gatti@frob.it>	2025-06-04 22:35:39 +10:00
Alessandro Gatti	4227654d42	examples/natmod/btree: Fix build for Xtensa. ... This commit provides the appropriate external symbol addresses to let the "btree" example natmod build for the Xtensa platform. On the ESP8266, unsigned integer division code isn't provided as part of libgcc.a, libm.a, or libc.a, but it is instead provided by the ROM. Regular builds inject the appropriate symbol addresses as part of the linking process (see eagle.rom.addr.v6.ld), but natmods need this information brought in from somewhere else. Signed-off-by: Alessandro Gatti <a.gatti@frob.it>	2025-06-04 22:35:39 +10:00
Alessandro Gatti	887125fc58	examples/natmod/deflate: Fix build for Xtensa. ... This commit provides the appropriate external symbol addresses to let the "deflate" example natmod build for the Xtensa platform. Unlike other natmods that require an external symbol list to build without bringing in the whole runtime libraries set, this natmod is referencing the `__modsi3` symbol which was removed from the ESP8266's SDK but not present in ROM. The latter only has a `__umodsi3` implementation that only operates on unsigned values, and thus unable to handle this natmod. Thus, the extended library resolution process is enabled for this natmod as a `__modsi3` implementation is made available that way (still using ROM symbols whenever possible). This also means that symbols that appear in both ROM and external libraries sort of co-exist in the final MPY file, with ROM symbols being used by natmod code but the implementation from the library still exists in the final MPY file, unused. Signed-off-by: Alessandro Gatti <a.gatti@frob.it>	2025-06-04 22:35:39 +10:00
Alessandro Gatti	462ee12d3c	examples/natmod/framebuf: Fix build for Xtensa. ... This commit provides the appropriate external symbol addresses to let the "framebuf" example natmod build for the Xtensa platform. On the ESP8266, integer division code isn't provided as part of libgcc.a, libm.a, or libc.a, but it is instead provided by the ROM. Regular builds inject the appropriate symbol addresses as part of the linking process (see eagle.rom.addr.v6.ld), but natmods need this information brought in from somewhere else. Signed-off-by: Alessandro Gatti <a.gatti@frob.it>	2025-06-04 22:35:39 +10:00
Alessandro Gatti	0bf2fd7ad0	examples/natmod/random: Fix build for Xtensa. ... This commit provides the appropriate external symbol addresses to let the "random" example natmod build for the Xtensa platform. On the ESP8266, signed integer division code isn't provided as part of libgcc.a, libm.a, or libc.a, but it is instead provided by the ROM. Regular builds inject the appropriate symbol addresses as part of the linking process (see eagle.rom.addr.v6.ld), but natmods need this information brought in from somewhere else. Signed-off-by: Alessandro Gatti <a.gatti@frob.it>	2025-06-04 22:35:39 +10:00
Alessandro Gatti	9ef7322a5d	tests/run-natmodtests.py: Allow injected code customisation. ... This commit introduces a mechanism to customise the code that is injected to the board when performing a native module import. A new argument, "-b"/"--begin", is added so regular Python code can be inserted in the injected fragment between the module file creation and the effective module import. This is needed for running natmod tests on ESP8266 as that board does not have enough memory to fit certain modules unless additional configuration is performed. Signed-off-by: Alessandro Gatti <a.gatti@frob.it>	2025-06-04 22:35:39 +10:00
Alessandro Gatti	bf2005de9e	tools/mpy_ld.py: Resolve fixed-address symbols if requested. ... This commit lets mpy_ld.py resolve symbols not only from the object files involved in the linking process, or from compiler-supplied static libraries, but also from a list of symbols referenced by an absolute address (usually provided by the system's ROM). This is needed for ESP8266 targets as some C stdlib functions are provided by the MCU's own ROM code to reduce the final code footprint, and therefore those functions' implementation was removed from the compiler's support libraries. This means that unless `LINK_RUNTIME` is set (which lets tooling look at more libraries to resolve symbols) the build process will fail as tooling is unaware of the ROM symbols' existence. With this change, fixed-address symbols can be exposed to the symbol resolution step when performing natmod linking. If there are symbols coming in from a fixed-address symbols list and internal code or external libraries, the fixed-address symbol address will take precedence in all cases. Although this is - in theory - also working for the whole range of ESP32 MCUs, testing is currently limited to Xtensa processors and the example natmods' makefiles only make use of this commit's changes for the ESP8266 target. Natmod builds can set the MPY_EXTERN_SYM_FILE variable pointing to a linkerscript file containing a series of symbols (weak or strong) at a fixed address; these symbols will then be used by the MicroPython linker when packaging the natmod. If a different natmod build method is used (eg. custom CMake scripts), `tools/mpy_ld.py` can now accept a command line parameter called `--externs` (or its short variant `-e`) that contains the path of a linkerscript file with the fixed-address symbols to use when performing the linking process. The linkerscript file parser can handle a very limited subset of binutils's linkerscript syntax, namely just block comments, strong symbols, and weak symbols. Each symbol must be in its own line for the parser to succeed, empty lines or comment blocks are skipped. For an example of what this parser was meant to handle, you can look at `ports/esp8266/boards/eagle.rom.addr.v6.ld` and follow its format. The natmod developer documentation is also updated to reflect the new command line argument accepted by `mpy_ld.py` and the use cases for the changes introduced by this commit. Signed-off-by: Alessandro Gatti <a.gatti@frob.it>	2025-06-04 22:35:39 +10:00
Damien George	9174cffc47	mpy-cross/main: Document emit=host option in help. ... Signed-off-by: Damien George <damien@micropython.org>	2025-06-04 12:07:30 +10:00
Damien George	e869dae31e	mpy-cross/main: Exit with error if arch not specified with emit=native. ... Currently, mpy-cross will crash if called as: mpy-cross -X emit=native foo.py because it tries to use the native emitter with no target architecture set. Fix that by checking that an architecture is set when `-X emit=native` or `-X emit=viper` is used. Signed-off-by: Damien George <damien@micropython.org>	2025-06-04 12:06:12 +10:00
Andrew Leech	820485358d	unix/coverage: Add coverage test for mp_sched_schedule_node. ... Test modified to reschedule itself based on a flag setting. Without the change in the parent commit, this test executes the callback indefinitely and hangs but with the change it runs only once each time mp_handle_pending() is called. Modified-by: Angus Gratton <angus@redyak.com.au> Signed-off-by: Andrew Leech <andrew.leech@planetinnovation.com.au>	2025-06-04 11:31:12 +10:00
Angus Gratton	7f274c7550	py/scheduler: Only run scheduler callbacks queued before run started. ... Without this change, a scheduler callback which itself queues a new callback will have that callback executed as part of the same scheduler run. Where a callback may re-queue itself, this can lead to an infinite loop. With this change, each call to mp_handle_pending() will only service the callbacks which were queued when the scheduler pass started - any callbacks added during the run are serviced on the next mp_handle_pending(). This does mean some interrupts may have higher latency (as callback is deferred until next scheduler run), but the worst-case latency should stay very similar. This work was funded through GitHub Sponsors. Signed-off-by: Angus Gratton <angus@redyak.com.au>	2025-06-04 11:31:12 +10:00
Damien George	b15348415e	extmod/modframebuf: Add support for blit'ing read-only data. ... Currently the `FrameBuffer.blit(buf, x, y)` method requires the `buf` argument to be another `FrameBuffer`, which is quite restrictive because it doesn't allow blit'ing read-only memory/data. This commit extends `blit()` to allow the `buf` argument to be a tuple or list of the form: (buffer, width, height, format[, stride]) where `buffer` can be anything with the buffer protocol and may be read-only, eg `bytes`. Also, the palette argument to `blit()` may be of the same form. The form of this tuple/list was chosen to be the same as the signature of the `FrameBuffer` constructor (that saves quite a bit of code size doing it that way). Signed-off-by: Damien George <damien@micropython.org>	2025-06-04 02:40:45 +10:00
Andrew Leech	d5f2fc239a	extmod/modbluetooth: Add timeout to deinit. ... If the BLE radio stops responding before deinit is called the function can get stuck waiting for an event that is never received, particularly if the radio is external or on a separate core. This commit adds a timeout, similar to the timeout already used in the init function. Updated for nimble, btstack, esp32 and zephyr bindings. Signed-off-by: Andrew Leech <andrew.leech@planetinnovation.com.au>	2025-06-04 02:21:32 +10:00
Andrew Leech	17898f8607	stm32/machine_adc: Enable ADC re-read errata handling for STM32WB55. ... Signed-off-by: Andrew Leech <andrew.leech@planetinnovation.com.au>	2025-06-04 02:11:23 +10:00
Matt Trentini	3e33d0567f	ports: Update board.json files for vendor/product consistency. ... The vendor and product fields in the `board.json` files were somewhat inconsistent. Remove any duplication of the vendor name in the product field so that `f"{vendor} {product}"` reads well. In addition to that, update most of the URL's for `board.json` files that are modified here, and match case and spacing used by the manufacturers for the vendor and product names. Signed-off-by: Matt Trentini <matt.trentini@gmail.com>	2025-06-04 01:47:59 +10:00
Angus Gratton	ba92063d64	docs: Add a description of recv/recvfrom flags argument. ... Implementation added for various ports in the parent commits. This work was funded through GitHub Sponsors. Signed-off-by: Angus Gratton <angus@redyak.com.au>	2025-06-03 12:52:25 +10:00
Angus Gratton	d23fb86934	tests/multi_net: Add test coverage for socket recv flag MSG_DONTWAIT. ... Adding multi_net case for UDP only, as TCP timing is hard to test reliably. Signed-off-by: Angus Gratton <angus@redyak.com.au>	2025-06-03 12:52:25 +10:00
Angus Gratton	73d4ddce6c	tests/multi_net: Add test coverage for socket recv flag MSG_PEEK. ... Adds TCP and UDP multi_net test cases. This work was funded through GitHub Sponsors. Signed-off-by: Angus Gratton <angus@redyak.com.au>	2025-06-03 12:52:22 +10:00
Angus Gratton	0b224048ef	unix/modsocket: Expose MSG_PEEK flag for recv & recvfrom. ... This work was funded through GitHub Sponsors. Signed-off-by: Angus Gratton <angus@redyak.com.au>	2025-06-03 12:52:06 +10:00
Angus Gratton	4781cde4f7	esp32/modsocket: Add optional flags argument for recv and recvfrom. ... Implements MSG_PEEK and MSG_DONTWAIT (both passed through to LWIP sockets API). This work was funded through GitHub Sponsors. Signed-off-by: Angus Gratton <angus@redyak.com.au>	2025-06-03 12:52:06 +10:00
Angus Gratton	e8447768ef	extmod/modlwip: Add optional flags argument for recv and recvfrom. ... Implements MSG_PEEK and MSG_DONTWAIT. This work was funded through GitHub Sponsors. Signed-off-by: Angus Gratton <angus@redyak.com.au>	2025-06-03 12:52:02 +10:00
Damien George	4dff9cbf1a	tests/run-tests.py: Change _results.json to have a combined result list. ... The `_results.json` output of `run-tests.py` was recently changed in 7a55cb6b36 to add a list of passed and skipped tests. The way this was done turned out to be not general enough, because we want to add another type of result, namely tests that are skipped because they are too large. Instead of having separate lists in `_results.json` for each kind of result (pass, fail, skip, skip too large, etc), this commit changes the output form of `_results.json` so that it stores a single list of 3-tuples of all tests that were run: [(test_name, result, reason), ...] That's more general and allows adding a reason for skipped and failed tests. At the moment this reason is just an empty string, but can be improved in the future. Signed-off-by: Damien George <damien@micropython.org>	2025-06-03 10:07:29 +10:00
Andrew Leech	c0111e63b3	lib/libhydrogen: Update to latest release. ... Signed-off-by: Andrew Leech <andrew.leech@planetinnovation.com.au>	2025-06-02 21:28:51 +10:00
Damien George	dea3035b88	tools/pyboard.py: Add write_timeout and catch errors in enter_raw_repl. ... If the USB serial device locks up, then writes to that device can hang forever. That can make the test runner `tests/run-tests.py` lock up, among other problems. This commit introduces a 5 second write-timeout, and catches any OSError's raised during `enter_raw_repl()`. Now, if a USB serial device locks up, `enter_raw_repl()` will eventually raise an exception. Signed-off-by: Damien George <damien@micropython.org>	2025-06-02 17:02:59 +10:00
Damien George	b1c947ab45	tools/pyboard.py: Introduce timeout_overall for read_until(). ... This applies the mpremote commit 03fe9c55ea to pyboard.py. The `timeout_overall` is used in `enter_raw_repl()`. It prevents waiting forever for a serial device that does not respond to the Ctrl-C/Ctrl-D/etc commands and is constantly outputting data. Signed-off-by: Damien George <damien@micropython.org>	2025-06-02 17:02:30 +10:00
Damien George	aaedd59b7c	tools/pyboard.py: Avoid initial blocking read in read_until(). ... This applies the mpremote commit 0d46e45a1f to pyboard.py. If the target does not return any data then `read_until()` will block indefinitely. Fix this by making the initial read part of the general read look, which always checks `inWaiting() > 0` before reading from the serial device. Also added the UART timeout to the constructor. This is not currently used but may be used as an additional safeguard. Signed-off-by: Damien George <damien@micropython.org>	2025-06-02 17:02:30 +10:00
Alessandro Gatti	f5d10c322e	py/asmxtensa: Emit prologue jump only when constants table is in use. ... This commit simplifies native functions' prologue code by not emitting a jump opcode that goes over the function's constants pool if the pool is empty. The original code assumed the constants pool is never empty as large 32-bits constants are commonly used, but for inline assembler functions that may not be the case. This meant that inline assembler functions may start with an unneeded jump (along with its alignment byte), using four bytes more than necessary. This commit is limited to the "xtensa" target, as "xtensawin" doesn't support inline assembler functions yet, so native functions' constant pools are almost always guaranteed to hold one or more values. Signed-off-by: Alessandro Gatti <a.gatti@frob.it>	2025-05-29 12:12:39 +10:00
Alessandro Gatti	1006ed69f0	py/emitinlinextensa: Add the rest of LX3 opcodes to the assembler. ... This commit expands the Xtensa inline assembler to support most if not all opcodes available on the ESP8266 and LX3 Xtensa cores. This is meant as a stepping stone to add inline assembler support for the ESP32 and its LX6 core, along to windowed-specific opcodes and additional opcodes that are present only on the LX7 core (ESP32-S3 and later). New opcodes being added are covered by tests, and the provided tests were expanded to also include opcodes available in the existing implementation. Given that the ESP8266 space requirements are tighter than ESP32's, certain opcodes that won't be commonly used have been put behind a define to save some space in the general use case. Signed-off-by: Alessandro Gatti <a.gatti@frob.it>	2025-05-29 12:12:39 +10:00
Alessandro Gatti	555f1cf488	py/asmxtensa: Make the generated code dumper work on mpy-cross. ... This commit fixes compilation errors occurring when enabling the Xtensa code dumper inside mpy-cross. The original code was meant to dump the code from an Xtensa device itself, but for debugging the inline assembler this functionality was also needed off-line. The changes involve solving a signed/unsigned mismatch that was not much of a problem for the 8266's gcc version but made modern compilers complain, and using the printf formatter for pointers when it comes to printing code addresses. Signed-off-by: Alessandro Gatti <a.gatti@frob.it>	2025-05-29 12:12:39 +10:00
Alessandro Gatti	eccd23feb6	py/asmxtensa: Replace printf messages with exceptions. ... This commit removes old raw printf calls happening inside certain branch opcode emitters, indicating the target label is out of range for the opcode. They have been replaced with a RuntimeError being raised in these cases, using a parameterised qstr instead. Whilst this technically breaks runtime behaviour expectations, the generated code would not have worked anyway so it's better to catch those cases early. This should be updated to always emit long jumps unless jumps are backwards and short enough, following the other ports, but that's something coming later. This is actually needed because there are test files that do not work when processed through mpy-cross and entirely converted to native code. The original implementation would still generate mostly-valid code that was bound to crash on the device, whilst this change would prevent invalid code to even be emitted in the first place. Signed-off-by: Alessandro Gatti <a.gatti@frob.it>	2025-05-29 12:12:39 +10:00
robert-hh	5cfafb73da	docs/esp32: Mention the use of Timer(0) by UART.IRQ_RXIDLE. ... In both the machine.UART and esp32.quickref sections. Signed-off-by: robert-hh <robert@hammelrath.com>	2025-05-28 12:13:51 +10:00
robert-hh	92c219afd6	docs/esp32/quickref: Mention the different timer counts. ... Since the are ESP32 variants with 1, 2 or 4 hardware timers. Signed-off-by: robert-hh <robert@hammelrath.com>	2025-05-28 12:13:46 +10:00
robert-hh	2f864416c6	docs/library/time: Amend the documentation of time.mktime(). ... By showing the argument and refer to epoch instead of a fixed date. The note about epoch lists the ports using the POSIX epoch. Signed-off-by: robert-hh <robert@hammelrath.com>	2025-05-28 12:13:28 +10:00
robert-hh	bbdc832ca9	samd/boards: Add two SparkFun SAMD21 boards. ... Add support for the boards: - SparkFun SAMD21 Dev Breakout - SparkFun RedBoard Turbo Both boards are SAMD21 based and actively sold by SparkFun. Signed-off-by: robert-hh <robert@hammelrath.com>	2025-05-28 12:04:42 +10:00
Dryw Wade	6bfb83e30a	rp2: Make FLASH LENGTH match PICO_FLASH_SIZE_BYTES in .ld files. ... With a fallback to default sizes if `PICO_FLASH_SIZE_BYTES` is not defined. Signed-off-by: Dryw Wade <dryw.wade@sparkfun.com>	2025-05-28 11:02:45 +10:00
Herwin Grobben	2dada065ac	stm32: Allow QSPI to work on STM32G4. ... Adding a QSPI memory chip on a STM32G4 does not work due to some small issues, which are fixed in this commit: - Rename QUADSPI1_xxx alt-func names to QUADSPI_xxx, to match the static names used in `qspi.c`. - Enable `mpu.h` macros on G4. - Don't include I- and D-cache invalidation on G4. Signed-off-by: Damien George <damien@micropython.org>	2025-05-26 12:40:27 +10:00
Daniël van de Giessen	9dbae39348	lib/littlefs: Update LittleFS to v2.11. ... Signed-off-by: Daniël van de Giessen <daniel@dvdgiessen.nl>	2025-05-26 12:17:27 +10:00
Ayush Singh	670b7c9350	zephyr/boards: Add support for BeaglePlay CC1352p7. ... - Enable support for FLASH and IEEE802154 subg radio - Requires Zephyr v3.8.0 Signed-off-by: Ayush Singh <ayush@beagleboard.org>	2025-05-26 12:13:04 +10:00
Angus Gratton	b36111b12c	nrf: Revert "nrf/Makefile: Enable LTO by default only on newer gcc.". ... This reverts commit 62e0fa04a7. Reverting as the only linker wrap needed for nrf port was removed in the parent commit. This work was funded through GitHub Sponsors. Signed-off-by: Angus Gratton <angus@redyak.com.au>	2025-05-26 11:15:33 +10:00
Angus Gratton	22f1d76633	shared/tinyusb: Use device event hook to schedule USB task. ... Previously MicroPython ports would linker-wrap dcd_event_handler in order to schedule the USB task callback to run when needed. TinyUSB 0.16 added proper support for an event hook to do the same thing without the hacky linker wrapping. This work was funded through GitHub Sponsors. Signed-off-by: Angus Gratton <angus@redyak.com.au>	2025-05-26 11:15:33 +10:00
Damien George	49f81d5046	tests/float/math_constants.py: Test actual e and pi constant values. ... The existing test for `math.e` and `math.pi` constants can fail on certain targets if the functions `math.exp()` and/or `math.cos()` are not accurate enough (eg out by an LSB of float precision). For example this test currently fails on PYBD_SF6 which uses double precision floats (and that's due to the `lib/libm_dbl/exp.c` implementation not being exact). This commit changes this constant test so that it tests the actual constant value, not the evaluation of `exp()` and `cos()` functions. Signed-off-by: Damien George <damien@micropython.org>	2025-05-22 17:19:03 +10:00
Malcolm McKellips	dc1af386a8	esp32/boards/SPARKFUN_IOT_REDBOARD_ESP32: Add SparkFun board. ... Add board definition files for SparkFun IoT RedBoard ESP32. Signed-off-by: Malcolm McKellips <malcolm.mckellips@sparkfun.com>	2025-05-22 10:37:38 +10:00
Malcolm McKellips	7f6fedef2a	rp2/boards/SPARKFUN_XRP_CONTROLLER_BETA: Fix default I2C to use I2C1. ... Signed-off-by: Damien George <damien@micropython.org>	2025-05-22 00:24:02 +10:00
Phil Howard	45cb9b4444	rp2/machine_pin: Fix simulated open drain with more than 32 GPIOs. ... Changes are: - Refactor the open-drain macros, add GPIO_ENABLE/DISABLE_OPEN_DRAIN, and move them to `mphalport.h`. - Only use `uint64_t` for the open-drain mask if there are more than 32 GPIOs (saves code size). - Ensure we're shifting a `uint64_t` by using 1ULL constants. Signed-off-by: Phil Howard <github@gadgetoid.com>	2025-05-22 00:08:27 +10:00
Phil Howard	28c8fff6d8	rp2/machine_pin: Replace macros with Pico SDK functions. ... Replace custom macros with Pico SDK functions, enabling support for RP2350B variant chips with > 32 GPIOs. Fixes issue #17241. Signed-off-by: Phil Howard <github@gadgetoid.com>	2025-05-22 00:03:20 +10:00
Angus Gratton	4545eb844d	rp2: Disable the LWIP tick timer when not needed. ... Prevents lightsleep being woken up every 64ms to service LWIP timers, when: 1. No netif is up, and 2. No TCP sockets are active The TCP socket check may not be strictly necessary, but without ticking the tcp timer they won't ever time out by themselves. This work was funded through GitHub Sponsors. Signed-off-by: Angus Gratton <angus@redyak.com.au>	2025-05-21 13:47:45 +10:00
Damien George	a1ee42cd3e	nrf: Use common implementation of machine disable/enable IRQ. ... This is a breaking change due to the signature change of `enable_irq()`. Previously the signature was: machine.enable_irq() Now the signature matches other ports, and the docs, and is: machine.enable_irq(state) Where `state` is the return value from `machine.disable_irq()`. Signed-off-by: Damien George <damien@micropython.org>	2025-05-21 13:30:40 +10:00
Damien George	cc7eb1a535	nrf/boards: Use 64 byte raw-paste buffer on PCA10028 and PCA10040. ... To workaround issues with JLink CDC. Signed-off-by: Damien George <damien@micropython.org>	2025-05-21 13:14:42 +10:00
Damien George	e676b58d9f	nrf: Fix UART write on parts that can't write more than 255 bytes. ... Some MCUs cannot write more than 255 bytes to the UART at once. Eg writing 256 bytes gets truncated to 0, writing 257 gets truncated to 1, etc. Signed-off-by: Damien George <damien@micropython.org>	2025-05-21 13:14:26 +10:00