912 Commits

Author	SHA1	Message	Date
Alessandro Gatti	10d4018872	tools/mpy_ld.py: Ignore R_XTENSA_NDIFF32 relocations. ... This commit introduces support for the negative counterpart of `R_XTENSA_PDIFF32`, ignoring the relocation instead of aborting processing. Signed-off-by: Alessandro Gatti <a.gatti@frob.it>	2026-06-03 22:15:28 +10:00
Finn Glas	935881eb18	tools/verifygitlog.py: Fix --pretty filter to inspect each arg. ... The list comprehension checked "--pretty" not in args (the entire argument list) instead of "--pretty" not in arg (the current element), so the filter could not actually strip a user-supplied --pretty argument from the call to git log. Signed-off-by: Finn Glas <finn@finnmglas.com>	2026-06-03 22:14:51 +10:00
Angus Gratton	3e5add395b	tools: Formally recommend the micropython-uncrustify package. ... Has been the unofficial best option for a while, this updates the docs and pre-commit/CI checks to match. Signed-off-by: Angus Gratton <angus@redyak.com.au>	2026-06-03 15:52:47 +10:00
Damien George	78fc0b2c90	tools/autobuild: Update example usage of script. ... Signed-off-by: Damien George <damien@micropython.org>	2026-05-29 15:49:59 +10:00
Damien George	5885f6bf0c	tools/autobuild: Print consistent msgs for start/pass/fail board build. ... Consistent messages are now printed to stdout (along with the main output of the build process) when the build starts, and when it succeeds or fails. For example: bash: Autobuild started for RPI_PICO ... ... bash: Autobuild succeeded for RPI_PICO Or in the case of a failure: bash: Autobuild started for RPI_PICO ... ... bash: Autobuild failed for RPI_PICO That helps searching the output logs for the results of all builds. And if something failed, it's easy to locate the rest of the build logs for the failure (they will be above the "Autobuild failed" message). Signed-off-by: Damien George <damien@micropython.org>	2026-05-29 15:49:59 +10:00
Damien George	4d3e2c6401	tools/autobuild: Remove the use of the "id" entry in board.json. ... This "id" entry was removed from all `board.json` files in commit 1a99f74063. Replace its use with the default value which is the board name. Signed-off-by: Damien George <damien@micropython.org>	2026-05-29 15:49:59 +10:00
Damien George	d05d988d8b	tools/ci.sh: Reorder alif and webassembly CI sections alphabetically. ... This commit makes sure the 17 ports CI sections are ordered alphabetically within the file. Also adds a heading for the last section of the file that makes the script easily runnable as a CLI tool. No functional change, just cosmetic (and makes it easier to maintain). Signed-off-by: Damien George <damien@micropython.org>	2026-05-29 14:52:45 +10:00
Alessandro Gatti	9c0249cddc	tools/mpy-tool.py: Clean up escaped compiled module name. ... This commit lets "mpy-tool.py" filter unwanted characters that may end up in the compiled module name, even after the first encoding pass. Certain characters are already ASCII-safe but cannot appear in a C identifier (eg. dots, dashes, etc.). Those characters, when appearing in a module name, won't be escaped and will be placed in the output C source code template when freezing files - leading to an invalid source file. Now the code, after the first character encoding pass, will pre-process the compiled module name to use when filling out the C source code template. Every character that is not expected to be part of a C identifier will be replaced with an underscore. This closes #3445. Signed-off-by: Alessandro Gatti <a.gatti@frob.it>	2026-05-29 14:47:50 +10:00
Damien George	36d29c29e6	ports: Switch ports to use lib/CMSIS_5 instead of lib/cmsis. ... This is a no-op change to the firmware because these CMSIS sources are equivalent (verified building the default board for all 6 affected ports). Signed-off-by: Damien George <damien@micropython.org>	2026-05-18 16:09:12 +10:00
Damien George	0715bec063	zephyr: Upgrade to Zephyr v4.4.0. ... Updates the Zephyr port build instructions and CI to use the latest Zephyr release tag. Tested on frdm_k64f and nucleo_wb55rg. Signed-off-by: Damien George <damien@micropython.org>	2026-05-13 14:28:05 +10:00
Damien George	ca29431e9a	zephyr/boards/qemu_x86: Enable CONFIG_X86_SSE2 for _Float16 use. ... Otherwise there is a compiler error. Likely due to the update to use zephyr SDK 1.0.1. Signed-off-by: Damien George <damien@micropython.org>	2026-05-13 14:28:05 +10:00
Alessandro Gatti	a595bbba67	tools/mpremote: Add an alias for codeberg repos. ... This commit introduces an alias to access codeberg repos from within mpremote's package manager. Right now packages hosted on codeberg could only be referenced by their full URL, unlike other packages hosted on either GitHub or GitLab. To make access those packages easier, now they can be referenced as "codeberg:org/repo@branch". Signed-off-by: Alessandro Gatti <a.gatti@frob.it>	2026-05-09 00:40:53 +02:00
Jos Verlinde	670d775365	tools/mpremote: Add tests for array readinto and write. ... Signed-off-by: Jos Verlinde <Jos_Verlinde@hotmail.com>	2026-05-09 00:46:28 +10:00
Jos Verlinde	6443130968	tools/mpremote: Fix length calculation in RemoteCommand for arrays. ... Refactor the byte length calculation in the wr_bytes and read methods to use a new `buffer_nbytes` function. This change corrects the accuracy of byte length determination for various buffer types. Closes: #17665 Signed-off-by: Jos Verlinde <Jos_Verlinde@hotmail.com>	2026-05-09 00:46:25 +10:00
Damien George	bad1c60953	tools/ci.sh: Build user C example modules as part of alif CI. ... Signed-off-by: Damien George <damien@micropython.org>	2026-05-01 14:25:10 +10:00
Alessandro Gatti	70bb728c09	tools/ci.sh: Let QEMU try to build with a user module. ... This commit brings the QEMU port in line with other ports when it comes to making sure the port builds with a user module to be part of the main interpreter. To not impact too much on the build time, only the `MPS2_AN385` board does this as there'd be just too many targets to test, for not much gain. Signed-off-by: Alessandro Gatti <a.gatti@frob.it>	2026-04-30 23:39:42 +10:00
Alessandro Gatti	ca85a1eb23	tools/boardgen.py: Make per-pin content output extensible. ... This commit lets classes extending the base `PinGenerator` class to override the process of generating extra per-pin content when creating the pins' information source file. There are cases in which one may want to have more control on the part of the source generation process that dumps additional per-pin information to the source file. The current approach works fine if each pin generates self-contained additional data to be placed in the source file, but there is no clean way to provide a prologue or an epilogue to that content. For example, if one wants to emit a single consolidated additional pin data table it is not that convenient to be able to consistently emit the table start definition and the table end markers. With these changes all one has to do to achieve this is to override `PinGenerator.print_pin_source` in their PinGenerator-derived class to either wrap the output or to replace what is being output altogether. Signed-off-by: Alessandro Gatti <a.gatti@frob.it>	2026-04-30 23:32:40 +10:00
Alessandro Gatti	67de20ae0a	tests: Rename "tests/frozen" into "tests/assets". ... This commit renames the "tests/frozen" directory into "tests/assets" to make it more explicit that it does contain files that are needed for other tests to function. Right now there's only a single pre-compiled module being used for miscellaneous tests, but it will soon hold ROMFS test data as well. Signed-off-by: Alessandro Gatti <a.gatti@frob.it>	2026-04-15 16:04:26 +10:00
Angus Gratton	bc92f5a249	nrf: Add support for building C++ user modules. ... The compiler flags -ansi -std=c11 were both being passed to g++, causing weirdness. Removed the -ansi flag entirely, it's superseded by explicitly setting the standard. Also adds build coverage for user C modules (including C++) in CI. This work was funded through GitHub Sponsors. Signed-off-by: Angus Gratton <angus@redyak.com.au>	2026-04-15 15:25:50 +10:00
Angus Gratton	523ad2c6f0	tools/ci.sh: Build the usercmodule example in CI for more ports. ... Adds build coverage of C++ compilation on the following ports: mimxrt, renesas-ra, esp8266, windows (mingw32). This work was funded through GitHub Sponsors. Signed-off-by: Angus Gratton <angus@redyak.com.au>	2026-04-15 15:24:40 +10:00
Damien George	5c00edcee2	tools/ci.sh: Increase qemu_arm test run timeout. ... It takes longer now that weakref is enabled in the coverage build. Signed-off-by: Damien George <damien@micropython.org>	2026-03-22 23:19:28 +11:00
Angus Gratton	2ccf78ae19	ci,esp32: Build oldest & newest ESP-IDF versions in CI. ... Intended to catch problems where new features don't build in old ESP-IDF. Includes major refactor to the GitHub Actions Workflow for esp32 port, including making a reusable workflow for both Code Size and ESP32 build jobs. This work was funded through GitHub Sponsors. Signed-off-by: Angus Gratton <angus@redyak.com.au>	2026-03-20 12:42:52 +11:00
Andrew Leech	43199278eb	tests/run-tests.py: Ignore known-flaky test failures. ... Reclassify failures of tests listed in flaky_tests_to_ignore as "ignored" instead of retrying them. Ignored tests still run and their output is reported, but they don't affect the exit code. The ci.sh --exclude lists for these tests are removed so they run normally. Signed-off-by: Andrew Leech <andrew.leech@planet-innovation.com>	2026-03-11 14:56:04 +11:00
stijn	412ffd4b32	tools/codeformat.py: Use input files when formatting python code. ... Signed-off-by: stijn <stijn@ignitron.net>	2026-02-26 16:18:49 +11:00
Damien George	3a487c32ba	all: Fix spelling of Micropython -> MicroPython. ... Signed-off-by: Damien George <damien@micropython.org>	2026-01-13 12:51:31 +11:00
Alessandro Gatti	b87d73f2e9	tools/mpy_ld.py: Write architecture flags to output natmod if needed. ... This commit lets "tools/mpy_ld.py" store architecture flags in generated MPY files if explicitly requested, like "mpy-cross" does. To achieve this, a new command-line option ("--arch-flags") was added to receive the architecture flags value, accepting the same arguments' format as "mpy-cross", and performing the same input validation. The rest of the MPY toolchain was also modified to let the user pass the arch flags to standard native module makefiles. Given that there's already a well-established "ARCH" argument, "ARCH_FLAGS" was chosen to pass the optional flags to "mpy_ld.py". Finally, documentation was updated to mention the new variable. Signed-off-by: Alessandro Gatti <a.gatti@frob.it>	2026-01-11 09:22:13 +01:00
Alessandro Gatti	0fd084363a	tools/mpy_ld.py: Optimise MPY trampoline sizes if possible. ... This commit changes the way native modules' trampoline code sequence is emitted, generating an optimised code sequence to jump to the entry symbol. Turns out the address of the entry point is known even before the segments are built and the address of the entry point doesn't change when processing the module on anything but Xtensa. This means that the jump trampoline doesn't have to be a dummy fixed-size block to be filled in later, but it can be the final trampoline being used in the module. On Xtensa the address of the symbol is offset by the length of the literals pool, but since the trampoline being generated is always the shortest one said platform is left alone (handling distances greater than 128KiB would require more extensive changes). Signed-off-by: Alessandro Gatti <a.gatti@frob.it>	2026-01-09 14:46:52 +11:00
Alessandro Gatti	21e4c036af	tools/ci.sh: Update Unix/x86 target to Ubuntu 24.04 LTS. ... This commit updates the Unix/x86 target's environment to use the latest available LTS version of Ubuntu Linux (24.04). Since the new OS updated some key components used in the CI build process, a few modifications have been made to the setup and build procedure. The new OS introduces a CPython version that is known to not be compatible with a subset of settrace tests, so even though the OS is updated, an older version of CPython is installed as part of the image provisioning process. Signed-off-by: Alessandro Gatti <a.gatti@frob.it>	2026-01-07 12:04:41 +01:00
Alessandro Gatti	31fe865460	tools/ci.sh: Use CPython 3.11 for Unix/RV64. ... This commit forces the installation of CPython 3.11 instead of CPython 3.12 in the OS image for Unix/RV64 CI jobs. CPython 3.12 is not compatible with settrace tests, but it is the CPython version that is installed by default in "ubuntu-latest" (which is Ubuntu 24.04 LTS right now). Updating the base image for the RV64 tests also disabled settrace tests to work around its incompatibility, however turns out there is a way to force CI to set up a base OS image with an arbitrary CPython version. Now the RV64 CI jobs are now going to be executed using CPython 3.11, and thus the settrace tests can be removed from the ignore list. Signed-off-by: Alessandro Gatti <a.gatti@frob.it>	2026-01-07 00:09:54 +11:00
Alessandro Gatti	16844bb027	tools/ci.sh: Update Unix/Arm target to Ubuntu 24.04 LTS. ... This commit updates the Unix/Arm target's environment to use the latest available LTS version of Ubuntu Linux (24.04). Since the new OS updated some key components used in the CI build process, a few modifications have been made to the setup and build procedure. Newer QEMU's sysroot location changed and the "static" variant of the QEMU emulators has to be used to make binfmt work, and updated autotools versions split some macros into an optional package that has to be manually installed. Signed-off-by: Alessandro Gatti <a.gatti@frob.it>	2026-01-07 00:09:54 +11:00
Alessandro Gatti	6dea53cb27	tools/ci.sh: Update Unix/MIPS target to Ubuntu 24.04 LTS. ... This commit updates the Unix/MIPS target's environment to use the latest available LTS version of Ubuntu Linux (24.04). Since the new OS updated some key components used in the CI build process, a few modifications have been made to the setup and build procedure. Newer QEMU's sysroot location changed and the "static" variant of the QEMU emulators has to be used to make binfmt work, and updated autotools versions split some macros into an optional package that has to be manually installed. Signed-off-by: Alessandro Gatti <a.gatti@frob.it>	2026-01-07 00:09:54 +11:00
Jeff Epler	569ebaa828	tools/ci.sh: Put embedding build rules in ci.sh. ... To make this CI step runnable locally by `ci.sh`. Signed-off-by: Jeff Epler <jepler@unpythonic.net>	2026-01-05 12:01:59 +11:00
Jeff Epler	6c7edce76c	github/workflows: Add esp32 to code size report. ... Add an esp32 build (specifically ESP32_GENERIC) to the CI code-size check. Multiple new steps must be done to prepare for building esp32, and caching is used to speed up both the install of the IDF and the build process. Signed-off-by: Jeff Epler <jepler@unpythonic.net>	2026-01-05 11:40:08 +11:00
Jeff Epler	0aa6115aac	github/workflows: Introduce and use ci_esp32_idf_ver helper. ... Signed-off-by: Jeff Epler <jepler@unpythonic.net>	2026-01-05 11:39:25 +11:00
Alessandro Gatti	d871c970c0	tools/ci.sh: Run natmod tests as part of CI for Unix/RV64. ... This commit updates the test procedure for the Unix port targeting the RV64 platform to also run the battery of native modules test that is part of the QEMU port. Unfortunately this required a few changes to the CI setup since the Unix port was still using an older version of Ubuntu LTS than the RISC-V natmods build infrastructure expects. Updating the OS version just for the RV64 Unix target brought a couple of issues when building the code (an extra package is now needed to let FFI build) and running tests (QEMU binfmt support requires a new setup). Signed-off-by: Alessandro Gatti <a.gatti@frob.it>	2026-01-01 17:08:56 +01:00
Alessandro Gatti	9af103300f	qemu: Enable loading natmods on RV64. ... This commit lets the QEMU port's VIRT_RV64 board load and run native modules, via the appropriate configuration changes in mpconfigport.h. Now the CI test job for the QEMU/RV64 port can also run natmods and see whether they actually work, so the CI tasks script has been updated to bring RV64 to parity with RV32 as far as CI checks go. Documentation was also updated, since now all supported boards in the QEMU port should be able to run natmod tests. Signed-off-by: Alessandro Gatti <a.gatti@frob.it>	2026-01-01 16:35:02 +01:00
Alessandro Gatti	e939d3ec76	tools/mpy_ld.py: Add RV64 natmod support. ... This commit adds the ability to compile native modules for the RV64 platform, using "rv64imc" as its architecture name (eg. "make ARCH=rv64imc" should build a RV64 natmod). The rest of 64-bits relocations needed to build a native module are now implemented, and all sample native modules build without errors or warnings. The same Picolibc caveats on RV32 also apply on RV64, thus the documentation was updated accordingly. RV64 native modules are also built as part of the CI process, but not yet executed as the QEMU port is not yet able to load and run them. Signed-off-by: Alessandro Gatti <a.gatti@frob.it>	2025-12-30 18:18:42 +01:00
Alessandro Gatti	1f67289a9e	tools/mpy_ld.py: Fix handling of R_RISCV_TLSDESC_LOAD_LO12. ... This commit fixes handling of the R_RISCV_TLSDESC_LOAD_LO12 RISC-V object file relocation, fixing a couple of mistakes in its usage. The condition check for TLS relocations presence and their rejection when found in object files skipped checking for R_RISCV_TLSDESC_LOAD_LO12 relocations, which is part of the set of unsupported TLS relocations and thus needing an object file rejection. Interestingly, that relocation name constant was actually misspelled in the file - since it was skipped in the list of relocations being checked its wrong name did pass unnoticed until now. This is not a critical change as the linker will raise an error about an unknown relocation type rather than report a more descriptive message to the user, but it's nice to have nonetheless. Signed-off-by: Alessandro Gatti <a.gatti@frob.it>	2025-12-30 17:56:02 +01:00
Alessandro Gatti	984027b88e	tools/mpy_ld.py: Fix R_RISCV_GOT32_PCREL handling. ... This commit fixes the implementation of the R_RISCV_GOT32_PCREL RISC-V relocation type when linking native modules for RV32IMC. The previous implementation of R_RISCV_GOT32_PCREL ended up not being fully updated when the initial RV32 support was checked in. Said relocation was not emitted in the sample natmods that ship with the MicroPython source tree, and since they're the testbed for CI jobs that should check RV32 natmod support, this was not caught. On the other hand, nobody raised an issue about this problem yet, so hopefully it didn't cause much trouble. Signed-off-by: Alessandro Gatti <a.gatti@frob.it>	2025-12-30 17:56:02 +01:00
Damien George	3f796b687b	tools/autobuild: Make firmware destination directory configurable. ... The destination directory for the firmware built by `autobuild.sh` is currently hard-coded to `/tmp/autobuild-firmware-$$`. Now that there are many boards built by this script, the `/tmp` partition can run out of space. This commit makes the destination directory configurable via the `MICROPY_AUTOBUILD_DEST` environment variable. Signed-off-by: Damien George <damien@micropython.org>	2025-12-04 00:33:04 +11:00
Matt Trentini	bfacf821f4	rp2/boards/WEACTSTUDIO_RP2350B_CORE: Add board.pinout. ... This adds an ANSI-rendered pinout for the WeAct Studio RP2350B Core board. Signed-off-by: Matt Trentini <matt.trentini@gmail.com>	2025-12-01 16:05:49 +11:00
Vincent1-python	50a06b6404	esp32/boards/ESP32_GENERIC_P4: Add board definition for ESP32P4. ... Includes a base variant with LAN, and C5_WIFI and C6_WIFI variants with LAN, WiFi and BLE. And builds this board in the esp32 CI, to cover the P4 support. Signed-off-by: Vincent1-python <pywei201209@163.com> Signed-off-by: Angus Gratton <angus@redyak.com.au> Signed-off-by: Damien George <damien@micropython.org>	2025-12-01 13:08:52 +11:00
Damien George	2fbd72ad78	tools/ci.sh: Build all stm32 MCU families in stm32 CI functions. ... Currently the CI for stm32 only tests building about half of the available MCU families. This commit adds the remaining families to the stm32 CI jobs. Signed-off-by: Damien George <damien@micropython.org>	2025-11-30 15:26:41 +11:00
Damien George	f63e64f4bc	tools/ci.sh: Install latest ARM toolchain for stm32 CI. ... This is needed to build Cortex-M55 (STM32N6) based boards. Signed-off-by: Damien George <damien@micropython.org>	2025-11-30 15:26:41 +11:00
Alessandro Gatti	6b661ca3f6	github/workflows: Test mpy-cross debug emitter. ... This commit adds a new workflow step to the CI, to test the debug emitter provided by mpy-cross. The checks being done are limited to make sure that the debug emitter does not crash and emits opcodes for a simple test file that is guaranteed to work for all configurations. Signed-off-by: Alessandro Gatti <a.gatti@frob.it>	2025-11-27 14:18:04 +11:00
Alessandro Gatti	4633d2a037	tools/ci.sh: Add zsh and fish shell completion support. ... This commit adds custom command completion functions for both the zsh and fish shell. The behaviour for those new completions follow the existing completion for the bash shell, including the way to generate the completion alias (with appropriately named command line switches). Signed-off-by: Alessandro Gatti <a.gatti@frob.it>	2025-11-26 13:50:39 +11:00
Anson Mansfield	c9af4e1a7e	tools/mpy-tool.py: Add Compiler Explorer JSON output. ... This commit adds a `--json` option to `mpy-tool.py`, in order to generate Compiler-Explorer-compatible JSON annotation information for the bytecode disassembly. Some of this information might be theoretically possible to parse out from the text itself, but not all of it is, e.g. disambiguating child references with non-unique simple names. Signed-off-by: Anson Mansfield <amansfield@mantaro.com>	2025-11-24 12:40:39 +11:00
Damien George	336d463eb2	tools/ci.sh: Build ESP32_GENERIC_C5 as part of esp32 CI. ... Signed-off-by: Damien George <damien@micropython.org>	2025-11-17 13:57:48 +11:00
Damien George	2a5c5093ec	tools/cc1: Fix ruff lint check with list length. ... Signed-off-by: Damien George <damien@micropython.org>	2025-11-05 12:46:29 +11:00
Christian Clauss	509207c9d0	tools/cc1: Apply ruff formatting to cc1 script. ... Running `ruff format tools/cc1` picks up `tools/cc1` which is a Python file that does not have a .py file extension. Signed-off-by: Christian Clauss <cclauss@me.com> Signed-off-by: Damien George <damien@micropython.org>	2025-11-05 12:42:42 +11:00