1387 Commits

Author	SHA1	Message	Date
Damien George	dafff1fd0e	extmod/network_cyw43: Add WPA3 security constants. ... These are now supported by cyw43-driver. Signed-off-by: Damien George <damien@micropython.org>	2025-03-12 13:17:02 +11:00
Damien George	d4b8ca2ffc	extmod/vfs: Add mp_vfs_mount_romfs_protected() helper. ... This function will attempt to create a `VfsRom` instance and mount it at location "/rom" in the filesystem. Signed-off-by: Damien George <damien@micropython.org>	2025-03-06 12:52:35 +11:00
Damien George	89e6c58c80	extmod/modvfs: Add vfs.rom_ioctl function and its ioctl constants. ... This is a generic interface to allow querying and modifying the read-only memory area of a device, if it has such an area. Signed-off-by: Damien George <damien@micropython.org>	2025-03-06 12:52:35 +11:00
Damien George	14ba32bb20	extmod/vfs_rom: Add bounds checking for all filesystem accesses. ... Testing with ROMFS shows that it is relatively easy to end up with a corrupt filesystem on the device -- eg due to the ROMFS deploy process stopping half way through -- which could lead to hard crashes. Notably, there can be boot loops trying to mount a corrupt filesystem, crashes when importing modules like `os` that first scan the filesystem for `os.py`, and crashing when deploying a new ROMFS in certain cases because the old one is removed while still mounted. The main problem is that `mp_decode_uint()` has an loop that keeps going as long as it reads 0xff byte values, which can happen in the case of erased and unwritten flash. This commit adds full bounds checking in the new `mp_decode_uint_checked()` function, and that makes all ROMFS filesystem accesses robust. Signed-off-by: Damien George <damien@micropython.org>	2025-02-26 16:11:19 +11:00
Christian Clauss	5e206fdeb5	all: Upgrade codespell to v2.4.1. ... This commit upgrades from codespell==2.2.6 to the current codespell==2.4.1, adding emac to the ignore-words-list. Signed-off-by: Christian Clauss <cclauss@me.com>	2025-02-25 16:11:33 +11:00
Keenan Johnson	321b30ca56	extmod/modtls_mbedtls: Wire in support for DTLS. ... This commit enables support for DTLS, i.e. TLS over datagram transport protocols like UDP. While support for DTLS is absent in CPython, it is worth supporting it in MicroPython because it is the basis of the ubiquitous CoAP protocol, used in many IoT projects. To select DTLS, a new set of "protocols" are added to SSLContext: - ssl.PROTOCOL_DTLS_CLIENT - ssl.PROTOCOL_DTLS_SERVER If one of these is set, the library assumes that the underlying socket is a datagram-like socket (i.e. UDP or similar). Our own timer callbacks are implemented because the out of the box implementation relies on `gettimeofday()`. This new DTLS feature is enabled on all ports that use mbedTLS. This commit is an update to a previous PR #10062. Addresses issue #5270 which requested DTLS support. Signed-off-by: Keenan Johnson <keenan.johnson@gmail.com>	2025-02-14 12:55:25 +11:00
Thomas Watson	aef6705a32	extmod/lwip-include: Increase number of lwIP timers when mDNS enabled. ... Despite the code comments claiming one is sufficient, the mDNS application is capable of using up to twelve timers. Three per IP protocol are started at once in `mdns_start_multicast_timeouts_ipvX`, then another two per protocol can be started in `mdns_handle_question`. Further timers can be started for two additional callbacks. Having certain timers, such as `MDNS_MULTICAST_TIMEOUT`, fail to start due to none being free will break mDNS forever as the app will never realize it's safe to transmit a packet. Therefore, this commit goes somewhat overkill and allocates the maximal amount of timers; it's uncertain if all can run simultaneously, or how many callback timers are needed. Each timer struct is 16 bytes on standard 32 bit builds. Plus, say, 8 bytes of allocater overhead, that's 288 more bytes of RAM used which shouldn't be too horrible. Users who don't need mDNS can manually disable it to recover the RAM if necessary. This fixes mDNS on W5500_EVB_PICO (among other boards). Before, mDNS would work for a bit after connection until the host's cache expired a minute or two later. Then the board would never respond to further queries. With this patch, all works well. Signed-off-by: Thomas Watson <twatson52@icloud.com>	2025-02-14 12:32:00 +11:00
Damien George	30acb16ad3	extmod/vfs_rom: Remove ability to create VfsRom from an address. ... It's not necessary to support this, which allows an arbitrary memory address to be specified and potentially allows invalid memory accesses. Requiring an object with the buffer protocol is safer, and also means that the length of the region is always specified. Signed-off-by: Damien George <damien@micropython.org>	2025-02-11 17:56:13 +11:00
Damien George	c3a18d74eb	extmod/modmarshal: Add new marshal module. ... This commit implements a small subset of the CPython `marshal` module. It implements `marshal.dumps()` and `marshal.loads()`, but only supports (un)marshalling code objects at this stage. The semantics match CPython, except that the actual marshalled bytes is not compatible with CPython's marshalled bytes. The module is enabled at the everything level (only on the unix coverage build at this stage). Signed-off-by: Damien George <damien@micropython.org>	2025-02-11 16:54:20 +11:00
Angus Gratton	97f444bfa0	extmod/mbedtls: Try GC before failing to setup socket on esp32, unix. ... On mbedTLS ports with non-baremetal configs (mostly esp32, technically also unix port), mbedTLS memory is allocated from the libc heap. This means an old SSL socket may be holding large SSL buffers and preventing a new SSL socket from being allocated. As a workaround, trigger a GC pass and retry before failing outright. This was originally implemented as a global mbedTLS calloc function, but there is complexity around the possibility of C user modules calling into mbedTLS without holding the GIL. It would be interesting to try making a generic version for any malloc which fails, but this would require checking for a Python thread and probably making the GIL recursive. This work was funded through GitHub Sponsors. Signed-off-by: Angus Gratton <angus@redyak.com.au>	2025-02-03 15:02:02 +11:00
Damien George	abb13b1e1e	extmod/lwip-include: Factor common lwIP config into lwipopts_common.h. ... This lwIP configuration file has options that are common to all ports, and the ports are updated to use this file. This change is a no-op, the lwIP configuration remains the same for the four ports using this common file. This reduces code duplication, keeps the ports in sync, and makes it easier to update the configuration for all ports at once. Signed-off-by: Damien George <damien@micropython.org>	2025-01-29 12:36:27 +11:00
Jared Hancock	f29bd5a65e	extmod/modlwip: Fix incorrect peer address for IPv6. ... For IPv6 connections, the peer address was previously defined as only the first four bytes of the IP address. For IPv6 addresses, this resulted in an incorrect IPv4 address. For instance, receiving a packet via `::recvfrom` from `'fe80::87:e7ff:fe48:629a'` is returned as having a peer address of `'254.128.0.0'` Signed-off-by: Jared Hancock <jared.hancock@centeredsolutions.com>	2025-01-29 10:49:34 +11:00
Glenn Strauss	f2cd1a3db6	lib/mbedtls: Update to mbedtls v3.6.2. ... Signed-off-by: Glenn Strauss <gstrauss@gluelogic.com>	2025-01-17 10:10:57 +11:00
Yoctopuce	61995b53c3	extmod/moddeflate: Add missing size_t cast. ... To prevent compiler warnings. Signed-off-by: Yoctopuce <dev@yoctopuce.com>	2025-01-02 13:33:39 +11:00
Yoctopuce	b323b42770	extmod/modsocket: Add missing static in private function definitions. ... Signed-off-by: Yoctopuce <dev@yoctopuce.com>	2025-01-02 13:33:39 +11:00
Damien George	5e9dd4b6a2	extmod/vfs_reader: Add support for opening a memory-mappable file. ... If the file can be memory mapped (because it responds to the buffer protocol) then return a memory-reader that directly references the ROM data of the file. Signed-off-by: Damien George <damien@micropython.org>	2024-12-23 13:04:54 +11:00
Damien George	50637ff239	extmod/vfs_rom: Add VfsRom filesystem object. ... This commit defines a new ROMFS filesystem for storing read-only files that can be memory mapped, and a new VfsRom driver. Files opened from this filesystem support the buffer protocol. This allows naturally getting the memory-mapped address of the file using: - memoryview(file) - uctypes.addressof(file) Furthermore, if these files are .mpy files then their content can be referenced in-place when importing. Such imports take up a lot less RAM than importing from a normal filesystem. This is essentially dynamically frozen .mpy files, building on the revamped v6 .mpy file format. Signed-off-by: Damien George <damien@micropython.org>	2024-12-23 13:04:54 +11:00
Damien George	8b6bd43eab	extmod/vfs: Guard mutating fs functions with MICROPY_VFS_WRITABLE. ... Enabled by default. Useful for ports that need the VFS but don't have any writable filesystems. Signed-off-by: Damien George <damien@micropython.org>	2024-12-20 21:58:50 +11:00
Damien George	8970ede7cc	extmod/moductypes: Fix large return values of addressof and INT_MAYBE. ... So they don't return a negative number for an address (prior to this fix they would return negative addresses for values that were larger than the maximum small-int value). Signed-off-by: Damien George <damien@micropython.org>	2024-12-18 11:00:08 +11:00
Alessandro Gatti	28b5244666	extmod/modplatform: Distinguish RISC-V 64 from RISC-V 32. ... This commit lets the platform module report a more accurate architecture name when running on a RISC-V 64 bits platform. Signed-off-by: Alessandro Gatti <a.gatti@frob.it>	2024-12-10 12:10:36 +11:00
iabdalkader	a118cf9ab0	extmod/extmod.mk: Fix libmetal build prefix. ... libmetal source files already have the build directory prefix, because they're auto-generated inside the build directory. When they're added to `SRC_THIRDPARTY_C`, another build directory prefix is added resulting in the object files being generated in a nested build directory. This patch strips the build directory prefix before adding libmetal's source files. Signed-off-by: iabdalkader <i.abdalkader@gmail.com>	2024-12-10 10:25:02 +11:00
Alessandro Gatti	3de3821abf	extmod/modplatform: Add Android to the recognised platforms list. ... This commit adds code to distinguish between regular Linux and Android, also adding a specific entry for the platform libc. The reported libc is marked as "bionic" and its version matches the Android platform API version (there are no definitions for a specific bionic version). Signed-off-by: Alessandro Gatti <a.gatti@frob.it>	2024-11-30 12:42:51 +11:00
Alessandro Gatti	09cf01d7c1	extmod/modplatform: Add Clang to the known compilers list. ... This commit adds support to distinguish between GCC and Clang to report the appropriate compiler version. Usually Clang also disguises itself as GCC for compatibility reasons, but these changes look for Clang-specific definitions first to avoid that problem. Signed-off-by: Alessandro Gatti <a.gatti@frob.it>	2024-11-30 12:42:51 +11:00
Alessandro Gatti	579e840de6	extmod/modplatform: Distinguish AArch64 from AArch32. ... This commit adds a new platform architecture name for Arm CPUs running in 64 bits mode ("aarch64"). The 32 bits name is left as "arm" to maintain compatibility with existing code. Signed-off-by: Alessandro Gatti <a.gatti@frob.it>	2024-11-30 12:42:51 +11:00
Corran Webster	e70048cf59	extmod/modframebuf: Fix 0 radius bug in FrameBuffer.ellipse. ... This fixes a bug in FrameBuffer.ellipse where it goes into an infinite loop if both radii are 0. This fixes the bug with a simple pre-check to see if both radii are 0, and in that case sets a single pixel at the center. This is consistent with the behaviour of the method when called with just one of the radii set to 0, where it will draw a horizontal or vertical line of 1 pixel width. The pixel is set with setpixel_checked so it should handle out-of-bounds drawing correctly. This fix also includes three new tests: one for the default behaviour, one for drawing out-of-bounds, and one for when the sector mask is 0. Fixes issue #16053. Signed-off-by: Corran Webster <cwebster@unital.dev>	2024-11-28 22:56:44 +11:00
Angus Gratton	181800eebd	extmod/network_cyw43: Allow configuring active AP interface. ... Configuring the AP for cyw43 writes to some buffers that are only sent to the modem when the interface is brought up. This means you can't configure the AP after calling active(True), the new settings seem to be accepted but the radio doesn't change. This is different to the WLAN behaviour on other ports. The esp8266 port requires calling active(True) on the AP before configuring, even. Fix this by bouncing the AP interface after a config change, if it's active. Configuring with active(False) still works the same as before. Adds a static variable to track interface active state, rather than relying on the LWIP interface state. This is because the interface state is updated by a driver callback and there's a race: if code calls active(True) and then config(a=b) then the driver doesn't know it's active yet and the changes aren't correctly applied. It is possible this pattern will cause the AP to come up briefly with the default "PICOabcd" SSID before being reconfigured, however (due to the aforementioned race condition) it seems like this may not happen at all before the new config is applied. This work was funded through GitHub Sponsors. Signed-off-by: Angus Gratton <angus@redyak.com.au>	2024-11-20 14:42:26 +11:00
Damien George	af743eaf59	extmod/network_cyw43: Fix uninitialised variable in status('stations'). ... The `num_stas` was uninitialised and if it happened to take the value 0 then no results were returned. It now has the correct maximum value. Signed-off-by: Damien George <damien@micropython.org>	2024-11-20 14:23:20 +11:00
Angus Gratton	f562aa1291	extmod/network_cyw43: Fix isconnected() result on AP interface. ... This function is documented to return True if any stations are connected to the AP. Without this fix it returns True whenever the driver has brought the AP interface up. This work was funded through GitHub Sponsors. Signed-off-by: Angus Gratton <angus@redyak.com.au>	2024-11-20 14:21:57 +11:00
Damien George	5dc9eda195	extmod/vfs_blockdev: Support bool return from Python read/write blocks. ... Commit f4ab9d9247 inadvertently broke some Python block devices, for example esp32 and stm32 SDCard classes. Those classes return a bool from their `readblocks` and `writeblocks` methods instead of an integer errno code. With that change, both `False` and `True` return values are now be interpreted as non-zero and hence the block device call fails. The fix in this commit is to allow a bool and explicitly convert `True` to 0 and `False` to `-MP_EIO`. Signed-off-by: Damien George <damien@micropython.org>	2024-11-13 14:21:29 +11:00
Daniël van de Giessen	77406b4240	extmod/network_ppp: Allow stream=None to suspend PPP. ... This allows the stream to be set to `None`, which essentially stops all PPP communication without disconnecting the session. This allows replacing the stream on-the-fly to suspend it, for example to send AT commands to a modem without completely disconnecting and re-establishing the PPP connection: uart = ppp.config('stream') ppp.config(stream=None) uart.write(b'+++') # do some AT commands uart.write(b'ATO\r\n') ppp.config(stream=uart) Any attempted communication by PPP while the stream is not connected will register as simple packet loss to the LwIP stack because we return 0 for any write calls, and protocols like TCP will then automatically handle retrying. Signed-off-by: Daniël van de Giessen <daniel@dvdgiessen.nl>	2024-11-13 13:11:32 +11:00
Daniël van de Giessen	161e2bd37d	extmod/network_ppp: Add stream config parameter. ... This makes the stream that the PPP object wraps, which is normally only set once via the constructor, accessible and configurable via the `ppp.config()` method. Signed-off-by: Daniël van de Giessen <daniel@dvdgiessen.nl>	2024-11-13 13:10:58 +11:00
Damien George	eab2869990	extmod/modlwip: Don't allow writing to a TCP socket that is connecting. ... This follows the behaviour of unix MicroPython (POSIX sockets) and the esp32 port. Signed-off-by: Damien George <damien@micropython.org>	2024-11-13 11:44:09 +11:00
Damien George	d278ba5cc5	extmod/nimble: Remove asserts of ediv_rand_present and adjust comments. ... Recent versions of NimBLE (since release 1.6.0) removed this variable; see 7cc8c08d67. We never used it except in an assert, so remove those asserts to make the code compatible with newer NimBLE versions (eg for the esp32 port). Signed-off-by: Damien George <damien@micropython.org>	2024-11-05 11:27:06 +11:00
Damien George	919756cea4	extmod/modlwip: Fix IGMP address type when IPv6 is enabled. ... This was missed in 628abf8f25. The the bug was that, when IPv6 is enabled, the `sizeof(ip_addr_t)` is much larger than IPv4 size, which is what's needed for IGMP addressing. Fixes issue #16100. Signed-off-by: Damien George <damien@micropython.org>	2024-11-04 13:12:18 +11:00
iabdalkader	68f1c20145	extmod/modtls_mbedtls: Support alternate sign callbacks in Python. ... This commit enables the implementation of alternative mbedTLS cryptography functions, such as ECDSA sign and verify, in pure Python. Alternative functions are implemented in Python callbacks, that get invoked from wrapper functions when needed. The callback can return None to fall back to the default mbedTLS function. A common use case for this feature is with secure elements that have drivers implemented in Python. Currently, only the ECDSA alternate sign function wrapper is implemented. Tested signing with a private EC key stored on an NXP SE05x secure element. Signed-off-by: iabdalkader <i.abdalkader@gmail.com>	2024-10-25 01:16:06 +11:00
iabdalkader	2644f577f1	extmod/modtls_mbedtls: Add a thread-global ptr for current SSL context. ... This is necessary for mbedTLS callbacks that do not carry any user state, so those callbacks can be customised per SSL context. Signed-off-by: iabdalkader <i.abdalkader@gmail.com>	2024-10-25 01:12:36 +11:00
Jared Hancock	078ead24f3	extmod/network_wiznet5k: Reset mDNS when interface is brought up. ... The LwIP interface is removed in wiznet5k_deinit() which is called as part of the init sequence. Therefore, if using mDNS, then the interface will need to be re-added when bringing the interface up. Additionally, this allows to set the hostname from MicroPython code prior to bringing the interface up and mDNS responding to the (new) hostname. This allows the hostname to be configured and saved on the flash or be based on dynamic information such as the MAC or unique_id(). Signed-off-by: Jared Hancock <jared.hancock@centeredsolutions.com>	2024-10-23 16:29:28 +11:00
Corran Webster	d1574de3b6	extmod/modframebuf: Fix FrameBuffer size check for stride corner-cases. ... This is a fix for issue #15944, and handles corner cases in the FrameBuffer code when using stride values where the last line's stride may extend past the end of the underlying buffer. This commit includes extra tests for these corner cases. For example a GS8 format FrameBuffer with a width of 8, height of 2 and stride of 10 should be able to fit into a buffer of size 18 (10 bytes for the first horizontal line, and 8 bytes for the second -- the full 10 bytes are not needed). Similarly a 1 by 9 FrameBuffer in MONO_VLSB format with a stride of 10 should be able to fit into a buffer of length 11 (10 bytes for the first 8 lines, and then one byte for the 9th line. Being able to do this is particularly important when cropping the corner of an existing FrameBuffer, either to copy a sprite or to clip drawing. Signed-off-by: Corran Webster <cwebster@unital.dev>	2024-10-22 13:05:31 +11:00
stijn	6835743dcc	extmod/vfs_posix_file: Skip flush of tty handles in msvc debug builds. ... In MSVC debug builds with debug error reporting set to showing a dialog (to allow attaching the debugger), any application which imports the logging module and leaves the default handlers would result in this dialog because logging.shutdown is called at exit and that flushes the default handler which has stderr as its stream. This commit fixes that by not fsync'ing stdin/out/err. Also adds a comment related to checking whether a file is stdin/out/err, which is difficult to fix properly. Signed-off-by: stijn <stijn@ignitron.net>	2024-10-09 15:03:07 +11:00
Angus Gratton	f4ab9d9247	extmod/vfs_blockdev: Implement common helper for read and write. ... - Code size saving as all of these functions are very similar. - Resolves the "TODO" of the plain read and write functions not propagating errors. An error in the underlying block device now causes VFatFs to return EIO, for example. This work was funded through GitHub Sponsors. Signed-off-by: Angus Gratton <angus@redyak.com.au>	2024-09-26 22:08:48 +10:00
Angus Gratton	4f6d4b2b49	extmod/vfs_blockdev: Check block device function positive results. ... A positive result here can result in eventual memory corruption as littlefs expects the result of a cache read/write function to be 0 or a negative integer for an error. Closes #13046 This work was funded through GitHub Sponsors. Signed-off-by: Angus Gratton <angus@redyak.com.au>	2024-09-26 22:08:48 +10:00
iabdalkader	3294606e23	extmod/libmetal: Fix libmetal rules for mkdir dependencies. ... Dependency on auto-generated libmetal should be an order only prerequisite. Signed-off-by: iabdalkader <i.abdalkader@gmail.com>	2024-09-06 17:14:03 +10:00
cajt	65244d291a	extmod/modlwip: Fix compile error for lwIP with SLIP support. ... Fixes a compile error if STM32 port is compiled with: make BOARD=(..) MICROPY_PY_LWIP=1 MICROPY_PY_LWIP_SLIP=1 `sio_send()` and `sio_tryread()` now use `mp_get_stream`. Signed-off-by: Carl Treudler <cjt@users.sf.net>	2024-09-06 17:11:47 +10:00
Damien George	bc952d37fe	extmod/network_ppp_lwip: Add network.PPP via lwIP. ... This commit adds a new `network.PPP` interface which works on any port that has bare-metal lwIP, eg rp2, stm32, mimxrt. It has been tested on stm32. A board needs to enable `MICROPY_PY_NETWORK_PPP_LWIP` and then it can use it as follows: import network ppp = network.PPP(uart) ppp.connect() while not ppp.isconnected(): pass # use `socket` module as usual, etc ppp.disconnect() Usually the application must first configure the cellular/etc UART link to get it connected and in to PPP mode first (eg ATD*99#), before handing over control to `network.PPP`. The PPP interface automatically configures the UART IRQ callback to call PPP.poll() on incoming data. Signed-off-by: Damien George <damien@micropython.org>	2024-08-29 23:46:13 +10:00
Damien George	664dd7b54a	extmod: Update make and cmake scripts to work with latest lwIP. ... Signed-off-by: Damien George <damien@micropython.org>	2024-08-29 23:46:13 +10:00
Jared Hancock	e901ff8557	extmod/network_wiznet5k: Add support for IPv6. ... This adds support for the WIZNET5K nic to use IPv6 with the LWIP stack. Additionally, if LWIP_IPV6 is disabled, the device is configured to drop all IPv6 packets to reduce load on the MCU. Signed-off-by: Jared Hancock <jared@greezybacon.me>	2024-08-26 13:02:44 +10:00
Angus Gratton	b82c9ca706	extmod/modtls_mbedtls: Optimise the DER certificate parsing fix. ... Small code size and binary size optimisation for the fix merged in 4d6d84983f. This work was funded through GitHub Sponsors. Signed-off-by: Angus Gratton <angus@redyak.com.au>	2024-08-26 12:48:12 +10:00
Angus Gratton	86f2c285eb	py: Add new cstack API for stack checking, with limit margin macro. ... Currently the stack limit margin is hard-coded in each port's call to `mp_stack_set_limit()`, but on threaded ports it's fiddlier and can lead to bugs (such as incorrect thread stack margin on esp32). This commit provides a new API to initialise the C Stack in one function call, with a config macro to set the margin. Where possible the new call is inlined to reduce code size in thread-free ports. Intended replacement for `MP_TASK_STACK_LIMIT_MARGIN` on esp32. The previous `stackctrl.h` API is still present and unmodified apart from a deprecation comment. However it's not available when the `MICROPY_PREVIEW_VERSION_2` macro is set. This work was funded through GitHub Sponsors. Signed-off-by: Angus Gratton <angus@redyak.com.au>	2024-08-14 12:55:45 +10:00
Peter Züger	4d6d84983f	extmod/modtls_mbedtls: Fix DER parsing and calculation of key/cert len. ... `mbedtls_pk_parse_key()` expects `key_len` to include the NULL terminator for PEM data but not for DER encoded data. This also applies to `mbedtls_x509_crt_parse()` and `cert_len`. Since all PEM data contains "-----BEGIN" this is used to check if the data is PEM (as per mbedtls code). This can be done for both v2 and v3 of mbedtls since the fundamental behaviour/expectation did not change. What changed is that in v3 the PKCS#8 DER parser now checks that the passed key buffer is fully utilized and no bytes are remaining (all other DER formats still do not check this). Signed-off-by: Peter Züger <zueger.peter@icloud.com>	2024-08-13 17:32:32 +10:00
iabdalkader	1743a7d721	extmod/modopenamp: Use mp_event_* functions for poll/wait. ... These are the new helper functions to use for polling/waiting. Signed-off-by: iabdalkader <i.abdalkader@gmail.com>	2024-08-08 18:02:21 +10:00