481 Commits

Author	SHA1	Message	Date
Alex Tran	d1caa9df07	unix/modsocket: Add IP ADD and DROP MEMBERSHIP to socket constants. ... Add the IP_ADD_MEMBERSHIP and IP_DROP_MEMBERSHIP to modsocket in the Unix port so that the directives take on the values defined in the system headers. This is needed because the values of these directives are different for MacOS vs other Unix systems. Fixes issue #8456. Signed-off-by: Alex Tran <alex.t.tran@gmail.com>	2025-11-26 12:35:36 +11:00
Andrew Leech	5f815b8a2d	unix: Enable exit code handling for sys.exit(). ... Enable `MICROPY_PYEXEC_ENABLE_EXIT_CODE_HANDLING` to propagate `sys.exit()` exit codes properly. Update `convert_pyexec_result()` to handle return values where pyexec returns the exit code with `PYEXEC_FORCED_EXIT` flag set for `SystemExit`. Extract the exit code from the lower 8 bits when the flag is set, otherwise return as-is (0 for success, 1 for exception). Signed-off-by: Andrew Leech <andrew.leech@planetinnovation.com.au>	2025-11-22 00:06:59 +11:00
Damien George	fd1ddc3f12	shared/runtime/pyexec: Call mp_hal_stdio_mode_orig/raw as appropriate. ... This ensures that ctrl-C works on the unix port when executing code at the REPL. Signed-off-by: Damien George <damien@micropython.org>	2025-11-22 00:06:59 +11:00
Andrew Leech	e06ac9ce08	unix/main: Replace execute_from_lexer with pyexec in do_file and do_str. ... Consolidates file and string execution to use the standard pyexec interface for consistency with other ports. Simplify execute_from_lexer for remaining usage: Remove unused LEX_SRC_VSTR and LEX_SRC_FILENAME cases, keeping only LEX_SRC_STR for REPL and LEX_SRC_STDIN for stdin execution. Signed-off-by: Andrew Leech <andrew.leech@planetinnovation.com.au>	2025-11-22 00:06:59 +11:00
Andrew Leech	7ac8fcf752	unix: Enable compile-only mode with shared pyexec REPL. ... Provides support for command line `-X compile-only` option on unix port. Signed-off-by: Andrew Leech <andrew.leech@planetinnovation.com.au>	2025-11-22 00:06:59 +11:00
Andrew Leech	5b3c928f53	unix/main: Use standard pyexec REPL for unix and windows ports. ... This improves REPL usage consistency across ports, by utilizing the pyexec code for the unix REPL. Only enabled when MICROPY_USE_READLINE == 1 (the default). Signed-off-by: Andrew Leech <andrew.leech@planetinnovation.com.au>	2025-11-22 00:00:07 +11:00
Yanfeng Liu	4f2f520dc2	unix/modtime: Add type casting for mktime return value. ... This adds type casting to avoid build errors on certain systems. Signed-off-by: Yanfeng Liu <yfliu2008@qq.com>	2025-11-04 16:22:29 +11:00
Jeff Epler	007f127a61	all: Simplify mp_int_t/mp_uint_t definition. ... Assuming proper C99 language support, we can select "the int type as big as a pointer" (most of the time) or "the 64-bit int type" (nanboxing with REPR_D), and then define everything else automatically. This simplifies port configuration files. And the types can still be overridden if needed. Signed-off-by: Jeff Epler <jepler@unpythonic.net>	2025-10-23 15:12:28 +11:00
Yanfeng Liu	8204f9e8c3	unix/Makefile: Allow out-of-tree tests. ... This allows out-of-tree tests like: $ make -C ports/unix/ BUILD=/tmp MICROPY_MPYCROSS=~/bin/mpy-cross test Signed-off-by: Yanfeng Liu <yfliu2008@qq.com>	2025-10-06 11:03:25 +11:00
Jeff Epler	ab00806025	py/mpconfig: Introduce SIZE_FMT macro. ... Signed-off-by: Jeff Epler <jepler@unpythonic.net>	2025-10-03 00:45:31 +10:00
Damien George	688016c6a2	unix/variants/minimal: Enable C stack checking. ... This unix minimal variant already has a few other things enabled beyond the default minimal configuration, and C-stack checking is arguably more important than those, so enable it. This helps to get some of the stress tests passing on this variant. Signed-off-by: Damien George <damien@micropython.org>	2025-10-02 00:37:29 +10:00
Damien George	e031ead6b2	unix/Makefile: Run all possible tests when using --via-mpy. ... Currently testing on the unix port with `--via-mpy` only runs tests in the `basics`, `float` and `micropython` test directories. This commit removes that restriction and now runs `--via-mpy` tests using all possible test directories. This improves test coverage. Signed-off-by: Damien George <damien@micropython.org>	2025-10-01 11:14:46 +10:00
Damien George	b44c4de4fd	tests/ports/unix: Add coverage test for readinto1 stream method. ... And expand the test for `readinto()` to test the difference between trying to read the requested amount by doing multiple underlying IO calls, and only doing one call. Signed-off-by: Damien George <damien@micropython.org>	2025-09-26 00:24:08 +10:00
Mike Wang	8c389db6ea	unix/main: Ensure atexit function is called with -m <module>. ... Previously, when running `micropython -m <module>` and the module called sys.exit(), the registered atexit function was not executed. This was due to sys.exit() raising a SystemExit exception, which bypassed the atexit handler. This change fixes the issue so that the atexit function is properly invoked when exiting via sys.exit(). Additionally, following the pattern in execute_from_lexer(), mp_hal_set_interrupt_char() and mp_handle_pending() handling were added to ensure that the atexit function is also executed when the user exits via Ctrl-C. Signed-off-by: Mike Wang <mikewang000000@gmail.com>	2025-09-23 14:13:37 +10:00
Mike Wang	cf097932a2	unix/modsocket: Set file descriptor to -1 on close. ... After s.close(), s.fileno() now returns -1, matching CPython behavior. Some code relies on this compatibility, as it allows checking whether a socket is closed by testing its fileno() value. This change ensures better interoperability with existing Python code and libraries. Signed-off-by: Mike Wang <mikewang000000@gmail.com>	2025-09-23 14:06:37 +10:00
Jeff Epler	a69425b533	unix/Makefile: Add additional testing targets. ... These are convenience targets for running specific tests as a developer. They are more useful that invoking run-tests directly as they take account of the VARIANT= specified on the make command-line. For instance, you can run all tests matching the regular expression "int" with `make VARIANT=... test//int`. The new targets are all documented in README.md. Signed-off-by: Jeff Epler <jepler@gmail.com>	2025-09-16 12:31:14 +10:00
Jeff Epler	e9da4c9c98	unix/modsocket: Use type-checking mp_obj_get_int. ... MP_OBJ_SMALL_INT_VALUE would give erroneous results, such as assertion failures in the coverage build and other oddities like: >>> s = socket.socket() >>> s.recv(3.14) MemoryError: memory allocation failed, allocating 4235896656 bytes Signed-off-by: Jeff Epler <jepler@gmail.com>	2025-09-16 12:04:19 +10:00
Anson Mansfield	1d90577b7e	py/gc: Clean up usage of GC_ALLOC_FLAG_HAS_FINALISER flag. ... The calls signature for gc_malloc was changed in 5ed578e5b4, without cleaning up existing code on the rationale that the previous bool is automatically converted to an int with the same meaning. This commit goes back and cleans up existing invocations to make their behavior more readable in a modern context. Signed-off-by: Anson Mansfield <amansfield@mantaro.com>	2025-09-10 17:24:56 +10:00
Jeff Epler	6ad91f25fb	unix: Unlock heap before readline. ... This is intended to be equivalent to the unlock in shared/runtime/pyexec.c. Signed-off-by: Jeff Epler <jepler@gmail.com>	2025-09-01 21:29:05 -05:00
Jeff Epler	30c1b6e3d1	unix: Don't crash if heap locked in prompt_write_history. ... Signed-off-by: Jeff Epler <jepler@gmail.com>	2025-09-01 21:29:05 -05:00
Damien George	a3f9dec788	py/mpconfig: Enable the sys module at all feature levels by default. ... This is a pretty fundamental module, and even minimal ports like unix and zephyr minimal have it enabled. So, enabled it by default at the lowest feature level. Most things in the `sys` module are configurable, and off by default, so it shouldn't add too much to ports that don't already have it enabled (which is just the minimal port). Also note that `sys` is still disabled on the bare-arm port, to keep that ultra minimal. It means we now have bare-arm without `sys` and the minimal port with `sys`. That will allow different code size comparisons if/when new `sys` features are added. Signed-off-by: Damien George <damien@micropython.org>	2025-08-22 13:31:10 +10:00
Damien George	b5fcb33eaa	py/mpconfig: Enable CRYPTOLIB, HASHLIB_MD5, HASHLIB_SHA1 if SSL enabled. ... This commit unifies the configuration of MICROPY_PY_CRYPTOLIB, MICROPY_PY_HASHLIB_MD5 and MICROPY_PY_HASHLIB_SHA1, so they are enabled by default if MICROPY_PY_SSL is enabled. This matches the existing configuration of most of the ports. With this change, all ports remain the same except: - reneses-ra now enables MICROPY_PY_CRYPTOLIB, MICROPY_PY_HASHLIB_MD5 and MICROPY_PY_HASHLIB_SHA1. - rp2 now enables MICROPY_PY_HASHLIB_MD5. Signed-off-by: Damien George <damien@micropython.org>	2025-08-19 21:10:00 +10:00
Damien George	169d382248	py/mpconfig: Rename MICROPY_PY___FILE__ to MICROPY_MODULE___FILE__. ... For consistency with other module-related configuration options. Signed-off-by: Damien George <damien@micropython.org>	2025-08-19 13:00:45 +10:00
Angus Gratton	d8672f4cde	unix: Increase stack sizes if running with sanitizers. ... The specific problem seems to be that the runtime "Python stack frame" function call is several times more expensive in stack usage when running with UBSan on older GCC (observed on gcc 11.4 as used in CI, would get 'RuntimeError: maximum recursion depth exceeded' when running some tests with UBSan enabled.) Other stack usage (i.e. from pushing things on the stack in Python) stays the same. Whatever causes the usage seems to be mostly gone in later GCC versions. Includes a refactor to apply the same stack size multipliers for the default thread stack size same as the main stack size. This goes in a new port-specific header as it depends on macros in misc.h, so can't be in mpconfigport.h. A side effect of this is that the default thread stack size is now doubled on ARM, same as the main stack size. This work was funded through GitHub Sponsors. Signed-off-by: Angus Gratton <angus@redyak.com.au>	2025-08-19 10:33:40 +10:00
Damien George	40cc4e4f74	py/objtype: Make mp_obj_new_type a static function. ... It's only used once, in the same file it's defined, and making it static reduces code size. Along with this, the associated example code comment in `ports/unix/main.c` has been removed. Signed-off-by: Damien George <damien@micropython.org>	2025-08-15 11:45:11 +10:00
Yoctopuce dev	dbbaa959c8	py/formatfloat: Improve accuracy of float formatting code. ... Following discussions in PR #16666, this commit updates the float formatting code to improve the `repr` reversibility, i.e. the percentage of valid floating point numbers that do parse back to the same number when formatted by `repr` (in CPython it's 100%). This new code offers a choice of 3 float conversion methods, depending on the desired tradeoff between code size and conversion precision: - BASIC method is the smallest code footprint - APPROX method uses an iterative method to approximate the exact representation, which is a bit slower but but does not have a big impact on code size. It provides `repr` reversibility on >99.8% of the cases in double precision, and on >98.5% in single precision (except with REPR_C, where reversibility is 100% as the last two bits are not taken into account). - EXACT method uses higher-precision floats during conversion, which provides perfect results but has a higher impact on code size. It is faster than APPROX method, and faster than the CPython equivalent implementation. It is however not available on all compilers when using FLOAT_IMPL_DOUBLE. Here is the table comparing the impact of the three conversion methods on code footprint on PYBV10 (using single-precision floats) and reversibility rate for both single-precision and double-precision floats. The table includes current situation as a baseline for the comparison: PYBV10 REPR_C FLOAT DOUBLE current = 364688 12.9% 27.6% 37.9% basic = 364812 85.6% 60.5% 85.7% approx = 365080 100.0% 98.5% 99.8% exact = 366408 100.0% 100.0% 100.0% Signed-off-by: Yoctopuce dev <dev@yoctopuce.com>	2025-08-01 00:47:33 +10:00
Jeff Epler	338ca3b68f	unix/coverage: Remove unused printf arguments. ... Signed-off-by: Jeff Epler <jepler@gmail.com>	2025-07-25 10:59:17 +10:00
Jeff Epler	aa9152ae0c	unix/coverage: Provide argmuents of expected integer types. ... Signed-off-by: Jeff Epler <jepler@gmail.com>	2025-07-25 10:59:04 +10:00
Jeff Epler	db7e935917	unix/coverage: Cast values to int for format printing. ... During the coverage test, all the values encountered are within the range of `%d`. These locations were found using an experimental gcc plugin for `mp_printf` error checking. Signed-off-by: Jeff Epler <jepler@gmail.com>	2025-07-25 10:58:24 +10:00
Jeff Epler	61006d8016	unix/coverage: Cast values to fit %x formatting code. ... This fixes the following diagnostic produced by the plugin: error: argument 3: Format ‘%x’ requires a ‘int’ or ‘unsigned int’ (32 bits), not ‘long unsigned int’ [size 64] [-Werror=format=] Signed-off-by: Jeff Epler <jepler@gmail.com>	2025-07-25 10:57:59 +10:00
Jeff Epler	a06857a11a	unix/coverage: Cast type names to qstr explicitly. ... Signed-off-by: Jeff Epler <jepler@gmail.com>	2025-07-25 10:57:54 +10:00
Jeff Epler	a1a8eacdce	unix/coverage: Avoid type checking an invalid string. ... We still want this not to crash a runtime but the new static checker wouldn't like it. Signed-off-by: Jeff Epler <jepler@gmail.com>	2025-07-25 10:57:39 +10:00
Jeff Epler	7493275918	py/mpconfig,ports: Define new HEX_FMT formatting macro. ... Signed-off-by: Jeff Epler <jepler@gmail.com>	2025-07-25 10:55:28 +10:00
Andrew Leech	bc77b27bad	unix/mpthreadport: Ensure consistent type of PTHREAD_STACK_MIN. ... It seems GCC 14 got stricter with warn/errs like -Wsign-compare and types a "bare number" as a long int that can't be compared to a (unsigned) size_t. Signed-off-by: Andrew Leech <andrew.leech@planetinnovation.com.au>	2025-07-24 13:29:36 +10:00
Damien George	6a4306a0df	unix/mpconfigport: Include time.h to get definition of time_t. ... Without this there's a build error on macOS (at least). This was likely due to a combination of 9b7d85227e and df05caea6c. Signed-off-by: Damien George <damien@micropython.org>	2025-07-24 11:42:53 +10:00
Yoctopuce dev	8b3439e26c	unix/variants/longlong: Use REPR_C on this variant. ... There is currently no build using REPR_C in the unix CI tests. As discussed in PR #16953, this is something that combines well with the longlong build. Signed-off-by: Yoctopuce dev <dev@yoctopuce.com>	2025-07-24 11:07:30 +10:00
Damien George	b6460df721	unix: Allow the GIL to be enabled. ... The unix port can now be built with the GIL enabled, by passing MICROPY_PY_THREAD_GIL=1 on the make command line. Signed-off-by: Damien George <damien@micropython.org>	2025-07-23 11:35:38 +10:00
Damien George	167c888df9	tests/run-tests.py: Detect threading and automatically run thread tests. ... When detecting the target platform, also check if it has threading and whether the GIL is enabled or not (using the new attribute `sys.implementation._thread`). If threading is available, add the thread tests to the set of tests to run (unless the set of tests is explicitly given). With this change, the unix port no longer needs to explicitly run the set of thread tests, so that line has been removed from the Makefile. This change will make sure thread tests are run with other testing combinations. In particular, thread tests are now run: - on the unix port with the native emitter - on macOS builds - on unix qemu, the architectures MIPS, ARM and RISCV-64 Signed-off-by: Damien George <damien@micropython.org>	2025-07-23 11:06:09 +10:00
Angus Gratton	a54b5d9aed	unix/variants: Add a 'longlong' variant to test 64-bit bigints in CI. ... Signed-off-by: Angus Gratton <angus@redyak.com.au>	2025-07-18 00:11:08 +10:00
Jeff Epler	628d53d23c	unix/coverage: Expand mp_printf coverage tests. ... Test 'l' and 'll' sized objects. When the platform's `mp_int_t` is not 64 bits, dummy values are printed instead so the test result can match across all platforms. Ensure hex test values have a letter so 'x' vs 'X' is tested. And test 'p' and 'P' pointer printing. Signed-off-by: Jeff Epler <jepler@gmail.com>	2025-07-16 11:13:08 +10:00
Yanfeng Liu	aa2362d4de	unix/Makefile: Drop include path of "i686-linux-gnu". ... This drops use of non-existing path `/usr/include/i686-linux-gnu` as default include paths shall suffice. Signed-off-by: Yanfeng Liu <yfliu2008@qq.com>	2025-07-15 14:03:06 +10:00
Yoctopuce dev	df05caea6c	shared/timeutils: Standardize supported date range on all platforms. ... This is code makes sure that time functions work properly on a reasonable date range, on all platforms, regardless of the epoch. The suggested minimum range is 1970 to 2099. In order to reduce code footprint, code to support far away dates is only enabled specified by the port. New types are defined to identify timestamps. The implementation with the smallest code footprint is when support timerange is limited to 1970-2099 and Epoch is 1970. This makes it possible to use 32 bit unsigned integers for all timestamps. On ARM4F, adding support for dates up to year 3000 adds 460 bytes of code. Supporting dates back to 1600 adds another 44 bytes of code. Signed-off-by: Yoctopuce dev <dev@yoctopuce.com>	2025-07-09 11:54:21 +10:00
Yoctopuce dev	c4a88f2ce7	py/obj: Add functions to retrieve large integers from mp_obj_t. ... This commit provides helpers to retrieve integer values from mp_obj_t when the content does not fit in a 32 bits integer, without risking an implicit wrap due to an int overflow. Signed-off-by: Yoctopuce dev <dev@yoctopuce.com>	2025-07-09 11:54:21 +10:00
Jeff Epler	da3709a738	unix/coverage: Add missing MP_OBJ_FROM_PTR casts. ... An attempt to build the coverage module into the nanbox binary failed, but pointed out that these sites needed explicit conversion from pointer to object. Signed-off-by: Jeff Epler <jepler@gmail.com>	2025-07-08 21:50:27 +10:00
Jeff Epler	f33f1aa9d3	unix/coverage: Initialize more code_state fields. ... When `MICROPY_PY_SYS_SETTRACE` was enabled, a crash was seen in the qemu_mips build. It seems likely that this was due to these added fields not being initialized. Signed-off-by: Jeff Epler <jepler@gmail.com>	2025-07-06 00:06:14 +10:00
Jeff Epler	fcfed6a0ea	unix/variants/coverage: Enable sys.settrace. ... The unix coverage variant should have all features enabled, so they can be tested for coverage. Therefore, enabled `MICROPY_PY_SYS_SETTRACE`. Signed-off-by: Jeff Epler <jepler@gmail.com>	2025-07-06 00:04:18 +10:00
Jeff Epler	1eb27e11f3	unix/README: Add some small documentation about sanitizers. ... Signed-off-by: Jeff Epler <jepler@gmail.com>	2025-07-01 15:19:07 +10:00
Jeff Epler	fc6205c4f0	unix/coverage: Add coverage test for left adjusted print. ... Signed-off-by: Jeff Epler <jepler@gmail.com>	2025-06-16 13:59:57 +10:00
Jeff Epler	0ef5ede382	py/mpz: Avoid undefined behavior decrementing NULL. ... In the case where an mpz number is zero, its `len` is 0 and its `dig` is NULL. In that case, decrementing NULL via `d--` is undefined behavior according to the C specification. Restructuring the loops in this way avoids undefined behavior. Also, ensure that these cases are tested in the coverage test. This doesn't make much difference now, but would otherwise cause errors later when the undefined behavior sanitizer is employed in CI. Signed-off-by: Jeff Epler <jepler@gmail.com>	2025-06-16 12:11:07 +10:00
Alessandro Gatti	0da22b2c30	tools/ci.sh: Fix nanbox CI test runs. ... This commit fixes CI test runs for the `nanbox` target, which were broken by the unconditional native emitter code output changes in the test runner. The `nanbox` configuration does not enable native emitters of any kind, and with a full test run that includes executing emitted native code things would break when doing CI runs. This is worked around by introducing a common subset of tests that do not involve the native emitter, and a more comprehensive set of tests that include both non-emitter and emitter tests. The `nanbox` CI test run will stop at the first subset, whilst other configurations will run that and execute further tests. Function names have been kept the same for steps that involve native code, with the `nanbox` subset having another one. This should not trigger any breakage in existing CI configurations or external scripts. Signed-off-by: Alessandro Gatti <a.gatti@frob.it>	2025-06-10 11:29:02 +10:00