Merge: 7082b6e34a 88f83280dc

Merged riscv_new branch

+ created branch for keyboard/video/mouse unit unicode support development

+ added tests directory

+ add svn:needs-lock to kbd_us.ods, because it's a binary file (and therefore,
unmerge-able)

* access the Default8087CW global variable directly from within inline asm,
instead of copying it to a local var first, since the concern about PIC code
(this asm code started out as a copy of the i386 rtl code) doesn't exist on
the i8086, since there's no such thing as PIC code on the i8086

* optimize the i8086 backwards move by using movsw instead of movsb in the Move
and MoveData procedures

+ added asm optimized version of fpc_pwidechar_length for i8086

* place the "external" directives in the interface instead of in the
implementation, because we don't support "external" in the implementation
for C varargs functions for LLVM (can't generate a stub for them)
o having "external" in the implementation also causes useless overhead
with code generators that do support this

+ added the initial implementation of my C structure checker code generator
tool, named h2paschk. This is currently a separate tool, that requires a
manually crafted input file with a special syntax (example is included as a
comment in the source code), that contains descriptions of all the records
that need to be checked, but it is planned to add support to h2pas to generate
these files automatically, since this would be very useful.

+ added h2paschk structure checker files for the DirectDraw and DirectInput
header translations, used by PTCPas.

Avoid C 64-bit compiler warnings by using %lu instead of %u for sizeof and offsetof

* fixed floating point div-by-zero RTE code on Darwin (208 instead of 200,
fixes webtbs/tw32671)

* fixed Darwin/AArch64 flt/int-div-by-zero error codes (fix for 42045, as
noted by AlexeyT)

put #ifdef TARGETOS / #endif around the gcclib section, otherwise the various host paths can cause a hard to debug mess during crosscompiling in some cases

Add support for softfloat in RISCV RTL.

Avoid range check error when compiled -Criot option

Fix bug report 35937 by simple assembly code change and add test

* the final build of packages and rtl are compiled with the general tls model on i386 as they could be used in dyn. libraries.
This does not hurt much as the linker optimized the threadvar access if possible

* arm uses the same approach as i386: during the final build of the rtl and the packages, the general dynamic tls model is selected

Define FPC_IS_SYSTEM at start of all system.pp source

Add riscv32 mathu inculde file, redirecting to ../riscv64/mathu.inc file (this file seems to have no 64-bit specific code)

Try to correctly handle m68k exceptions bits inside SetExceptionMask function

Wipe out any pre-existing exception on SetExceptionMask call for m68k cpu

* ensure that the includes for the new mm related files are indeed enabled

* ensure that the new mm related procs are only used for 3.3.1 and newer as 3.2 and older don't support the corresponding SSE types

* disabled mm procs again, they are not usable yet neither supposed to be
used

Pass old value of OPT to FPCMAKEOPT

Add '.built.on.$(SOURCESUFFIX)' for snapshots generated on another target using singlezipinstall

* Makefile fixed

atari: added the fpwidestring unit to the RTL build

* use getpagesize function instead of reading external variables to restore
ability to compile against SDKs < OS X 10.9 (mantis 0036653)

* allow FPC 3.2.0 as bootstrap version

Try to fix problems for more recent GDB versions.
Move GDB_NEW_UI macro def. to GDB_VER_GE_712
Add GDB_INTERP_LOOKUP_HAS_UI and GDB_HAS_SAVED_COMMAND_LINE_BUT_NO_SIZE
to same GDB_VER_GE_712.
Use stdio_filopen to create gdb_stdout and gdb_stderr
if GDB_HAS_GET_STDIN macro is set.

* Fix compilation of gdbint unit for go32v2, should resolve bug report 36923.
Replace cint type by longint (as gdbint unit does not use ctypes unit).

* disable some x86_64 specific assembly routines

* disable CPU and Signals units for Windows on AArch64 for now

* use accessor functions to work with the TContext record

* the prefetch bug handling is specific to x86_64

* rename RunErrorCodex64 to a more appropriate RunErrorCodeSEH

* enable is_prefetch only for x86 code

* inside the Win64 system unit convert FPC_USE_WIN64_SEH to a SYSTEM_USE_WIN_SEH

+ implement RTL functionality for SEH for aarch64-win64

+ implement a main_wrapper for the default exception handler for aarch64-win64

+ add ability to generate a flat binary file instead of a tape file

* simplify code: simply raising an exception is enough, it's not necessary to call ShowException and Terminate

Fix conversion between TFPURoundMode and bits of get_fsr according to SPARC-V8 specifications

+ readd Randomize with parameter

* import library function with a name that does not conflict with the functions exported in the interface

* Optimized Handle_I8086_Error by using smaller int types.

Fix compilation for watcom RTL

Fix NDS RTL compilation for default armv4 CPU, which does not have CLZ instruction

Use // comments as curly brackets not recognized as comment start inside aarch64 assembly blocks

Adapt to change of chr function in commit 47353, to change chr() a real intrinsics

Add missing CPULLVM versions for fpc_abs_real and fpc_sqr_real in x86_64/math.inc

Use pascal code for LLVM fpc_sqr_real, because fmultp instruction is not accepted by llvm

+ RTMSupport function
+ if available use RTM to support InterlockedCompareExchange128 on i386

* i386: disable InterlockedCompareExchange128 implementation if PIC is enabled

* darwin/AArch64: always clear fpu exception flags regardless of the
triggered signal, as the kernel currently triggers SIGILL rather
than SIGFPE for FPU exceptions

* while not official supported, bootstrapping with 3.0.4 fixed

Fix spelling error of revision 48023

Introduce USE_REAL_INSTRUCTIONS to handle expressions not accepted by old assemblers

* do not execute xend twice which was introduced in 0048430

* fixed the parse-collations script/bat file

* fixed the file name in the cldrparser help screen

* updated readme with URLs of the Unicode 9.0 and CLDR 30 data files (to the best of my knowledge)

+ added tool for parsing GraphemeBreakProperty.txt and converting it to code

+ added unit GraphemeBreakProperty, containing the grapheme break property character data from Unicode 9.0

+ added modified LGPL license header to the new graphemebreakproperty.pp unit

+ added and implemented a TUnicodeStringExtendedGraphemeClustersEnumerator class
in the graphemebreakproperty unit - an enumerator that splits a UTF-16 string
into extended grapheme clusters (i.e. user-perceived characters), conforming
to the Unicode 9.0 algorithm:
https://www.unicode.org/reports/tr29/tr29-29.html

+ added an eawparser tool - tool for parsing the EastAsianWidth.txt unicode
property table and converting it to code

+ added unit EastAsianWidth, which contains the EastAsianWidth unicode data property

Fixed free_fun function signature in zlib

fix! 2d00cab5

+ RiscV32: setjmp/longjmp implementation, based on the RiscV64 one

* RiscV32: fpc_longjmp needs nostackframe directive
* RiscV: unified procedure directives of fpc_*jmp

* JVM compilation fixed

* support building with FPC 3.2.2

Add missing go32v2 zips and corresponding sources

Update EMX packages

Update OS/2 packages

Replace p2fp by p2fm as short version for pas2fpm utils package and add some missing -3.3.1 to long source zip names

Remove double source entry for utils lexyacc package

Use utils also for short version for OS/2 and emx

Fix short name for utils-fpcres for OS/2 and EMX

* thumb2: Make fillchar smaller, faster and more reliable. Some gas versions remove the "mov r0,r0" making the calculated branch break

* thumb2: Optimize fillchar a bit more with a wider inner loop chunk size

+ Aarch64: use LSE if available for atomic intrinsics

+ lazarus project

* Darwin/BSD: fixed StackBottom calculation

atari: implemented stacktop for working stacktraces, implemented stacksize dependent stackmargin, and a system specific backtracestr. however, offs display still doesn't work properly, due to a linker issue (reported)

* fix bootstrapping on aarch64-linux with 3.2.x

* LLVM does not have an intrinsic for int/frac, so don't replace frac with
a call to runerror(207) there

* fpcr and fpsr are 64 bit on aarch64

* RiscV: unified cpu initialization and FPU exception handling, resolves 0038893

* Windows: Prevent removal of the TLS directory by the linker when RTL is compiled with -O4 or when inlining is enabled.

Exchange REQUIREDVERSION and REQUIREDVERSION2 values to get 3.2.2 version in reuired release version message

* win64: factored out cpu specific code

+ CPU.BMI1Support and CPU.BMI2Support

+ AVX512*Support functions
* call cpuid with eax=7 only if it is supported by the CPU

* x86-64: removed some fwait instructions from fpc_frac_real, they shouldn't be necessary

* x86-64: fpc_frac_real further improved: memory loads of extendeds are expensive

- x86_64: some more fwaits removed

* Gitlab client + example

* Some additional filters

* only .pp is needed

* extended routines int/frac/trunc shouldn't mess with precision or exception flags, should fix gitlab 0039275

* moved fwait

* moved fwait

* Add error check

+ CPU units: check for SHA support

* x86-64: do not jump in inc/declocked to return but return directly

* when compiling with the main branch compiler, p2align with 3 parameters can be used now

* the libc unit might be deprecated, but it's no reason for wrong declarations, in this case values that should be declared as octal but were declared as decimal with the same literal text

Fix compilation of nds and wii OS rtl

* fixed the ptccrt key codes for the ctrl+numpad keys

* Add missing definitions

* Add crypto.h functions

+ initial files for intrinsics support on AArch64

Also add short format version of build unit BUnit.pp to ignore list

* updated ptcpas and ptcgraph to the latest 0.99.16 release candidate

* ptcpas update: support the F13..F35 function keys on platforms that recognize them

* ptcpas keyboard handling improvements for macOS and X11

* libffi: fix abi declarations for x86_64

+ LZCNTSupport
+ test extended

* out and var are reserved words

* Prepend T when writing pointer types and PrependTypes is set

+ x86: ADXSupport
+ x86: RDSEEDSupport

* Remove debugging statements

* Add aliases

* Add options to request

Java: adapt FPC_ANSISTR_UNIQUE signature

Conform to change made in 800bb3adc23

Fix compilation of jvm-java and jvm-android rtl

+ routines to test for AVX512VNNI and AVX512BITALG support

* rtl/atari: get rid of the old prt0.as startup code, which is not in use any more. this way, we do not require GAS any more for a build

atari: implement ARGV protocol for runtime startup

rtl/atari: check for application/acc at startup

* rtl/atari: use the haltproc declared in the startup code instead of calling pterm in the system unit directly.

* rtl/atari: fix haltproc external name. apparently the atari target uses a different Cprefix in the compiler, so copy-pasting this stuff from the Amiga port don't work 1:1

rtl/atari: implement environment functions also in dos unit

* rtl/atari: add the standalone softfpu units to the Atari build. this fixes the Atari native compiler build after recent changes

atari/sysos: use the symbolic names for error numbers

rtl/atari: fix readln from console

+ skeletons for mips64el specific files

+ store also ecx and edx after cpuid call with eax=7
+ test VNNI and BIGALG instructions

* m68k: implement basic support for interlocked functions using a TAS based global spinlock on CPUs which don't have the CAS instruction

+ skeleton

* m68k: some CPUs don't have TAS either (for example some CF)

rtl/atari: move common code of getenv

rtl/atari: try to convert argv[0] to absolute pathname

atari: support ARGV protocol in ExecuteProcess

* fix declocked(longint) for aarch64 without LSE, resolves gitlab 0039569

* m68k: fix an instruction which doesn't exist on ColdFire

- removed superfluous comment

Add missing rtl/mips64 files and fix some rtl/mips64el files

* Extra options for more flexibility

* nds: the embedded stub DOS unit was just a copy of the NDS one with minor fixes, so lets make the NDS port use the current cleaned one as well

+ AVX512VBMISupport and AVX512VBMI2Support

* i386: make use of *fence instructions

* adapted to 64 bit

Make pas2jni use cthreads on Unices

+ introduced PTCKEY_LESS (the 102th key on international keyboards, <> when
used with US keyboard layout)

* use v*csr instructions if they are available

* CGI demo for css minimizer/classname extractor

* check more cpuid flags in the cpu units

* Changed -1 to $FFFFFFFF on DWord writes to suppress range check errors

* Add examples for syshelpers from Zeljko Avramovic. Fix issue gitlab 0039541

* Libnettle & dynamically loadable version of libgmp

* Add libnettle into build

* Add license message

* Fix library name

+ some more cpu specfic files for mips64(el)

* cleanup

Fix compilation ofrtl/nds/classes.pp unit

Remove accidently added binaries in commit 0e142c00

* x86-64: math helpers do not need a stackframe

* proper naming

FIX: DARWIN: aarch64: tstatfs.fstypename length error (gitlab 0039873)

powerpc64le: fix reading FPU control word after gitlab 000758aa1143

Also, missing rest of the commit message for that change:

The default implementation of SysResetFPU now sets the FPU control word that
was last set from any thread (Delphi and FPC i386/x86-64-compatible). No longer
call SysInitFPU when starting a new thread, only SysResetFPU. Combined, this
means that new FPC-started threads will always start out with that control
word on all architectures.

Added generic fpc_cpuinit implementation that is used unless
FPC_SYSTEM_HAS_FPC_CPUINIT has been defined.

Ensure that the softfloat exception mask is initially set to the same
value as the hardware fpu exception mask on architectures that use both.

SafeLoadLibrary now saves/restores the FPU control word on all platforms.

Removed outdated fpc_mtfsb0_corrected define check in powerpc64.inc

Resolves gitlab 0038230

Thumb(2): fix compilation after FPU control word changes

Resolves gitlab 0039966

Darwin/AArch64: detect when SIGILL indicates an FPU exception

Parse the ESR (ESR_ELx, Exception Syndrome Register (ELx)), return run error
as in float_raise

Darwin/AArch64: future-proof version check

* Add gstreamer library import unit (gst)

* Remove wrong unit

add ppsuf so that we can compiler loongarch fpc now

+ CMOVSupport function

* new cpu feature tests

Add TBits.Find / FindRev / Find0 / Find0Rev / Find1 / Find1Rev that store no state inside TBits.

Add TBits.MoveRange, and change TBitsBase to unsigned type.

Add TBits.Get/SetUint.

Fix ScanFor1 truncating result to TBitsBase.

Enhance GitLab CI and use official docker images

Add TBits.NotRange, And/Or/Xor/AndNot/OpRange, Clear/SetRange.

Add TBits.PopCount and IntersectionPopCount / HasIntersection.

Add TBits.DumpBinary / LoadBinary.

Add TBits.DumpText / LoadText.

Add TBitsBase = byte support, and use universal formula for TBITS_SHIFT.

Useful for debugging, as byte versions of certain intrinsics have different return types.
Assumes ln() is intrinsic everywhere, unlike Bsr*.

Keep tarball artifacts for a longer time

Limit amount of used cpu cores to six

Use platform and architecture independent approach to get ppc executable

Fix YAML usage to make CI linter happy

see https://yaml.org/type/merge.html

Add PIC code for solaris/i386/start.inc

- remove apparently accidently added files

* Char -> AnsiChar

* Char -> AnsiChar

* Char -> AnsiChar

* Char -> AnsiChar

* Char -> AnsiChar

* Char -> AnsiChar

* Char -> AnsiChar

* Char -> AnsiChar

* Char -> AnsiChar

* Char -> AnsiChar

* Char -> AnsiChar

* Char -> AnsiChar

* Char -> AnsiChar

* Char -> AnsiChar

* Char -> AnsiChar

* Char -> AnsiChar

* Char -> AnsiChar

* Char -> AnsiChar

* Char -> AnsiChar

* Char -> AnsiChar

* Char -> AnsiChar

* Char -> AnsiChar

* Char -> AnsiChar

* Char -> AnsiChar

* Char -> AnsiChar

* Char -> AnsiChar

* Char -> AnsiChar

* Char -> AnsiChar

* Char -> AnsiChar

* Char -> AnsiChar

* Char -> AnsiChar

* mess cleaned up

* string -> shortstring

* string -> shortstring

* string -> shortstring

* string -> shortstring

* string -> shortstring

* string -> shortstring

* string -> shortstring

* string -> shortstring

* string -> shortstring

* string -> shortstring

* string -> shortstring

* string -> shortstring

* string -> shortstring

* String -> ansistring

* string -> shortstring

* string -> shortstring

* string -> shortstring

* string -> shortstring

* string -> shortstring

* string -> shortstring

* string -> shortstring

* string -> shortstring

* string -> shortstring

* string -> shortstring

* string -> shortstring

* Fix compilation with unicodertl

* PChar -> PAnsiChar

* PChar -> PAnsiChar

* PChar -> PAnsiChar

* PChar -> PAnsiChar

* PChar -> PAnsiChar

* PChar -> PAnsiChar

* PChar -> PAnsiChar

* PChar -> PAnsiChar

* PChar -> PAnsiChar

* PChar -> PAnsiChar

* PChar -> PAnsiChar

* PChar -> PAnsiChar

* PChar -> PAnsiChar

* PChar -> PAnsichar

* PChar -> PAnsichar

* PChar -> PAnsichar

* PChar -> PAnsichar

* PChar -> PAnsichar

* PChar -> PAnsichar

* PChar -> PAnsichar

* PChar -> PAnsichar

* PChar -> PAnsichar

* PChar -> PAnsichar

* PChar -> PAnsichar

* PChar -> PAnsichar

* PChar -> PAnsichar

* PChar -> PAnsichar

* PChar -> PAnsichar

* PChar -> PAnsichar

* PChar -> PAnsichar

* PChar -> PAnsichar

* PChar -> PAnsichar

* PChar -> PAnsichar

* PChar -> PAnsichar

* PChar -> PAnsichar

* PChar -> PAnsichar