+ introduced the TEnhancedKeyEvent record

+ added GetEnhancedKeyEvent and PollEnhancedKeyEvent to TKeyboardDriver

+ added functions GetEnhancedKeyEvent and PollEnhancedKeyEvent and implemented
default fallbacks, which revert to calling GetKeyEvent and PollKeyEvent for
drivers that don't support the enhanced functions

+ also invoke TranslateKey to get more data (either Ascii or virtual key translation)
when converting a TKeyEvent to TExtendedKeyEvent
+ also fill UnicodeChar from AsciiChar if AsciiChar is in the standard Ascii range
(#0..#127)

* switch to using ReadConsoleInputW instead of ReadConsoleInputA in the windows
keyboard unit. This way the console input is read using Unicode and is later
translated to the OEM character set via WideCharToMultiByte. This is will
allow returning Unicode character codes once enhanced key events are
implemented.

- removed redundant setting of result in TranslateKey

+ initial implementation of a windows key event to TEnhancedKeyEvent conversion function

+ added the NilEnhancedKeyEvent const (equivalent to the value 0 of TKeyEvent)

* use x:=NilEnhancedKeyEvent instead of FillChar for setting an enhanced key
event variable to 0

+ overloaded the = operator for pairs of TEnhancedKeyEvent

+ implemented SysGetEnhancedKeyEvent and SysPollEnhancedKeyEvent for win32/win64

* use :=NilEnhancedKeyEvent instead of FillChar to clear the result of ConvertToEnhancedKeyEvent

+ implemented generic conversion from enhanced to legacy key events as well

* handle nil key events properly in ConvertToLegacyKeyEvent

+ switch the win32/win64 keyboard unit to use enhanced key events (they are
converted to legacy key events by the generic converter in keyboard.inc)

+ introduced TEnhancedShiftState. Not used yet, but will eventually be used inside TEnhancedKeyEvent.

+ added generic Shift, Ctrl and Alt values to TEnhancedShiftState

* TEnhancedKeyEvent.ShiftState changed to TEnhancedShiftState

+ detect and return the state of num lock, caps lock and scroll lock in the enhanced shift state on win32/win64

+ introduce TFPKeyEventRecord - a wrapper record around TKeyEventRecord, so it
can store additional data (not added yet) to our keyboard events; this way we
can later add extended shift state (e.g. distinguishing between left and right
shift), etc.

+ add enhanced shift state to the TFPKeyEventRecord object and call
transEnhShiftState only in HandleKeyboard, when the new key event is added to
the queue. This way we can use GetKeyState to determine the parts of the shift
state that are not in dwControlKeyState.
* transEnhShiftState moved to be a local function inside HandleKeyboard to
ensure it's not called outside this procedure.

+ introduced TEnhancedShiftStateElement - an enum type, containing the elements of TEnhancedShiftState set

+ distinguish between left and right shift and detect num/caps/lock key down using GetKeyState

- get rid of the ss:TEnhancedShiftState local variable in TranslateEnhancedKeyEvent

+ introduced unit UnixKvmBase, which is going to contain miscellaneous routines,
commonly used by the unix keyboard, video and mouse units. Currently, it only
contains the UTF8Enabled function, which was moved away from the video unit
and which will also be used by the keyboard unit in the future, as soon as
that unit also gets UTF-8 input support.

+ added a global variable Utf8KeyboardInputEnabled in the implementation of the
unix keyboard unit. Initialize it in SysInitKeyboard with the value, returned
by UnixKvmBase.UTF8Enabled (the same function that checks whether UTF-8 output
should be enabled in the video unit).

+ return enhanced key events in the unix keyboard driver; unicode not supported yet

+ handled the 'center' (numpad 5) key properly in linux, xterm and gnome

* gnome3 (clarifies gnome version tested)

* fixed Shift-F1..F8 on the Linux console

+ added shift state to the escape sequence structure

+ add shift state to TTreeElement and DoAddSequence

* modified ReadKey to return TEnhancedKeyEvent (partially constructed - contains only asciichar and virtualscancode)

* moved ReadKey after GetEnhShiftState, so it can be used to return the shift state

* return the shiftstate in ReadKey

* the variables only used by ReadKey made local, and not visible in its nested routines

* simplify an 'if A' followed by an 'if not A' sequence to 'if A then...else...'

* fixed off-by-one error when putting a character back into the input buffer

+ introduced PutBackIntoInBuf - procedure that returns a key back into InBuf

- removed the IsAlt parameter from ReadKey, because it is not used

- removed the IsAlt local variable, because it is not used

- removed some no longer used commented out code

- removed FAltKey, because it is not used

* set char to 27 for the Esc key (for the linux patched console) in the sequence table

* handle sequences that return both char and scan code

* the type of key_sequence.char changed from byte to 0..127 to enforce ASCII only use

- removed check for the kbEsc scan code, since this is now made redundant,
thanks to the fact that the sequence can return both non-zero AsciiChar
and ScanCode at the same time.

- removed commented out code

- removed commented out code

* simplified the initialization of MyScan, since ReadKey now returns a record, that contains both AsciiChar and ScanCode

* initialize SState from the shift state, returned by ReadKey

* moved the 'if not again' part after the repeat..until loop; it behaves the same, but improves code readability

+ added UTF-8 keyboard input support

* reject surrogate characters when decoding UTF-8 keyboard input

* preserve the unicode keycode returned from ReadKey in the result of SysGetEnhancedKeyEvent

+ add ConvertEnhancedToLegacyShiftState to the interface of unit keyboard

* fixed the linux keyboard patching table for handling F11 and F12 properly

+ also patch Ctrl+F1..Ctrl+F12 when running as root on the linux console, so they can also be read properly

* fix typo in comment

* fix typo in comment

+ added essAltGr to TEnhancedShiftState and added proper AltGr handling for the Linux console

+ added proper Windows AltGr support for the enhanced shift state

+ enable the enhanced key events permanently on windows

- removed the no-longer-used code for dealing with the legacy key events

* fix typo in comment

* CheckAltGr moved above HandleKeyboard, because it will be invoked from there also

* update the keyboard layout info before every keystroke, since Windows can
change between multiple layouts, while the program is running

* optimized UpdateKeyboardLayoutInfo, so it only calls GetKeyboardLayout once
and only performs the HasAltGr check in case the keyboard layout has actually
changed

+ added comments, explaining the enhanced shift states in detail

+ added comment about a Windows bug, which causes the keyboard layout change
detection code to not work

* refactored slightly the BEOS ifdef in unixkvmbase.utf8enabled

* check the LC_CTYPE env var instead of LANG on OpenBSD to check whether UTF-8
is enabled

amiga: Crt, fixed cursor x and y position

Amiga: Video unit, do not draw Cursor if outside the window (would write over the window border)

Amiga: keyboard prevent double keys on GetKeyEvent, if called without PollKeyEvent

Amiga: special CRT unit (named vidcrt) based on video unit

rtl-console: fixed keypressed implementation in the Amiga VidCRT unit

Amiga: optimized video unit drawing

Amiga: make the fullscreen video draggable, map Help Key to F20

+ initial attempt at defining an enhanced video cell record for the Unicode support in the video unit

+ added the EnhancedVideoBuf global variable to the video unit

+ introduced TVideoDriver.InitEnhancedDriver

+ introduced OldEnhancedVideoBuf

* use UnicodeString instead of WideString in TEnhancedVideoCell

+ introduced initialization of the video unit in enhanced (Unicode) mode

* formatting

+ support both legacy and enhanced video buffers in Video.ClearScreen

* fixed off by one errors in the new video unit routines

+ added operator = for comparison of TEnhancedVideoCell records

* switched the windows video driver to use the enhanced (unicode) video buffer

* use CP_OEMCP to convert characters in LegacyChar2ExtendedGraphemeCluster

- removed useunicodefunctions from the windows video unit

- removed the cp850 code page mapping from the windows video unit (it is no longer used)

- removed unused variables and types from Video.SysUpdateScreen

* LineBuf converted to dynarray (to avoid buffer overflow for too big consoles) and made global to avoid reallocating it on the heap on each screen update

+ initial attempt to switch the unix video unit to enhanced (unicode) mode. Only
UTF-8 is supported for now, and it's not yet implemented for Linux VCSA.

+ introduced video.StringDisplayWidth

+ introduced Video.ExtendedGraphemeClusterDisplayWidth

+ double width character support in the unix video unit

* reset LastCharWasDoubleWidth in the beginning of every line

+ bug fix in the rendering of double width characters

+ another double width rendering bugfix

* fixed handling of non-BMP characters in Video.ExtendedGraphemeClusterDisplayWidth

* fixed compilation of the video unit on Windows

* convert unicode to the cp437 dingbats range (#0..#31,#127) in ExtendedGraphemeCluster2LegacyChar

+ use a table convert_lowascii_to_Unicode to convert unicode to cp437 lowascii and vice versa

+ also convert characters in the range #128..#255 in ExtendedGraphemeCluster2LegacyChar

- removed commented out code

+ handle enhanced video buffer resizing

+ added graphemebreakproperty and eastasianwidth to the video unit uses clauses of all the remaining operating systems

* fixed compilation under Linux

+ added functions for getting/setting the current code page, when using the
legacy (non-Unicode) video buffer

+ added checks for certain code pages that should not be allowed to be set in Video.ActivateCodePage

+ introduced legacy code page functions to the video driver itself (they can
optionally be implemented for operating systems with non-unicode consoles)

* wire up the code page functions to call the driver functions in case of a legacy driver

+ implemented GetSupportedCodePageCount/GetSupportedCodePage for unicode consoles

* use the current legacy console code page in Enhanced2Legacy

* converted internal_codepage and external_codepage to the TSystemCodePage type.
Removed the unused codepage enum constants and sets.

* fixed bug in decide_codepages, which was checking the wrong variable for is_vga_code_page

- get rid of internal_codepage. Set CurrentLegacy2EnhancedTranslationCodePage instead.

* converted tabs to spaces

* converted comments to utf-8, so the file is readable in modern text editors

* return RawByteString in the transform function result

* use FPC's integrated codepage conversion for non-Unicode unix consoles

Amiga, MorphOS, AROS: unified function results to LongBool in amigados unit, correct type for GFXBase

Amiga video unit: fixed not initialized TInputEvent field

Amiga video unit: fixed not initialized TInputEvent field, 2nd try, now the deadkeys actually work as they should

Amiga: Workbench 1.x compatibilty via the AMIGA_V1_2_ONLY define

Amiga: Implemented GetVar for 1.x

amiga: FPC_DOKEYCONVERSION env var if key conversation Ansi to IBM should be done for every key

amiga: removed some debugging settings

* rtl-console: always compile Amiga KVM units in OBJFPC mode. This makes it easier to compile these units outside of this package

* rtl-console: slight refactor of how Amiga SysUpdateScreen() addresses the videobuf. this results in slightly more optimal code with less complex addressing, which helps low-end processors

* rtl-console: on Amiga, remove the initial testing of the buffer for changes. it just slowed things down with frequent partial updates, especially on low-end processors with limited or no data cache

* rtl-console: on Amiga added a custom screen update call, to do partial screen updates. doing a full update can be very slow on low-end systems (checking the entire screen buffer every time), so software tuned for these can now request partial updates, when the updated already is already known

* rtl-console: generalized the partial screen update feature which was added to Amiga. the function was renamed to UpdateScreenArea(). it's still an empty call on other platforms, that falls back to UpdateScreen() but the infrastructure is now there to support it.

* rtl-console: fix ; in the previous commit

rtl-console/amicommon: set the window's UserPort to nil before closing, as recommended

rtl-console: use videoDefaultFlags variable on Amiga for WA_Flags. disable smartrefresh in full screen, also respect the FPC_VIDEO_SIMPLEREFRESH env var

rtl-console: quickfix for Amiga UpdateScreenArea() so it properly updates multiple lines

+ support conversion between legancy and enhanced console in UpdateScreenArea

* Amiga compilation fix after merge of unicodekvm branch

* win16 compilation fix after merge of unicodekvm branch

AmigaOS4: fix compilation for double UTF8Encode in library unit and system

* return the proper shift state in the i8086-msdos keyboard unit GetKeyEvent and
PollKeyEvent (previously, it was truncated, due to the native int being 16-bit
on i8086)

* fixed bug, where left and right shift were swapped in the i8086-msdos
keyboard unit.

* fixed bug, where left and right shift were swapped in the i386-go32v2
keyboard unit as well.

+ introduced the CurrentLegacy2EnhancedKeyEventTranslationCodePage private
variable in the keyboard unit. It is used for translating AsciiChar to
UnicodeChar in non-enhanced (i.e. non-unicode) consoles. It can be initialized
in SysInitKeyboard in non-unicode consoles, so they can return unicode
characters as well.

+ support 83/84-key keyboards in the go32v2 keyboard unit

+ get the current DOS code page in the go32v2 keyboard unit, so enhanced key
events Unicode characters are returned correctly (provided that the cpall and
fpwidestring unit are included as well)

+ get the current code page in the msdos keyboard unit as well

+ support shift+pgup, shift+pgdn, ctrl+shift+pgup and ctrl+shift+pgdn in the
unix keyboard unit

+ added properties TEnhancedVideoCell.ForegroundColor and .BackgroundColor,
which can store up to 256 colors

- removed spaces at end of line

- delete disabled code

* attr2ansi changed to accept separate foreground and background color
parameters, instead of single attribute bytes. No functional changes.

* use separate variables for tracking the foreground and background colors

* copy operator of TEnhancedVideoCell now copies the 8-bit foreground and background colors

+ added 256 color support to the Unix console video unit

* fixed the 256-color support for konsole

* changed the video unit initialization sequence, so that the startup cursor
position is preserved at exit (or when switching to the user screen in the
IDE), when running in xterm or compatible (gnome-terminal, konsole, etc.)

+ introduced TEnhancedVideoCell.EnhancedVideoAttributes, based on ECMA-48 and xterm

+ implemented enhanced video attributes in the Unix video unit
+ added test for the enhanced video attributes

* convert advanced video attributes to legacy attributes (emulating bold, italic,
etc. using colors). Also, the blink attribute is converted correctly now.

Enabled mouse support for macOS and *BSD. Free Vision apps can now make use of the mouse for these O/Ss.

+ use the DEC special graphics character set to draw some non-ASCII characters
on Unix consoles that don't support UTF-8 (or don't have it enabled)

+ use some ASCII replacements for certain non-ASCII characters (used by Free
Vision) on Unix consoles that don't support UTF-8

* attempt to fix gitlab 0039900

* PChar -> PAnsiChar

* Dotted filenames for package rtl-console

Block insert cursor. Block cursor for overwrite mode in xterm

Branch to save Enhanced video buffer or Legacy video buffer (Unix).

Implementation of Kitty keys and xterm - ModifyOtherKeys (Unix keyboard)

Enable mouse in pterm (putty)

Windows console mouse - scroll up and down events

Additional function key escape sequences for rxvt (urxvt)

In console enable mouse buttons browse back/forward (xterm Unix)

Go32v2 and msdos mouse is zero based. Fixed GetMouseX, GetMouseY and SetMouseXY.

make file gitlab web interface friendly

Silent key apostrophe. Fixed problem for Windows Textmode IDE in Linux under Wine.

Console keyboard shift states in Unix

Multi byte mouse report format for rxvt (Unix)

rtl-console/amicommon: added a way to redefine colors externally in the video unit

RawReadString is limited to length of shortstring, don't read more than that

Correct mouse button mapping under Unix

Escape key press while rapidly move mouse don't print escape sequence on screen

No mouse up events for mouse wheel.

Exposes in interface ConvertToLegacyKeyEvent.

Show mouse with new Free Vision Enhanced Video in linux console.

GPM report two additional buttons.

Hide debug info. Use constant in expr instead of variable.

Mouse wheel generate only down action.

Mouse wheel for msdos.

Mouse wheel for go32v2.

Fix assembler syntax error in last commit

Do not localize shortcut keys when using Kitty keyboard protocol.

Kitty keyboard protocol fix F1, F2 and F4 keys.

Fixed hotkeys problems left after https://gitlab.com/freepascal.org/fpc/source/-/merge_requests/1138
See https://gitlab.com/freepascal.org/fpc/source/-/merge_requests/1138#note_2734591449 for details

Support non-lating Alt+char hotkeys in legacy terminals also

Added support for win32 input mode

Spec:
https://github.com/microsoft/terminal/blob/main/doc/specs/%234999%20-%20Improved%20keyboard%20handling%20in%20Conpty.md

Fixes gitlab 0040672

TV_INPUT env var for manual input protocol selection

- Fixed kitty input mode accidently broken by win32 input mode implementation
- Fixed Shift+Tab behavior under win32 input mode
- Fixed Del key behavior in win32 input mode
- Fixed Alt+non_latin_letters and Ctrl+arrows in legacy mode

- Added simple keyboard events debug tool
- Fixed and error causing kitty protocol being used even if other one is selected as preferred

Apply 1 suggestion(s) to 1 file(s)

Co-authored-by: Margers

sync with video.pp

Fixed doubling of ESC key events in kitty and legacy modes
Fixed wrong condition (Alt+NonLatin top menu hotkeys now work again)

This commit significantly enhances text input and editing in non-Unicode environments on Unix-like systems. The video unit now automatically detects the appropriate legacy (OEM) codepage based on the LANG environment variable, replacing the previous hardcoded default. This allows applications using Free Vision, like the built-in editor, to correctly display at least the most frequently occurring symbols in various legacy encodings. Furthermore, the keyboard unit now correctly translates Unicode key input into the detected single-byte codepage, enabling proper input of national characters, such as Russian, even in non-Unicode builds.

Based on
https://github.com/elfmz/far2l/blob/14c12dcfe29b42ac6870716bcb58012656b468a1/WinPort/src/APIStringCodepages.cpp

Fixed dotted unit names

Fix types according to
https://gitlab.com/freepascal.org/fpc/source/-/commit/38fda54ec6f5031a3d3d9dfdead3b4f3d3f0d4a2#note_2840311283

Fix lately broken Xterm Modify Other Keys keyboard protocol implementation.

Fix kitty keyboard protocol keys F1, F2, F4 (2nd attempt).

Fix Video unit doted name in uses.

* Easy-to-use Ansi escape sequences

Mouse is zero base. Fix it for go32v2 and msdos.

Report only uniq mouse events in DOS.

Allow arbitrary screen dimensions on Windows console resize. As well full screen allowed.

Adaptive Windows console size.

Windows mouse scroll x,y position fixup.

Enable mouse for BSD. No mouse wheel for BSD.

Kitty keys: quote key.

Disable Kitty keys for Haiku. Escape sequence have different meaning.

Enable some keys for Haiku terminal emulator.

Fix for Win32 input keyboard protocol.

FindSequence expose TTreeElements in interface.