def forced_utf8_encoding?: () -> bool
def forced_binary_encoding?: () -> bool
def forced_utf8_encoding?: () -> bool
def forced_binary_encoding?: () -> bool
def forced_utf8_encoding?: () -> bool
def forced_binary_encoding?: () -> bool
Returns the offset from the start of the file for the given byte offset counting in code units for the given encoding.
This method is tested with UTF-8, UTF-16, and UTF-32. If there is the concept of code units that differs from the number of characters in other encodings, it is not captured here.
We purposefully replace invalid and undefined characters with replacement characters in this conversion. This happens for two reasons. First, it’s possible that the given byte offset will not occur on a character boundary. Second, it’s possible that the source code will contain a character that has no equivalent in the given encoding.
Generate a cache that targets a specific encoding for calculating code unit offsets.
Returns the column number in code units for the given encoding for the given byte offset.
Returns the offset from the start of the file for the given byte offset counting in code units for the given encoding.
This method is tested with UTF-8, UTF-16, and UTF-32. If there is the concept of code units that differs from the number of characters in other encodings, it is not captured here.
Returns a cache that is the identity function in order to maintain the same interface. We can do this because code units are always equivalent to byte offsets for ASCII-only sources.