PrimalScript 2019 problem with unicode character

This forum can be browsed by the general public. Posting is limited to current SAPIEN license holders with active maintenance and does not offer a response time guarantee.
Forum rules
DO NOT POST LICENSE NUMBERS, ACTIVATION KEYS OR ANY OTHER LICENSING INFORMATION IN THIS FORUM.
Only the original author and our tech personnel can reply to a topic that is created in this forum. If you find a topic that relates to an issue you are having, please create a new topic and reference the other in your post.

Any code longer than three lines should be added as code using the 'Select Code' dropdown menu or attached as a file.
This topic is 5 years and 3 months old and has exceeded the time allowed for comments. Please begin a new topic or use the search feature to find a similar but newer topic.
User avatar
gmichaud
Posts: 108
Last visit: Fri Mar 10, 2023 9:05 am

PrimalScript 2019 problem with unicode character

Post by gmichaud »

Product: PrimalScript (64 Bit)
Build: v7.4.120
OS: Windows 10 Pro (64 Bit)
Build: v10.0.16299

At least one Unicode character that we have used in our scripts for many years causes the 2019 version to stop reading the script file, sometimes with gibberish after the character. The 2018 and 2014 versions read everything just fine.

The right double arrow is particularly troublesome:
" » "
In a comment it seems to simply stop reading the script. In code it causes the odd error you will find in the attached file, as well as an error that some lines are over 8128 characters long (they are NOT).
UnicodeError.zip
(41.1 KiB) Downloaded 201 times
Thanks,

Gerald Michaud
gmichaud@dxc.com

BTW, the dropdown on this web page to "select code" type doesn't seem to have a selection for vbscript. We make a LOT of vbscripts. Hopefully some day we'll move to powershell, but for the foreseeable future it's all vbscript.
Thanks,
Gerry
User avatar
Olga_B
Site Admin
Posts: 196
Last visit: Mon Mar 25, 2024 11:57 am

Re: PrimalScript 2019 problem with unicode character

Post by Olga_B »

Thanks for reporting the issue.
The issue has been sent to the proper place for evaluation and correction. When a fix is issued with a service build, it will be listed in the change log.
User avatar
Alexander Riedel
Posts: 8478
Last visit: Tue Mar 26, 2024 8:52 am
Answers: 19
Been upvoted: 37 times

Re: PrimalScript 2019 problem with unicode character

Post by Alexander Riedel »

It's fixed and in QA. There is new code to detect BOMs (Byte Order Marks) mid file because some folks started to concatenate unicode files with the good old DOS copy command. That created problems as you might imagine. The detection code was flawed though, so that caused your problem. Thought maybe you are curious :D
Alexander Riedel
SAPIEN Technologies, Inc.
User avatar
gmichaud
Posts: 108
Last visit: Fri Mar 10, 2023 9:05 am

Re: PrimalScript 2019 problem with unicode character

Post by gmichaud »

Thanks for the quick resolution and extra info. I DO like to hear these details.

One thing I learned a long time ago is that no matter how hard you try to think of all the usage scenarios and all possible ways users can break something, they'll still surprise you!

Any idea how long this will remain in QA? I'd like to provide an ETA to the rest or our team.

Thanks,
Gerry
Thanks,
Gerry
User avatar
Alexander Riedel
Posts: 8478
Last visit: Tue Mar 26, 2024 8:52 am
Answers: 19
Been upvoted: 37 times

Re: PrimalScript 2019 problem with unicode character

Post by Alexander Riedel »

Not sure at the moment. There are few other changes in that build that still require some work. I will know more after today.
Alexander Riedel
SAPIEN Technologies, Inc.
User avatar
Alexander Riedel
Posts: 8478
Last visit: Tue Mar 26, 2024 8:52 am
Answers: 19
Been upvoted: 37 times

Re: PrimalScript 2019 problem with unicode character

Post by Alexander Riedel »

The fix has been released in the latest service build (7.4.121).
Alexander Riedel
SAPIEN Technologies, Inc.
User avatar
gmichaud
Posts: 108
Last visit: Fri Mar 10, 2023 9:05 am

Re: PrimalScript 2019 problem with unicode character

Post by gmichaud »

thanks. i'll test it this morning.
Thanks,
Gerry
This topic is 5 years and 3 months old and has exceeded the time allowed for comments. Please begin a new topic or use the search feature to find a similar but newer topic.