default userpic

UTF-8 characters getting converted in plugin

Vote 0 Votes

I'm updating a plugin I wrote (PagedArchives) to run with MT5. All went well and I got it working, however if I include UTF8 characters in a post, they get converted somehow to ASCII.

I'm providing a BuildFile handler, which uses RawContent from the arguments passed. As far as I can tell, the RawContent contains the UTF8 characters correctly, however when I do a pattern match on it and save the matched string, the UTF8 bytes in this matched string have been converted to ASCII. From what I have read on the subject, Perl should be doing no conversion at all, and simply treating the string as a sequence of bytes.

I have successfully gotten it to output the UTF8 characters properly by calling utf8::encode($string); on the strings before writing them out, however this is just a hack.

I've also tried, without success: declaring "use utf8;" at the top, and calling "setlocale" to set the current locale to use utf8.

So, I'm not sure what the proper way to do this is.

Reported on Movable Type 5

2 Replies

| Add a Reply

Add a Reply

If you need to share template code, replace all the "<" signs with "&lt;" or use this utility.

Forum Groups

1773 6162

Last Topic: Excluding categories from blog by kholechek on Feb 9, 2012

86 302

Last Topic: website entries by masoud on Oct 26, 2011

1428 5076

Last Topic: Stupid Question? How to make a static homepage by Jeremy on Feb 3, 2012

694 2908

Last Topic: Blogspot to Movable Type by sdude on Feb 8, 2012

84 291

Last Topic: How to have some other characters in entry basename automatically written by Afshin Haghighatnia on Dec 22, 2011

173 737

Last Topic: About the MT version stated in HTML source by Alex E. Schneider on Feb 7, 2012

190 565

Last Topic: Analytics Reporting by michael webster on Feb 5, 2012

48 210

Last Topic: An idea and also a request by Afshin Haghighatnia on Jun 29, 2011

64 246

Last Topic: jQuery in MT 5.1 still at 1.4 - why? by perlmonkey on May 25, 2011

code.sixapart.com

137 478

Last Topic: Getting a thumbnail with xpath by Peter on Mar 13, 2011

222 716

Last Topic: Custom Field for Asset Not Appearing by android on Feb 9, 2012