-
Notifications
You must be signed in to change notification settings - Fork 2
/
Copy pathperl5100delta.html
1418 lines (887 loc) · 77.6 KB
/
perl5100delta.html
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
737
738
739
740
741
742
743
744
745
746
747
748
749
750
751
752
753
754
755
756
757
758
759
760
761
762
763
764
765
766
767
768
769
770
771
772
773
774
775
776
777
778
779
780
781
782
783
784
785
786
787
788
789
790
791
792
793
794
795
796
797
798
799
800
801
802
803
804
805
806
807
808
809
810
811
812
813
814
815
816
817
818
819
820
821
822
823
824
825
826
827
828
829
830
831
832
833
834
835
836
837
838
839
840
841
842
843
844
845
846
847
848
849
850
851
852
853
854
855
856
857
858
859
860
861
862
863
864
865
866
867
868
869
870
871
872
873
874
875
876
877
878
879
880
881
882
883
884
885
886
887
888
889
890
891
892
893
894
895
896
897
898
899
900
901
902
903
904
905
906
907
908
909
910
911
912
913
914
915
916
917
918
919
920
921
922
923
924
925
926
927
928
929
930
931
932
933
934
935
936
937
938
939
940
941
942
943
944
945
946
947
948
949
950
951
952
953
954
955
956
957
958
959
960
961
962
963
964
965
966
967
968
969
970
971
972
973
974
975
976
977
978
979
980
981
982
983
984
985
986
987
988
989
990
991
992
993
994
995
996
997
998
999
1000
<?xml version="1.0" ?>
<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd">
<html xmlns="http://www.w3.org/1999/xhtml">
<head>
<title>perl5100delta - what is new for perl 5.10.0</title>
<meta http-equiv="content-type" content="text/html; charset=utf-8" />
<link rev="made" href="mailto:[email protected]" />
</head>
<body>
<ul id="index">
<li><a href="#NAME">NAME</a></li>
<li><a href="#DESCRIPTION">DESCRIPTION</a></li>
<li><a href="#Core-Enhancements">Core Enhancements</a>
<ul>
<li><a href="#The-feature-pragma">The feature pragma</a></li>
<li><a href="#New--E-command-line-switch">New -E command-line switch</a></li>
<li><a href="#Defined-or-operator">Defined-or operator</a></li>
<li><a href="#Switch-and-Smart-Match-operator">Switch and Smart Match operator</a></li>
<li><a href="#Regular-expressions">Regular expressions</a></li>
<li><a href="#say">say()</a></li>
<li><a href="#Lexical-_">Lexical $_</a></li>
<li><a href="#The-_-prototype">The _ prototype</a></li>
<li><a href="#UNITCHECK-blocks">UNITCHECK blocks</a></li>
<li><a href="#New-Pragma-mro">New Pragma, mro</a></li>
<li><a href="#readdir-may-return-a-short-filename-on-Windows">readdir() may return a "short filename" on Windows</a></li>
<li><a href="#readpipe-is-now-overridable">readpipe() is now overridable</a></li>
<li><a href="#Default-argument-for-readline">Default argument for readline()</a></li>
<li><a href="#state-variables">state() variables</a></li>
<li><a href="#Stacked-filetest-operators">Stacked filetest operators</a></li>
<li><a href="#UNIVERSAL::DOES">UNIVERSAL::DOES()</a></li>
<li><a href="#Formats">Formats</a></li>
<li><a href="#Byte-order-modifiers-for-pack-and-unpack">Byte-order modifiers for pack() and unpack()</a></li>
<li><a href="#no-VERSION">no VERSION</a></li>
<li><a href="#chdir-chmod-and-chown-on-filehandles">chdir, chmod and chown on filehandles</a></li>
<li><a href="#OS-groups">OS groups</a></li>
<li><a href="#Recursive-sort-subs">Recursive sort subs</a></li>
<li><a href="#Exceptions-in-constant-folding">Exceptions in constant folding</a></li>
<li><a href="#Source-filters-in-INC">Source filters in @INC</a></li>
<li><a href="#New-internal-variables">New internal variables</a></li>
<li><a href="#Miscellaneous">Miscellaneous</a></li>
<li><a href="#UCD-5.0.0">UCD 5.0.0</a></li>
<li><a href="#MAD">MAD</a></li>
<li><a href="#kill-on-Windows">kill() on Windows</a></li>
</ul>
</li>
<li><a href="#Incompatible-Changes">Incompatible Changes</a>
<ul>
<li><a href="#Packing-and-UTF-8-strings">Packing and UTF-8 strings</a></li>
<li><a href="#Byte-character-count-feature-in-unpack">Byte/character count feature in unpack()</a></li>
<li><a href="#The-and-variables-have-been-removed">The $* and $# variables have been removed</a></li>
<li><a href="#substr-lvalues-are-no-longer-fixed-length">substr() lvalues are no longer fixed-length</a></li>
<li><a href="#Parsing-of--f-_">Parsing of -f _</a></li>
<li><a href="#unique">:unique</a></li>
<li><a href="#Effect-of-pragmas-in-eval">Effect of pragmas in eval</a></li>
<li><a href="#chdir-FOO">chdir FOO</a></li>
<li><a href="#Handling-of-.pmc-files">Handling of .pmc files</a></li>
<li><a href="#V-is-now-a-version-object-instead-of-a-v-string">$^V is now a version object instead of a v-string</a></li>
<li><a href="#and-in-patterns">@- and @+ in patterns</a></li>
<li><a href="#AUTOLOAD-can-now-be-tainted">$AUTOLOAD can now be tainted</a></li>
<li><a href="#Tainting-and-printf">Tainting and printf</a></li>
<li><a href="#undef-and-signal-handlers">undef and signal handlers</a></li>
<li><a href="#strictures-and-dereferencing-in-defined">strictures and dereferencing in defined()</a></li>
<li><a href="#p-has-been-removed">(?p{}) has been removed</a></li>
<li><a href="#Pseudo-hashes-have-been-removed">Pseudo-hashes have been removed</a></li>
<li><a href="#Removal-of-the-bytecode-compiler-and-of-perlcc">Removal of the bytecode compiler and of perlcc</a></li>
<li><a href="#Removal-of-the-JPL">Removal of the JPL</a></li>
<li><a href="#Recursive-inheritance-detected-earlier">Recursive inheritance detected earlier</a></li>
<li><a href="#warnings::enabled-and-warnings::warnif-changed-to-favor-users-of-modules">warnings::enabled and warnings::warnif changed to favor users of modules</a></li>
</ul>
</li>
<li><a href="#Modules-and-Pragmata">Modules and Pragmata</a>
<ul>
<li><a href="#Upgrading-individual-core-modules">Upgrading individual core modules</a></li>
<li><a href="#Pragmata-Changes">Pragmata Changes</a></li>
<li><a href="#New-modules">New modules</a></li>
<li><a href="#Selected-Changes-to-Core-Modules">Selected Changes to Core Modules</a></li>
</ul>
</li>
<li><a href="#Utility-Changes">Utility Changes</a></li>
<li><a href="#New-Documentation">New Documentation</a></li>
<li><a href="#Performance-Enhancements">Performance Enhancements</a>
<ul>
<li><a href="#In-place-sorting">In-place sorting</a></li>
<li><a href="#Lexical-array-access">Lexical array access</a></li>
<li><a href="#XS-assisted-SWASHGET">XS-assisted SWASHGET</a></li>
<li><a href="#Constant-subroutines">Constant subroutines</a></li>
<li><a href="#PERL_DONT_CREATE_GVSV">PERL_DONT_CREATE_GVSV</a></li>
<li><a href="#Weak-references-are-cheaper">Weak references are cheaper</a></li>
<li><a href="#sort-enhancements">sort() enhancements</a></li>
<li><a href="#Memory-optimisations">Memory optimisations</a></li>
<li><a href="#UTF-8-cache-optimisation">UTF-8 cache optimisation</a></li>
<li><a href="#Sloppy-stat-on-Windows">Sloppy stat on Windows</a></li>
<li><a href="#Regular-expressions-optimisations">Regular expressions optimisations</a></li>
</ul>
</li>
<li><a href="#Installation-and-Configuration-Improvements">Installation and Configuration Improvements</a>
<ul>
<li><a href="#Configuration-improvements">Configuration improvements</a></li>
<li><a href="#Compilation-improvements">Compilation improvements</a></li>
<li><a href="#Installation-improvements">Installation improvements</a></li>
<li><a href="#New-Or-Improved-Platforms">New Or Improved Platforms</a></li>
</ul>
</li>
<li><a href="#Selected-Bug-Fixes">Selected Bug Fixes</a></li>
<li><a href="#New-or-Changed-Diagnostics">New or Changed Diagnostics</a></li>
<li><a href="#Changed-Internals">Changed Internals</a>
<ul>
<li><a href="#Reordering-of-SVt_-constants">Reordering of SVt_* constants</a></li>
<li><a href="#Elimination-of-SVt_PVBM">Elimination of SVt_PVBM</a></li>
<li><a href="#New-type-SVt_BIND">New type SVt_BIND</a></li>
<li><a href="#Removal-of-CPP-symbols">Removal of CPP symbols</a></li>
<li><a href="#Less-space-is-used-by-ops">Less space is used by ops</a></li>
<li><a href="#New-parser">New parser</a></li>
<li><a href="#Use-of-const">Use of const</a></li>
<li><a href="#Mathoms">Mathoms</a></li>
<li><a href="#AvFLAGS-has-been-removed">AvFLAGS has been removed</a></li>
<li><a href="#av_-changes">av_* changes</a></li>
<li><a href="#H-and-H">$^H and %^H</a></li>
<li><a href="#B::-modules-inheritance-changed">B:: modules inheritance changed</a></li>
<li><a href="#Anonymous-hash-and-array-constructors">Anonymous hash and array constructors</a></li>
</ul>
</li>
<li><a href="#Known-Problems">Known Problems</a>
<ul>
<li><a href="#UTF-8-problems">UTF-8 problems</a></li>
</ul>
</li>
<li><a href="#Platform-Specific-Problems">Platform Specific Problems</a></li>
<li><a href="#Reporting-Bugs">Reporting Bugs</a></li>
<li><a href="#SEE-ALSO">SEE ALSO</a></li>
</ul>
<h1 id="NAME">NAME</h1>
<p>perl5100delta - what is new for perl 5.10.0</p>
<h1 id="DESCRIPTION">DESCRIPTION</h1>
<p>This document describes the differences between the 5.8.8 release and the 5.10.0 release.</p>
<p>Many of the bug fixes in 5.10.0 were already seen in the 5.8.X maintenance releases; they are not duplicated here and are documented in the set of man pages named perl58[1-8]?delta.</p>
<h1 id="Core-Enhancements">Core Enhancements</h1>
<h2 id="The-feature-pragma">The <code>feature</code> pragma</h2>
<p>The <code>feature</code> pragma is used to enable new syntax that would break Perl's backwards-compatibility with older releases of the language. It's a lexical pragma, like <code>strict</code> or <code>warnings</code>.</p>
<p>Currently the following new features are available: <code>switch</code> (adds a switch statement), <code>say</code> (adds a <code>say</code> built-in function), and <code>state</code> (adds a <code>state</code> keyword for declaring "static" variables). Those features are described in their own sections of this document.</p>
<p>The <code>feature</code> pragma is also implicitly loaded when you require a minimal perl version (with the <code>use VERSION</code> construct) greater than, or equal to, 5.9.5. See <a href="/cperl/lib/feature.html">feature</a> for details.</p>
<h2 id="New--E-command-line-switch">New <b>-E</b> command-line switch</h2>
<p><b>-E</b> is equivalent to <b>-e</b>, but it implicitly enables all optional features (like <code>use feature ":5.10"</code>).</p>
<h2 id="Defined-or-operator">Defined-or operator</h2>
<p>A new operator <code>//</code> (defined-or) has been implemented. The following expression:</p>
<pre><code> $a // $b</code></pre>
<p>is merely equivalent to</p>
<pre><code> defined $a ? $a : $b</code></pre>
<p>and the statement</p>
<pre><code> $c //= $d;</code></pre>
<p>can now be used instead of</p>
<pre><code> $c = $d unless defined $c;</code></pre>
<p>The <code>//</code> operator has the same precedence and associativity as <code>||</code>. Special care has been taken to ensure that this operator Do What You Mean while not breaking old code, but some edge cases involving the empty regular expression may now parse differently. See <a href="/cperl/perlop.html">perlop</a> for details.</p>
<h2 id="Switch-and-Smart-Match-operator">Switch and Smart Match operator</h2>
<p>Perl 5 now has a switch statement. It's available when <code>use feature 'switch'</code> is in effect. This feature introduces three new keywords, <code>given</code>, <code>when</code>, and <code>default</code>:</p>
<pre><code> given ($foo) {
when (/^abc/) { $abc = 1; }
when (/^def/) { $def = 1; }
when (/^xyz/) { $xyz = 1; }
default { $nothing = 1; }
}</code></pre>
<p>A more complete description of how Perl matches the switch variable against the <code>when</code> conditions is given in <a href="/cperl/perlsyn.html#Switch-statements">"Switch statements" in perlsyn</a>.</p>
<p>This kind of match is called <i>smart match</i>, and it's also possible to use it outside of switch statements, via the new <code>~~</code> operator. See <a href="/cperl/perlsyn.html#Smart-matching-in-detail">"Smart matching in detail" in perlsyn</a>.</p>
<p>This feature was contributed by Robin Houston.</p>
<h2 id="Regular-expressions">Regular expressions</h2>
<dl>
<dt id="Recursive-Patterns">Recursive Patterns</dt>
<dd>
<p>It is now possible to write recursive patterns without using the <code>(??{})</code> construct. This new way is more efficient, and in many cases easier to read.</p>
<p>Each capturing parenthesis can now be treated as an independent pattern that can be entered by using the <code>(?PARNO)</code> syntax (<code>PARNO</code> standing for "parenthesis number"). For example, the following pattern will match nested balanced angle brackets:</p>
<pre><code> /
^ # start of line
( # start capture buffer 1
< # match an opening angle bracket
(?: # match one of:
(?> # don't backtrack over the inside of this group
[^<>]+ # one or more non angle brackets
) # end non backtracking group
| # ... or ...
(?1) # recurse to bracket 1 and try it again
)* # 0 or more times.
> # match a closing angle bracket
) # end capture buffer one
$ # end of line
/x</code></pre>
<p>PCRE users should note that Perl's recursive regex feature allows backtracking into a recursed pattern, whereas in PCRE the recursion is atomic or "possessive" in nature. As in the example above, you can add (?>) to control this selectively. (Yves Orton)</p>
</dd>
<dt id="Named-Capture-Buffers">Named Capture Buffers</dt>
<dd>
<p>It is now possible to name capturing parenthesis in a pattern and refer to the captured contents by name. The naming syntax is <code>(?<NAME>....)</code>. It's possible to backreference to a named buffer with the <code>\k<NAME></code> syntax. In code, the new magical hashes <code>%+</code> and <code>%-</code> can be used to access the contents of the capture buffers.</p>
<p>Thus, to replace all doubled chars with a single copy, one could write</p>
<pre><code> s/(?<letter>.)\k<letter>/$+{letter}/g</code></pre>
<p>Only buffers with defined contents will be "visible" in the <code>%+</code> hash, so it's possible to do something like</p>
<pre><code> foreach my $name (keys %+) {
print "content of buffer '$name' is $+{$name}\n";
}</code></pre>
<p>The <code>%-</code> hash is a bit more complete, since it will contain array refs holding values from all capture buffers similarly named, if there should be many of them.</p>
<p><code>%+</code> and <code>%-</code> are implemented as tied hashes through the new module <code>Tie::Hash::NamedCapture</code>.</p>
<p>Users exposed to the .NET regex engine will find that the perl implementation differs in that the numerical ordering of the buffers is sequential, and not "unnamed first, then named". Thus in the pattern</p>
<pre><code> /(A)(?<B>B)(C)(?<D>D)/</code></pre>
<p>$1 will be 'A', $2 will be 'B', $3 will be 'C' and $4 will be 'D' and not $1 is 'A', $2 is 'C' and $3 is 'B' and $4 is 'D' that a .NET programmer would expect. This is considered a feature. :-) (Yves Orton)</p>
</dd>
<dt id="Possessive-Quantifiers">Possessive Quantifiers</dt>
<dd>
<p>Perl now supports the "possessive quantifier" syntax of the "atomic match" pattern. Basically a possessive quantifier matches as much as it can and never gives any back. Thus it can be used to control backtracking. The syntax is similar to non-greedy matching, except instead of using a '?' as the modifier the '+' is used. Thus <code>?+</code>, <code>*+</code>, <code>++</code>, <code>{min,max}+</code> are now legal quantifiers. (Yves Orton)</p>
</dd>
<dt id="Backtracking-control-verbs">Backtracking control verbs</dt>
<dd>
<p>The regex engine now supports a number of special-purpose backtrack control verbs: (*THEN), (*PRUNE), (*MARK), (*SKIP), (*COMMIT), (*FAIL) and (*ACCEPT). See <a href="/cperl/perlre.html">perlre</a> for their descriptions. (Yves Orton)</p>
</dd>
<dt id="Relative-backreferences">Relative backreferences</dt>
<dd>
<p>A new syntax <code>\g{N}</code> or <code>\gN</code> where "N" is a decimal integer allows a safer form of back-reference notation as well as allowing relative backreferences. This should make it easier to generate and embed patterns that contain backreferences. See <a href="/cperl/perlre.html#Capture-buffers">"Capture buffers" in perlre</a>. (Yves Orton)</p>
</dd>
<dt id="K-escape"><code>\K</code> escape</dt>
<dd>
<p>The functionality of Jeff Pinyan's module Regexp::Keep has been added to the core. In regular expressions you can now use the special escape <code>\K</code> as a way to do something like floating length positive lookbehind. It is also useful in substitutions like:</p>
<pre><code> s/(foo)bar/$1/g</code></pre>
<p>that can now be converted to</p>
<pre><code> s/foo\Kbar//g</code></pre>
<p>which is much more efficient. (Yves Orton)</p>
</dd>
<dt id="Vertical-and-horizontal-whitespace-and-linebreak">Vertical and horizontal whitespace, and linebreak</dt>
<dd>
<p>Regular expressions now recognize the <code>\v</code> and <code>\h</code> escapes that match vertical and horizontal whitespace, respectively. <code>\V</code> and <code>\H</code> logically match their complements.</p>
<p><code>\R</code> matches a generic linebreak, that is, vertical whitespace, plus the multi-character sequence <code>"\x0D\x0A"</code>.</p>
</dd>
<dt id="Optional-pre-match-and-post-match-captures-with-the-p-flag">Optional pre-match and post-match captures with the /p flag</dt>
<dd>
<p>There is a new flag <code>/p</code> for regular expressions. Using this makes the engine preserve a copy of the part of the matched string before the matching substring to the new special variable <code>${^PREMATCH}</code>, the part after the matching substring to <code>${^POSTMATCH}</code>, and the matched substring itself to <code>${^MATCH}</code>.</p>
<p>Perl is still able to store these substrings to the special variables <code>$`</code>, <code>$'</code>, <code>$&</code>, but using these variables anywhere in the program adds a penalty to all regular expression matches, whereas if you use the <code>/p</code> flag and the new special variables instead, you pay only for the regular expressions where the flag is used.</p>
<p>For more detail on the new variables, see <a href="/cperl/perlvar.html">perlvar</a>; for the use of the regular expression flag, see <a href="/cperl/perlop.html">perlop</a> and <a href="/cperl/perlre.html">perlre</a>.</p>
</dd>
</dl>
<h2 id="say"><code>say()</code></h2>
<p>say() is a new built-in, only available when <code>use feature 'say'</code> is in effect, that is similar to print(), but that implicitly appends a newline to the printed string. See <a href="/cperl/perlfunc.html#say">"say" in perlfunc</a>. (Robin Houston)</p>
<h2 id="Lexical-_">Lexical <code>$_</code></h2>
<p>The default variable <code>$_</code> can now be lexicalized, by declaring it like any other lexical variable, with a simple</p>
<pre><code> my $_;</code></pre>
<p>The operations that default on <code>$_</code> will use the lexically-scoped version of <code>$_</code> when it exists, instead of the global <code>$_</code>.</p>
<p>In a <code>map</code> or a <code>grep</code> block, if <code>$_</code> was previously my'ed, then the <code>$_</code> inside the block is lexical as well (and scoped to the block).</p>
<p>In a scope where <code>$_</code> has been lexicalized, you can still have access to the global version of <code>$_</code> by using <code>$::_</code>, or, more simply, by overriding the lexical declaration with <code>our $_</code>. (Rafael Garcia-Suarez)</p>
<h2 id="The-_-prototype">The <code>_</code> prototype</h2>
<p>A new prototype character has been added. <code>_</code> is equivalent to <code>$</code> but defaults to <code>$_</code> if the corresponding argument isn't supplied (both <code>$</code> and <code>_</code> denote a scalar). Due to the optional nature of the argument, you can only use it at the end of a prototype, or before a semicolon.</p>
<p>This has a small incompatible consequence: the prototype() function has been adjusted to return <code>_</code> for some built-ins in appropriate cases (for example, <code>prototype('CORE::rmdir')</code>). (Rafael Garcia-Suarez)</p>
<h2 id="UNITCHECK-blocks">UNITCHECK blocks</h2>
<p><code>UNITCHECK</code>, a new special code block has been introduced, in addition to <code>BEGIN</code>, <code>CHECK</code>, <code>INIT</code> and <code>END</code>.</p>
<p><code>CHECK</code> and <code>INIT</code> blocks, while useful for some specialized purposes, are always executed at the transition between the compilation and the execution of the main program, and thus are useless whenever code is loaded at runtime. On the other hand, <code>UNITCHECK</code> blocks are executed just after the unit which defined them has been compiled. See <a href="/cperl/perlmod.html">perlmod</a> for more information. (Alex Gough)</p>
<h2 id="New-Pragma-mro">New Pragma, <code>mro</code></h2>
<p>A new pragma, <code>mro</code> (for Method Resolution Order) has been added. It permits to switch, on a per-class basis, the algorithm that perl uses to find inherited methods in case of a multiple inheritance hierarchy. The default MRO hasn't changed (DFS, for Depth First Search). Another MRO is available: the C3 algorithm. See <a href="/cperl/lib/mro.html">mro</a> for more information. (Brandon Black)</p>
<p>Note that, due to changes in the implementation of class hierarchy search, code that used to undef the <code>*ISA</code> glob will most probably break. Anyway, undef'ing <code>*ISA</code> had the side-effect of removing the magic on the @ISA array and should not have been done in the first place. Also, the cache <code>*::ISA::CACHE::</code> no longer exists; to force reset the @ISA cache, you now need to use the <code>mro</code> API, or more simply to assign to @ISA (e.g. with <code>@ISA = @ISA</code>).</p>
<h2 id="readdir-may-return-a-short-filename-on-Windows">readdir() may return a "short filename" on Windows</h2>
<p>The readdir() function may return a "short filename" when the long filename contains characters outside the ANSI codepage. Similarly Cwd::cwd() may return a short directory name, and glob() may return short names as well. On the NTFS file system these short names can always be represented in the ANSI codepage. This will not be true for all other file system drivers; e.g. the FAT filesystem stores short filenames in the OEM codepage, so some files on FAT volumes remain unaccessible through the ANSI APIs.</p>
<p>Similarly, $^X, @INC, and $ENV{PATH} are preprocessed at startup to make sure all paths are valid in the ANSI codepage (if possible).</p>
<p>The Win32::GetLongPathName() function now returns the UTF-8 encoded correct long file name instead of using replacement characters to force the name into the ANSI codepage. The new Win32::GetANSIPathName() function can be used to turn a long pathname into a short one only if the long one cannot be represented in the ANSI codepage.</p>
<p>Many other functions in the <code>Win32</code> module have been improved to accept UTF-8 encoded arguments. Please see <a href="/cperl/lib/File/Spec/Win32.html">Win32</a> for details.</p>
<h2 id="readpipe-is-now-overridable">readpipe() is now overridable</h2>
<p>The built-in function readpipe() is now overridable. Overriding it permits also to override its operator counterpart, <code>qx//</code> (a.k.a. <code>``</code>). Moreover, it now defaults to <code>$_</code> if no argument is provided. (Rafael Garcia-Suarez)</p>
<h2 id="Default-argument-for-readline">Default argument for readline()</h2>
<p>readline() now defaults to <code>*ARGV</code> if no argument is provided. (Rafael Garcia-Suarez)</p>
<h2 id="state-variables">state() variables</h2>
<p>A new class of variables has been introduced. State variables are similar to <code>my</code> variables, but are declared with the <code>state</code> keyword in place of <code>my</code>. They're visible only in their lexical scope, but their value is persistent: unlike <code>my</code> variables, they're not undefined at scope entry, but retain their previous value. (Rafael Garcia-Suarez, Nicholas Clark)</p>
<p>To use state variables, one needs to enable them by using</p>
<pre><code> use feature 'state';</code></pre>
<p>or by using the <code>-E</code> command-line switch in one-liners. See <a href="/cperl/perlsub.html#Persistent-Private-Variables">"Persistent Private Variables" in perlsub</a>.</p>
<h2 id="Stacked-filetest-operators">Stacked filetest operators</h2>
<p>As a new form of syntactic sugar, it's now possible to stack up filetest operators. You can now write <code>-f -w -x $file</code> in a row to mean <code>-x $file && -w _ && -f _</code>. See <a href="/cperl/perlfunc.html#X">"-X" in perlfunc</a>.</p>
<h2 id="UNIVERSAL::DOES">UNIVERSAL::DOES()</h2>
<p>The <code>UNIVERSAL</code> class has a new method, <code>DOES()</code>. It has been added to solve semantic problems with the <code>isa()</code> method. <code>isa()</code> checks for inheritance, while <code>DOES()</code> has been designed to be overridden when module authors use other types of relations between classes (in addition to inheritance). (chromatic)</p>
<p>See <a href="/cperl/lib/UNIVERSAL.html#obj--DOES-ROLE">"$obj->DOES( ROLE )" in UNIVERSAL</a>.</p>
<h2 id="Formats">Formats</h2>
<p>Formats were improved in several ways. A new field, <code>^*</code>, can be used for variable-width, one-line-at-a-time text. Null characters are now handled correctly in picture lines. Using <code>@#</code> and <code>~~</code> together will now produce a compile-time error, as those format fields are incompatible. <a href="/cperl/perlform.html">perlform</a> has been improved, and miscellaneous bugs fixed.</p>
<h2 id="Byte-order-modifiers-for-pack-and-unpack">Byte-order modifiers for pack() and unpack()</h2>
<p>There are two new byte-order modifiers, <code>></code> (big-endian) and <code><</code> (little-endian), that can be appended to most pack() and unpack() template characters and groups to force a certain byte-order for that type or group. See <a href="/cperl/perlfunc.html#pack">"pack" in perlfunc</a> and <a href="/cperl/perlpacktut.html">perlpacktut</a> for details.</p>
<h2 id="no-VERSION"><code>no VERSION</code></h2>
<p>You can now use <code>no</code> followed by a version number to specify that you want to use a version of perl older than the specified one.</p>
<h2 id="chdir-chmod-and-chown-on-filehandles"><code>chdir</code>, <code>chmod</code> and <code>chown</code> on filehandles</h2>
<p><code>chdir</code>, <code>chmod</code> and <code>chown</code> can now work on filehandles as well as filenames, if the system supports respectively <code>fchdir</code>, <code>fchmod</code> and <code>fchown</code>, thanks to a patch provided by Gisle Aas.</p>
<h2 id="OS-groups">OS groups</h2>
<p><code>$(</code> and <code>$)</code> now return groups in the order where the OS returns them, thanks to Gisle Aas. This wasn't previously the case.</p>
<h2 id="Recursive-sort-subs">Recursive sort subs</h2>
<p>You can now use recursive subroutines with sort(), thanks to Robin Houston.</p>
<h2 id="Exceptions-in-constant-folding">Exceptions in constant folding</h2>
<p>The constant folding routine is now wrapped in an exception handler, and if folding throws an exception (such as attempting to evaluate 0/0), perl now retains the current optree, rather than aborting the whole program. Without this change, programs would not compile if they had expressions that happened to generate exceptions, even though those expressions were in code that could never be reached at runtime. (Nicholas Clark, Dave Mitchell)</p>
<h2 id="Source-filters-in-INC">Source filters in @INC</h2>
<p>It's possible to enhance the mechanism of subroutine hooks in @INC by adding a source filter on top of the filehandle opened and returned by the hook. This feature was planned a long time ago, but wasn't quite working until now. See <a href="/cperl/perlfunc.html#require">"require" in perlfunc</a> for details. (Nicholas Clark)</p>
<h2 id="New-internal-variables">New internal variables</h2>
<dl>
<dt id="RE_DEBUG_FLAGS"><code>${^RE_DEBUG_FLAGS}</code></dt>
<dd>
<p>This variable controls what debug flags are in effect for the regular expression engine when running under <code>use re "debug"</code>. See <a href="/cperl/lib/re.html">re</a> for details.</p>
</dd>
<dt id="CHILD_ERROR_NATIVE"><code>${^CHILD_ERROR_NATIVE}</code></dt>
<dd>
<p>This variable gives the native status returned by the last pipe close, backtick command, successful call to wait() or waitpid(), or from the system() operator. See <a href="/cperl/perlvar.html">perlvar</a> for details. (Contributed by Gisle Aas.)</p>
</dd>
<dt id="RE_TRIE_MAXBUF"><code>${^RE_TRIE_MAXBUF}</code></dt>
<dd>
<p>See <a href="#Trie-optimisation-of-literal-string-alternations">"Trie optimisation of literal string alternations"</a>.</p>
</dd>
<dt id="WIN32_SLOPPY_STAT"><code>${^WIN32_SLOPPY_STAT}</code></dt>
<dd>
<p>See <a href="#Sloppy-stat-on-Windows">"Sloppy stat on Windows"</a>.</p>
</dd>
</dl>
<h2 id="Miscellaneous">Miscellaneous</h2>
<p><code>unpack()</code> now defaults to unpacking the <code>$_</code> variable.</p>
<p><code>mkdir()</code> without arguments now defaults to <code>$_</code>.</p>
<p>The internal dump output has been improved, so that non-printable characters such as newline and backspace are output in <code>\x</code> notation, rather than octal.</p>
<p>The <b>-C</b> option can no longer be used on the <code>#!</code> line. It wasn't working there anyway, since the standard streams are already set up at this point in the execution of the perl interpreter. You can use binmode() instead to get the desired behaviour.</p>
<h2 id="UCD-5.0.0">UCD 5.0.0</h2>
<p>The copy of the Unicode Character Database included in Perl 5 has been updated to version 5.0.0.</p>
<h2 id="MAD">MAD</h2>
<p>MAD, which stands for <i>Miscellaneous Attribute Decoration</i>, is a still-in-development work leading to a Perl 5 to Perl 6 converter. To enable it, it's necessary to pass the argument <code>-Dmad</code> to Configure. The obtained perl isn't binary compatible with a regular perl 5.10, and has space and speed penalties; moreover not all regression tests still pass with it. (Larry Wall, Nicholas Clark)</p>
<h2 id="kill-on-Windows">kill() on Windows</h2>
<p>On Windows platforms, <code>kill(-9, $pid)</code> now kills a process tree. (On Unix, this delivers the signal to all processes in the same process group.)</p>
<h1 id="Incompatible-Changes">Incompatible Changes</h1>
<h2 id="Packing-and-UTF-8-strings">Packing and UTF-8 strings</h2>
<p>The semantics of pack() and unpack() regarding UTF-8-encoded data has been changed. Processing is now by default character per character instead of byte per byte on the underlying encoding. Notably, code that used things like <code>pack("a*", $string)</code> to see through the encoding of string will now simply get back the original $string. Packed strings can also get upgraded during processing when you store upgraded characters. You can get the old behaviour by using <code>use bytes</code>.</p>
<p>To be consistent with pack(), the <code>C0</code> in unpack() templates indicates that the data is to be processed in character mode, i.e. character by character; on the contrary, <code>U0</code> in unpack() indicates UTF-8 mode, where the packed string is processed in its UTF-8-encoded Unicode form on a byte by byte basis. This is reversed with regard to perl 5.8.X, but now consistent between pack() and unpack().</p>
<p>Moreover, <code>C0</code> and <code>U0</code> can also be used in pack() templates to specify respectively character and byte modes.</p>
<p><code>C0</code> and <code>U0</code> in the middle of a pack or unpack format now switch to the specified encoding mode, honoring parens grouping. Previously, parens were ignored.</p>
<p>Also, there is a new pack() character format, <code>W</code>, which is intended to replace the old <code>C</code>. <code>C</code> is kept for unsigned chars coded as bytes in the strings internal representation. <code>W</code> represents unsigned (logical) character values, which can be greater than 255. It is therefore more robust when dealing with potentially UTF-8-encoded data (as <code>C</code> will wrap values outside the range 0..255, and not respect the string encoding).</p>
<p>In practice, that means that pack formats are now encoding-neutral, except <code>C</code>.</p>
<p>For consistency, <code>A</code> in unpack() format now trims all Unicode whitespace from the end of the string. Before perl 5.9.2, it used to strip only the classical ASCII space characters.</p>
<h2 id="Byte-character-count-feature-in-unpack">Byte/character count feature in unpack()</h2>
<p>A new unpack() template character, <code>"."</code>, returns the number of bytes or characters (depending on the selected encoding mode, see above) read so far.</p>
<h2 id="The-and-variables-have-been-removed">The <code>$*</code> and <code>$#</code> variables have been removed</h2>
<p><code>$*</code>, which was deprecated in favor of the <code>/s</code> and <code>/m</code> regexp modifiers, has been removed.</p>
<p>The deprecated <code>$#</code> variable (output format for numbers) has been removed.</p>
<p>Two new severe warnings, <code>$#/$* is no longer supported</code>, have been added.</p>
<h2 id="substr-lvalues-are-no-longer-fixed-length">substr() lvalues are no longer fixed-length</h2>
<p>The lvalues returned by the three argument form of substr() used to be a "fixed length window" on the original string. In some cases this could cause surprising action at distance or other undefined behaviour. Now the length of the window adjusts itself to the length of the string assigned to it.</p>
<h2 id="Parsing-of--f-_">Parsing of <code>-f _</code></h2>
<p>The identifier <code>_</code> is now forced to be a bareword after a filetest operator. This solves a number of misparsing issues when a global <code>_</code> subroutine is defined.</p>
<h2 id="unique"><code>:unique</code></h2>
<p>The <code>:unique</code> attribute has been made a no-op, since its current implementation was fundamentally flawed and not threadsafe.</p>
<h2 id="Effect-of-pragmas-in-eval">Effect of pragmas in eval</h2>
<p>The compile-time value of the <code>%^H</code> hint variable can now propagate into eval("")uated code. This makes it more useful to implement lexical pragmas.</p>
<p>As a side-effect of this, the overloaded-ness of constants now propagates into eval("").</p>
<h2 id="chdir-FOO">chdir FOO</h2>
<p>A bareword argument to chdir() is now recognized as a file handle. Earlier releases interpreted the bareword as a directory name. (Gisle Aas)</p>
<h2 id="Handling-of-.pmc-files">Handling of .pmc files</h2>
<p>An old feature of perl was that before <code>require</code> or <code>use</code> look for a file with a <i>.pm</i> extension, they will first look for a similar filename with a <i>.pmc</i> extension. If this file is found, it will be loaded in place of any potentially existing file ending in a <i>.pm</i> extension.</p>
<p>Previously, <i>.pmc</i> files were loaded only if more recent than the matching <i>.pm</i> file. Starting with 5.9.4, they'll be always loaded if they exist.</p>
<h2 id="V-is-now-a-version-object-instead-of-a-v-string">$^V is now a <code>version</code> object instead of a v-string</h2>
<p>$^V can still be used with the <code>%vd</code> format in printf, but any character-level operations will now access the string representation of the <code>version</code> object and not the ordinals of a v-string. Expressions like <code>substr($^V, 0, 2)</code> or <code>split //, $^V</code> no longer work and must be rewritten.</p>
<h2 id="and-in-patterns">@- and @+ in patterns</h2>
<p>The special arrays <code>@-</code> and <code>@+</code> are no longer interpolated in regular expressions. (Sadahiro Tomoyuki)</p>
<h2 id="AUTOLOAD-can-now-be-tainted">$AUTOLOAD can now be tainted</h2>
<p>If you call a subroutine by a tainted name, and if it defers to an AUTOLOAD function, then $AUTOLOAD will be (correctly) tainted. (Rick Delaney)</p>
<h2 id="Tainting-and-printf">Tainting and printf</h2>
<p>When perl is run under taint mode, <code>printf()</code> and <code>sprintf()</code> will now reject any tainted format argument. (Rafael Garcia-Suarez)</p>
<h2 id="undef-and-signal-handlers">undef and signal handlers</h2>
<p>Undefining or deleting a signal handler via <code>undef $SIG{FOO}</code> is now equivalent to setting it to <code>'DEFAULT'</code>. (Rafael Garcia-Suarez)</p>
<h2 id="strictures-and-dereferencing-in-defined">strictures and dereferencing in defined()</h2>
<p><code>use strict 'refs'</code> was ignoring taking a hard reference in an argument to defined(), as in :</p>
<pre><code> use strict 'refs';
my $x = 'foo';
if (defined $$x) {...}</code></pre>
<p>This now correctly produces the run-time error <code>Can't use string as a SCALAR ref while "strict refs" in use</code>.</p>
<p><code>defined @$foo</code> and <code>defined %$bar</code> are now also subject to <code>strict 'refs'</code> (that is, <code>$foo</code> and <code>$bar</code> shall be proper references there.) (<code>defined(@foo)</code> and <code>defined(%bar)</code> are discouraged constructs anyway.) (Nicholas Clark)</p>
<h2 id="p-has-been-removed"><code>(?p{})</code> has been removed</h2>
<p>The regular expression construct <code>(?p{})</code>, which was deprecated in perl 5.8, has been removed. Use <code>(??{})</code> instead. (Rafael Garcia-Suarez)</p>
<h2 id="Pseudo-hashes-have-been-removed">Pseudo-hashes have been removed</h2>
<p>Support for pseudo-hashes has been removed from Perl 5.9. (The <code>fields</code> pragma remains here, but uses an alternate implementation.)</p>
<h2 id="Removal-of-the-bytecode-compiler-and-of-perlcc">Removal of the bytecode compiler and of perlcc</h2>
<p><code>perlcc</code>, the byteloader and the supporting modules (B::C, B::CC, B::Bytecode, etc.) are no longer distributed with the perl sources. Those experimental tools have never worked reliably, and, due to the lack of volunteers to keep them in line with the perl interpreter developments, it was decided to remove them instead of shipping a broken version of those. The last version of those modules can be found with perl 5.9.4.</p>
<p>However the B compiler framework stays supported in the perl core, as with the more useful modules it has permitted (among others, B::Deparse and B::Concise).</p>
<h2 id="Removal-of-the-JPL">Removal of the JPL</h2>
<p>The JPL (Java-Perl Lingo) has been removed from the perl sources tarball.</p>
<h2 id="Recursive-inheritance-detected-earlier">Recursive inheritance detected earlier</h2>
<p>Perl will now immediately throw an exception if you modify any package's <code>@ISA</code> in such a way that it would cause recursive inheritance.</p>
<p>Previously, the exception would not occur until Perl attempted to make use of the recursive inheritance while resolving a method or doing a <code>$foo->isa($bar)</code> lookup.</p>
<h2 id="warnings::enabled-and-warnings::warnif-changed-to-favor-users-of-modules">warnings::enabled and warnings::warnif changed to favor users of modules</h2>
<p>The behaviour in 5.10.x favors the person using the module; The behaviour in 5.8.x favors the module writer;</p>
<p>Assume the following code:</p>
<pre><code> main calls Foo::Bar::baz()
Foo::Bar inherits from Foo::Base
Foo::Bar::baz() calls Foo::Base::_bazbaz()
Foo::Base::_bazbaz() calls: warnings::warnif('substr', 'some warning
message');</code></pre>
<p>On 5.8.x, the code warns when Foo::Bar contains <code>use warnings;</code> It does not matter if Foo::Base or main have warnings enabled to disable the warning one has to modify Foo::Bar.</p>
<p>On 5.10.0 and newer, the code warns when main contains <code>use warnings;</code> It does not matter if Foo::Base or Foo::Bar have warnings enabled to disable the warning one has to modify main.</p>
<h1 id="Modules-and-Pragmata">Modules and Pragmata</h1>
<h2 id="Upgrading-individual-core-modules">Upgrading individual core modules</h2>
<p>Even more core modules are now also available separately through the CPAN. If you wish to update one of these modules, you don't need to wait for a new perl release. From within the cpan shell, running the 'r' command will report on modules with upgrades available. See <code>perldoc CPAN</code> for more information.</p>
<h2 id="Pragmata-Changes">Pragmata Changes</h2>
<dl>
<dt id="feature"><code>feature</code></dt>
<dd>
<p>The new pragma <code>feature</code> is used to enable new features that might break old code. See <a href="#The-feature-pragma">"The <code>feature</code> pragma"</a> above.</p>
</dd>
<dt id="mro"><code>mro</code></dt>
<dd>
<p>This new pragma enables to change the algorithm used to resolve inherited methods. See <a href="#New-Pragma-mro">"New Pragma, <code>mro</code>"</a> above.</p>
</dd>
<dt id="Scoping-of-the-sort-pragma">Scoping of the <code>sort</code> pragma</dt>
<dd>
<p>The <code>sort</code> pragma is now lexically scoped. Its effect used to be global.</p>
</dd>
<dt id="Scoping-of-bignum-bigint-bigrat">Scoping of <code>bignum</code>, <code>bigint</code>, <code>bigrat</code></dt>
<dd>
<p>The three numeric pragmas <code>bignum</code>, <code>bigint</code> and <code>bigrat</code> are now lexically scoped. (Tels)</p>
</dd>
<dt id="base"><code>base</code></dt>
<dd>
<p>The <code>base</code> pragma now warns if a class tries to inherit from itself. (Curtis "Ovid" Poe)</p>
</dd>
<dt id="strict-and-warnings"><code>strict</code> and <code>warnings</code></dt>
<dd>
<p><code>strict</code> and <code>warnings</code> will now complain loudly if they are loaded via incorrect casing (as in <code>use Strict;</code>). (Johan Vromans)</p>
</dd>
<dt id="version"><code>version</code></dt>
<dd>
<p>The <code>version</code> module provides support for version objects.</p>
</dd>
<dt id="warnings"><code>warnings</code></dt>
<dd>
<p>The <code>warnings</code> pragma doesn't load <code>Carp</code> anymore. That means that code that used <code>Carp</code> routines without having loaded it at compile time might need to be adjusted; typically, the following (faulty) code won't work anymore, and will require parentheses to be added after the function name:</p>
<pre><code> use warnings;
require Carp;
Carp::confess 'argh';</code></pre>
</dd>
<dt id="less"><code>less</code></dt>
<dd>
<p><code>less</code> now does something useful (or at least it tries to). In fact, it has been turned into a lexical pragma. So, in your modules, you can now test whether your users have requested to use less CPU, or less memory, less magic, or maybe even less fat. See <a href="/cperl/lib/less.html">less</a> for more. (Joshua ben Jore)</p>
</dd>
</dl>
<h2 id="New-modules">New modules</h2>
<ul>
<li><p><code>encoding::warnings</code>, by Audrey Tang, is a module to emit warnings whenever an ASCII character string containing high-bit bytes is implicitly converted into UTF-8. It's a lexical pragma since Perl 5.9.4; on older perls, its effect is global.</p>
</li>
<li><p><code>Module::CoreList</code>, by Richard Clamp, is a small handy module that tells you what versions of core modules ship with any versions of Perl 5. It comes with a command-line frontend, <code>corelist</code>.</p>
</li>
<li><p><code>Math::BigInt::FastCalc</code> is an XS-enabled, and thus faster, version of <code>Math::BigInt::Calc</code>.</p>
</li>
<li><p><code>Compress::Zlib</code> is an interface to the zlib compression library. It comes with a bundled version of zlib, so having a working zlib is not a prerequisite to install it. It's used by <code>Archive::Tar</code> (see below).</p>
</li>
<li><p><code>IO::Zlib</code> is an <code>IO::</code>-style interface to <code>Compress::Zlib</code>.</p>
</li>
<li><p><code>Archive::Tar</code> is a module to manipulate <code>tar</code> archives.</p>
</li>
<li><p><code>Digest::SHA</code> is a module used to calculate many types of SHA digests, has been included for SHA support in the CPAN module.</p>
</li>
<li><p><code>ExtUtils::CBuilder</code> and <code>ExtUtils::ParseXS</code> have been added.</p>
</li>
<li><p><code>Hash::Util::FieldHash</code>, by Anno Siegel, has been added. This module provides support for <i>field hashes</i>: hashes that maintain an association of a reference with a value, in a thread-safe garbage-collected way. Such hashes are useful to implement inside-out objects.</p>
</li>
<li><p><code>Module::Build</code>, by Ken Williams, has been added. It's an alternative to <code>ExtUtils::MakeMaker</code> to build and install perl modules.</p>
</li>
<li><p><code>Module::Load</code>, by Jos Boumans, has been added. It provides a single interface to load Perl modules and <i>.pl</i> files.</p>
</li>
<li><p><code>Module::Loaded</code>, by Jos Boumans, has been added. It's used to mark modules as loaded or unloaded.</p>
</li>
<li><p><code>Package::Constants</code>, by Jos Boumans, has been added. It's a simple helper to list all constants declared in a given package.</p>
</li>
<li><p><code>Win32API::File</code>, by Tye McQueen, has been added (for Windows builds). This module provides low-level access to Win32 system API calls for files/dirs.</p>
</li>
<li><p><code>Locale::Maketext::Simple</code>, needed by CPANPLUS, is a simple wrapper around <code>Locale::Maketext::Lexicon</code>. Note that <code>Locale::Maketext::Lexicon</code> isn't included in the perl core; the behaviour of <code>Locale::Maketext::Simple</code> gracefully degrades when the later isn't present.</p>
</li>
<li><p><code>Params::Check</code> implements a generic input parsing/checking mechanism. It is used by CPANPLUS.</p>
</li>
<li><p><code>Term::UI</code> simplifies the task to ask questions at a terminal prompt.</p>
</li>
<li><p><code>Object::Accessor</code> provides an interface to create per-object accessors.</p>
</li>
<li><p><code>Module::Pluggable</code> is a simple framework to create modules that accept pluggable sub-modules.</p>
</li>
<li><p><code>Module::Load::Conditional</code> provides simple ways to query and possibly load installed modules.</p>
</li>
<li><p><code>Time::Piece</code> provides an object oriented interface to time functions, overriding the built-ins localtime() and gmtime().</p>
</li>
<li><p><code>IPC::Cmd</code> helps to find and run external commands, possibly interactively.</p>
</li>
<li><p><code>File::Fetch</code> provide a simple generic file fetching mechanism.</p>
</li>
<li><p><code>Log::Message</code> and <code>Log::Message::Simple</code> are used by the log facility of <code>CPANPLUS</code>.</p>
</li>
<li><p><code>Archive::Extract</code> is a generic archive extraction mechanism for <i>.tar</i> (plain, gzipped or bzipped) or <i>.zip</i> files.</p>
</li>
<li><p><code>CPANPLUS</code> provides an API and a command-line tool to access the CPAN mirrors.</p>
</li>
<li><p><code>Pod::Escapes</code> provides utilities that are useful in decoding Pod E<...> sequences.</p>
</li>
<li><p><code>Pod::Simple</code> is now the backend for several of the Pod-related modules included with Perl.</p>
</li>
</ul>
<h2 id="Selected-Changes-to-Core-Modules">Selected Changes to Core Modules</h2>
<dl>
<dt id="Attribute::Handlers"><code>Attribute::Handlers</code></dt>
<dd>
<p><code>Attribute::Handlers</code> can now report the caller's file and line number. (David Feldman)</p>
<p>All interpreted attributes are now passed as array references. (Damian Conway)</p>
</dd>
<dt id="B::Lint"><code>B::Lint</code></dt>
<dd>
<p><code>B::Lint</code> is now based on <code>Module::Pluggable</code>, and so can be extended with plugins. (Joshua ben Jore)</p>
</dd>
<dt id="B"><code>B</code></dt>
<dd>
<p>It's now possible to access the lexical pragma hints (<code>%^H</code>) by using the method B::COP::hints_hash(). It returns a <code>B::RHE</code> object, which in turn can be used to get a hash reference via the method B::RHE::HASH(). (Joshua ben Jore)</p>
</dd>
<dt id="Thread"><code>Thread</code></dt>
<dd>
<p>As the old 5005thread threading model has been removed, in favor of the ithreads scheme, the <code>Thread</code> module is now a compatibility wrapper, to be used in old code only. It has been removed from the default list of dynamic extensions.</p>
</dd>
</dl>
<h1 id="Utility-Changes">Utility Changes</h1>
<dl>
<dt id="perl--d">perl -d</dt>
<dd>
<p>The Perl debugger can now save all debugger commands for sourcing later; notably, it can now emulate stepping backwards, by restarting and rerunning all bar the last command from a saved command history.</p>
<p>It can also display the parent inheritance tree of a given class, with the <code>i</code> command.</p>
</dd>
<dt id="ptar">ptar</dt>
<dd>
<p><code>ptar</code> is a pure perl implementation of <code>tar</code> that comes with <code>Archive::Tar</code>.</p>
</dd>
<dt id="ptardiff">ptardiff</dt>
<dd>
<p><code>ptardiff</code> is a small utility used to generate a diff between the contents of a tar archive and a directory tree. Like <code>ptar</code>, it comes with <code>Archive::Tar</code>.</p>
</dd>
<dt id="shasum">shasum</dt>
<dd>
<p><code>shasum</code> is a command-line utility, used to print or to check SHA digests. It comes with the new <code>Digest::SHA</code> module.</p>
</dd>
<dt id="corelist">corelist</dt>
<dd>
<p>The <code>corelist</code> utility is now installed with perl (see <a href="#New-modules">"New modules"</a> above).</p>
</dd>
<dt id="h2ph-and-h2xs">h2ph and h2xs</dt>
<dd>
<p><code>h2ph</code> and <code>h2xs</code> have been made more robust with regard to "modern" C code.</p>
<p><code>h2xs</code> implements a new option <code>--use-xsloader</code> to force use of <code>XSLoader</code> even in backwards compatible modules.</p>
<p>The handling of authors' names that had apostrophes has been fixed.</p>
<p>Any enums with negative values are now skipped.</p>
</dd>
<dt id="perlivp">perlivp</dt>
<dd>
<p><code>perlivp</code> no longer checks for <i>*.ph</i> files by default. Use the new <code>-a</code> option to run <i>all</i> tests.</p>
</dd>
<dt id="find2perl">find2perl</dt>
<dd>
<p><code>find2perl</code> now assumes <code>-print</code> as a default action. Previously, it needed to be specified explicitly.</p>
<p>Several bugs have been fixed in <code>find2perl</code>, regarding <code>-exec</code> and <code>-eval</code>. Also the options <code>-path</code>, <code>-ipath</code> and <code>-iname</code> have been added.</p>
</dd>
<dt id="config_data">config_data</dt>
<dd>
<p><code>config_data</code> is a new utility that comes with <code>Module::Build</code>. It provides a command-line interface to the configuration of Perl modules that use Module::Build's framework of configurability (that is, <code>*::ConfigData</code> modules that contain local configuration information for their parent modules.)</p>
</dd>
<dt id="cpanp">cpanp</dt>
<dd>
<p><code>cpanp</code>, the CPANPLUS shell, has been added. (<code>cpanp-run-perl</code>, a helper for CPANPLUS operation, has been added too, but isn't intended for direct use).</p>
</dd>
<dt id="cpan2dist">cpan2dist</dt>
<dd>
<p><code>cpan2dist</code> is a new utility that comes with CPANPLUS. It's a tool to create distributions (or packages) from CPAN modules.</p>
</dd>
<dt id="pod2html">pod2html</dt>
<dd>
<p>The output of <code>pod2html</code> has been enhanced to be more customizable via CSS. Some formatting problems were also corrected. (Jari Aalto)</p>
</dd>
</dl>
<h1 id="New-Documentation">New Documentation</h1>
<p>The <a href="/cperl/perlpragma.html">perlpragma</a> manpage documents how to write one's own lexical pragmas in pure Perl (something that is possible starting with 5.9.4).</p>
<p>The new <a href="/cperl/lib/perlglossary.html">perlglossary</a> manpage is a glossary of terms used in the Perl documentation, technical and otherwise, kindly provided by O'Reilly Media, Inc.</p>
<p>The <a href="/cperl/perlreguts.html">perlreguts</a> manpage, courtesy of Yves Orton, describes internals of the Perl regular expression engine.</p>
<p>The <a href="/cperl/perlreapi.html">perlreapi</a> manpage describes the interface to the perl interpreter used to write pluggable regular expression engines (by Ævar Arnfjörð Bjarmason).</p>
<p>The <a href="/cperl/perlunitut.html">perlunitut</a> manpage is a tutorial for programming with Unicode and string encodings in Perl, courtesy of Juerd Waalboer.</p>
<p>A new manual page, <a href="/cperl/perlunifaq.html">perlunifaq</a> (the Perl Unicode FAQ), has been added (Juerd Waalboer).</p>
<p>The <a href="/cperl/perlcommunity.html">perlcommunity</a> manpage gives a description of the Perl community on the Internet and in real life. (Edgar "Trizor" Bering)</p>
<p>The <a href="/cperl/lib/CORE.html">CORE</a> manual page documents the <code>CORE::</code> namespace. (Tels)</p>
<p>The long-existing feature of <code>/(?{...})/</code> regexps setting <code>$_</code> and pos() is now documented.</p>
<h1 id="Performance-Enhancements">Performance Enhancements</h1>
<h2 id="In-place-sorting">In-place sorting</h2>
<p>Sorting arrays in place (<code>@a = sort @a</code>) is now optimized to avoid making a temporary copy of the array.</p>
<p>Likewise, <code>reverse sort ...</code> is now optimized to sort in reverse, avoiding the generation of a temporary intermediate list.</p>
<h2 id="Lexical-array-access">Lexical array access</h2>
<p>Access to elements of lexical arrays via a numeric constant between 0 and 255 is now faster. (This used to be only the case for global arrays.)</p>
<h2 id="XS-assisted-SWASHGET">XS-assisted SWASHGET</h2>
<p>Some pure-perl code that perl was using to retrieve Unicode properties and transliteration mappings has been reimplemented in XS.</p>
<h2 id="Constant-subroutines">Constant subroutines</h2>
<p>The interpreter internals now support a far more memory efficient form of inlineable constants. Storing a reference to a constant value in a symbol table is equivalent to a full typeglob referencing a constant subroutine, but using about 400 bytes less memory. This proxy constant subroutine is automatically upgraded to a real typeglob with subroutine if necessary. The approach taken is analogous to the existing space optimisation for subroutine stub declarations, which are stored as plain scalars in place of the full typeglob.</p>
<p>Several of the core modules have been converted to use this feature for their system dependent constants - as a result <code>use POSIX;</code> now takes about 200K less memory.</p>
<h2 id="PERL_DONT_CREATE_GVSV"><code>PERL_DONT_CREATE_GVSV</code></h2>
<p>The new compilation flag <code>PERL_DONT_CREATE_GVSV</code>, introduced as an option in perl 5.8.8, is turned on by default in perl 5.9.3. It prevents perl from creating an empty scalar with every new typeglob. See <a href="/cperl/perl589delta.html">perl589delta</a> for details.</p>
<h2 id="Weak-references-are-cheaper">Weak references are cheaper</h2>
<p>Weak reference creation is now <i>O(1)</i> rather than <i>O(n)</i>, courtesy of Nicholas Clark. Weak reference deletion remains <i>O(n)</i>, but if deletion only happens at program exit, it may be skipped completely.</p>
<h2 id="sort-enhancements">sort() enhancements</h2>
<p>Salvador Fandiño provided improvements to reduce the memory usage of <code>sort</code> and to speed up some cases.</p>
<h2 id="Memory-optimisations">Memory optimisations</h2>
<p>Several internal data structures (typeglobs, GVs, CVs, formats) have been restructured to use less memory. (Nicholas Clark)</p>
<h2 id="UTF-8-cache-optimisation">UTF-8 cache optimisation</h2>
<p>The UTF-8 caching code is now more efficient, and used more often. (Nicholas Clark)</p>
<h2 id="Sloppy-stat-on-Windows">Sloppy stat on Windows</h2>
<p>On Windows, perl's stat() function normally opens the file to determine the link count and update attributes that may have been changed through hard links. Setting ${^WIN32_SLOPPY_STAT} to a true value speeds up stat() by not performing this operation. (Jan Dubois)</p>
<h2 id="Regular-expressions-optimisations">Regular expressions optimisations</h2>
<dl>
<dt id="Engine-de-recursivised">Engine de-recursivised</dt>
<dd>
<p>The regular expression engine is no longer recursive, meaning that patterns that used to overflow the stack will either die with useful explanations, or run to completion, which, since they were able to blow the stack before, will likely take a very long time to happen. If you were experiencing the occasional stack overflow (or segfault) and upgrade to discover that now perl apparently hangs instead, look for a degenerate regex. (Dave Mitchell)</p>
</dd>
<dt id="Single-char-char-classes-treated-as-literals">Single char char-classes treated as literals</dt>
<dd>
<p>Classes of a single character are now treated the same as if the character had been used as a literal, meaning that code that uses char-classes as an escaping mechanism will see a speedup. (Yves Orton)</p>
</dd>
<dt id="Trie-optimisation-of-literal-string-alternations">Trie optimisation of literal string alternations</dt>
<dd>
<p>Alternations, where possible, are optimised into more efficient matching structures. String literal alternations are merged into a trie and are matched simultaneously. This means that instead of O(N) time for matching N alternations at a given point, the new code performs in O(1) time. A new special variable, ${^RE_TRIE_MAXBUF}, has been added to fine-tune this optimization. (Yves Orton)</p>
<p><b>Note:</b> Much code exists that works around perl's historic poor performance on alternations. Often the tricks used to do so will disable the new optimisations. Hopefully the utility modules used for this purpose will be educated about these new optimisations.</p>
</dd>
<dt id="Aho-Corasick-start-point-optimisation">Aho-Corasick start-point optimisation</dt>
<dd>
<p>When a pattern starts with a trie-able alternation and there aren't better optimisations available, the regex engine will use Aho-Corasick matching to find the start point. (Yves Orton)</p>
</dd>
</dl>
<h1 id="Installation-and-Configuration-Improvements">Installation and Configuration Improvements</h1>
<h2 id="Configuration-improvements">Configuration improvements</h2>
<dl>
<dt id="Dusesitecustomize"><code>-Dusesitecustomize</code></dt>
<dd>
<p>Run-time customization of @INC can be enabled by passing the <code>-Dusesitecustomize</code> flag to Configure. When enabled, this will make perl run <i>$sitelibexp/sitecustomize.pl</i> before anything else. This script can then be set up to add additional entries to @INC.</p>
</dd>
<dt id="Relocatable-installations">Relocatable installations</dt>
<dd>
<p>There is now Configure support for creating a relocatable perl tree. If you Configure with <code>-Duserelocatableinc</code>, then the paths in @INC (and everything else in %Config) can be optionally located via the path of the perl executable.</p>
<p>That means that, if the string <code>".../"</code> is found at the start of any path, it's substituted with the directory of $^X. So, the relocation can be configured on a per-directory basis, although the default with <code>-Duserelocatableinc</code> is that everything is relocated. The initial install is done to the original configured prefix.</p>
</dd>
<dt id="strlcat-and-strlcpy">strlcat() and strlcpy()</dt>
<dd>
<p>The configuration process now detects whether strlcat() and strlcpy() are available. When they are not available, perl's own version is used (from Russ Allbery's public domain implementation). Various places in the perl interpreter now use them. (Steve Peters)</p>
</dd>
<dt id="d_pseudofork-and-d_printf_format_null"><code>d_pseudofork</code> and <code>d_printf_format_null</code></dt>
<dd>
<p>A new configuration variable, available as <code>$Config{d_pseudofork}</code> in the <a href="/cperl/lib/Config.html">Config</a> module, has been added, to distinguish real fork() support from fake pseudofork used on Windows platforms.</p>