General Functions > Configuring the MIE (Programmer's Guide) > Alternate Language Support > Tokenizer

There are some specific text and/or areas within text that will be ignored by the Tokenizer. Ignored areas are as follows (case insensitive):

1. Any area that begins with "<script". All content from that point until (and including) the "</script" end tag will be ignored.

2. Any area that begins with "<style". All content from that point until (and including) the "</style" end tag will be ignored.

Any ESI merge tags for the following variables will be ignored and not tokenized (case insensitive):

1. StoreInSN550

2. RecStatus550

3. RrecordSource550

4. InstalledStatus550

5. PurchasedStatus550

6. ReceivedStatus550

7. RetiredStatus550

8. DisposedStatus550

9. HKeyField550

10. HBuilding550

11. HBuildingRemove550

12. HKeyValue550

13. HCarryForward550

14. StatChg1550

Any line that begins with the following ESI and HTML constructs will be ignored (case insensitive):

1. %|

2. HEADER|%

3. FOOTER|%

4. ^^

5. REPEAT|%

6. %}

7. {%ORDERAREA

8. {%STEP

9. LU=

10. DIV

11. [%LOOKUP

12. {%PAGEHEADER

13. [%CUSTLOGO

14 {%STYLE~~

15. {%VALIDATE~~

Ignored Areas