Kalli nassin da ke ƙasa sannan ka amsa tambayar daga baya a cikin harshe ɗaya kamar nassin: Nassi: Ana bayyana alamomi sau da yawa ta hanyar maganganu na yau da kullun, wanda janareta mai nazarin lexical kamar lex ya fahimta. Mai nazarin lexical (wanda aka kirkira ta atomatik ta hanyar kayan aiki kamar lex, ko aikin hannu) yana karantawa a cikin rafin haruffa, yana gano lexemes a cikin rafin, kuma ya rarraba su cikin alamomi. Wannan ana kiransa tokenizing. Idan lexer ya sami alamar mara inganci, zai ba da rahoton kuskure. Tambaya: Menene zai samu idan ya ba da rahoton kuskure?
ba daidai ba alama