About: Lexical analysis

An Entity of Type: Thing, from Named Graph: http://dbpedia.org, within Data Space: dbpedia-live.demo.openlinksw.com

Computing process of parsing a sequence of characters into a sequence of tokens

Property	Value
dbo:description	프로그래밍 언어를 처리하는 처리하는 최초의 단계 (ko) 文字列を解析してトークン列に分解する計算処理 (ja) процесс разбора входной последовательности символов на лексемы (ru) Computerprogramm zur Zerlegung von Plain text (de) computing process of parsing a sequence of characters into a sequence of tokens (en) datorprocess som tolkar en sträng av tecken och ger en sträng av lexikalska enheter (sv) transformation d'une suite de caractères (un texte) en une suite de mots, appelés lexèmes (fr) 将输入的字符序列转换为单词符号序列的过程 (zh)
dbo:wikiPageExternalLink	http://people.cs.nctu.edu.tw/~wuuyang/homepage/papers/applicability2002.ps https://www.ibm.com/developerworks/community/blogs/nlp/entry/tokenization http://www.gabormelli.com/RKB/Word_Mention_Segmentation_Task https://web.archive.org/web/20190530155339/https:/www.ibm.com/developerworks/community/blogs/nlp/entry/tokenization%3Flang=en
dbo:wikiPageWikiLink	dbr:Backtracking dbr:Integer_literal dbr:Domain-specific_language dbr:Syntax_(programming_languages) dbc:Compiler_construction dbc:Programming_language_implementation dbr:Whitespace_character dbr:Flex_(lexical_analyser_generator) dbr:GNU_Bison dbr:Reserved_word dbr:Lint_(software) dbr:Ancient_Greek dbr:Character_(computing) dbr:Emoticon dbr:Natural_language dbr:Natural_language_processing dbr:Part_of_speech dbr:Web_page dbr:Abstract_syntax_tree dbr:Literal_(computer_programming) dbr:Word_(computer_architecture) dbr:Lexeme dbr:Formal_grammar dbr:Statement_(computer_science) dbr:Identifier_(computer_languages) dbr:Maximal_munch dbc:Parsing dbr:Newline dbr:English_language dbr:JavaScript dbc:Lexical_analysis dbr:Lex_(software) dbr:Yacc dbr:Parser dbr:Parsing dbr:Block_(programming) dbr:Operator_(computer_programming) dbr:Scriptio_continua dbr:Off-side_rule dbr:Chinese_language dbr:Programming_language dbr:Thai_language dbr:Word dbr:Data_type dbr:Finite-state_machine dbr:Structure_and_Interpretation_of_Computer_Programs dbr:Lexical_grammar dbr:C_(programming_language) dbr:Computer_science dbr:Computer_program dbr:Go_(programming_language) dbr:Numerical_digit dbr:ALGOL dbr:Bash_(Unix_shell) dbr:Comment_(computer_programming) dbr:Regular_expression dbr:Language_model dbr:Typedef dbr:Morpheme dbr:Context-free_grammar dbr:Poetic_contraction dbr:Regular_language dbr:BCPL dbr:Delimiter dbr:Stropping_(syntax) dbr:Agglutinative_language dbr:Hyphen dbr:String_(computer_science) dbr:Prettyprint dbr:Python_(programming_language) dbr:Re2c dbr:String_literal dbr:Semantic_analysis_(compilers) dbr:Compiling dbr:Flag_(computing) dbr:Parser_generator dbr:The_lexer_hack dbr:Line_continuation dbr:Line_reconstruction dbr:State_transition_table dbr:URI dbr:Defensive_semicolon dbr:Compiler_frontend dbr:List_of_parser_generators dbr:Trailing_comma
dbp:wikiPageUsesTemplate	dbt:Natural_Language_Processing dbt:Cite_web dbt:Reflist dbt:Redirect dbt:Code dbt:Cite_journal dbt:See_also dbt:Further dbt:Dubious dbt:ISBN dbt:Refend dbt:Refbegin dbt:Citation_needed dbt:Distinguish dbt:Also dbt:Short_description
dct:subject	dbc:Compiler_construction dbc:Programming_language_implementation dbc:Parsing dbc:Lexical_analysis
gold:hypernym	dbr:Process
rdfs:label	Lexical analysis (en) تحليل المفردات (ar) Anàlisi lèxica (ca) Lexikální analýza (cs) Λεκτική ανάλυση (el) Lexikalische Analyse (de) Analizador léxico (es) Analisis leksikal (in) Analyse lexicale (fr) 字句解析 (ja) Analisi lessicale (it) 낱말 분석 (ko) Lexicale analyse (nl) Analiza leksykalna (pl) Análise léxica (pt) Лексический анализ (ru) Лексичний аналіз (uk) Lexikalanalys (sv) 词法分析 (zh)
rdfs:seeAlso	dbr:Compiler-compiler dbr:Word
owl:differentFrom	dbr:Large_language_model dbr:Tokenization_(data_security)
owl:sameAs	yago-res:Lexical analysis freebase:Lexical analysis wikidata:Lexical analysis dbpedia-it:Lexical analysis dbpedia-nl:Lexical analysis dbpedia-de:Lexical analysis dbpedia-fr:Lexical analysis dbpedia-tr:Lexical analysis dbpedia-zh:Lexical analysis dbpedia-ja:Lexical analysis dbpedia-pt:Lexical analysis dbpedia-he:Lexical analysis dbpedia-da:Lexical analysis dbpedia-es:Lexical analysis dbpedia-fa:Lexical analysis dbpedia-ru:Lexical analysis dbpedia-sv:Lexical analysis dbpedia-vi:Lexical analysis dbpedia-pl:Lexical analysis dbpedia-ko:Lexical analysis dbpedia-id:Lexical analysis dbpedia-el:Lexical analysis dbpedia-ca:Lexical analysis dbpedia-ar:Lexical analysis dbpedia-az:Lexical analysis dbpedia-cs:Lexical analysis dbpedia-hr:Lexical analysis dbpedia-hy:Lexical analysis dbpedia-mk:Lexical analysis dbpedia-ms:Lexical analysis dbpedia-no:Lexical analysis dbpedia-sr:Lexical analysis dbpedia-ta:Lexical analysis dbpedia-uk:Lexical analysis dbpedia-global:Lexical analysis dbr:Lexical analysis
prov:wasDerivedFrom	wikipedia-en:Lexical_analysis?oldid=1292066921&ns=0
foaf:isPrimaryTopicOf	wikipedia-en:Lexical_analysis
is dbo:genre of	dbr:Flex_(lexical_analyser_generator) dbr:Re2c dbr:RE/flex
is dbo:wikiPageDisambiguates of	dbr:Lexical
is dbo:wikiPageRedirects of	dbr:Lexical_token dbr:Tokenization_(lexical_analysis) dbr:Automatic_semicolon_insertion dbr:Token_(parser) dbr:Token_scanner dbr:Token_splitting dbr:Tokenise dbr:Tokeniser dbr:Tokenize dbr:Tokenized dbr:Tokenizer dbr:Tokenizing dbr:Lexeme_(computer_science) dbr:Lexer dbr:Lexer_(computer_science) dbr:Lexer_generator dbr:Lexers dbr:Lexical_Analysis dbr:Lexical_analyser dbr:Lexical_analyzer dbr:Lexical_parser dbr:Lexical_syntax dbr:Lexing dbr:List_of_lexer_generators dbr:Scanner_(computing) dbr:Semicolon_insertion
is dbo:wikiPageWikiLink of	dbr:BASIC_Stamp dbr:List_of_formal_language_and_literal_string_topics dbr:Haskell_Platform dbr:Integer_literal dbr:Turkoman_(ethnonym) dbr:Uniform_Resource_Identifier dbr:Bell_Labs dbr:Text_mining dbr:Domain-specific_language dbr:Enterprise_search dbr:Text_segmentation dbr:C_Sharp_(programming_language) dbr:Syntax_(programming_languages) dbr:XML dbr:Compiler dbr:JavaScript_syntax dbr:Flex_(lexical_analyser_generator) dbr:GW-BASIC dbr:GNU_Bison dbr:TeXstudio dbr:Translation_unit_(programming) dbr:Stack-oriented_programming dbr:Glasgow_Haskell_Compiler dbr:Haskell_features dbr:Uralic_languages dbr:Literal_(computer_programming) dbr:Parboiled_(Java) dbr:ANTLR dbr:List_of_programming_languages_by_type dbr:Coco/R dbr:Book_of_Dede_Korkut dbr:Cohesion_(computer_science) dbr:C_shell dbr:Identifier_(computer_languages) dbr:Earley_parser dbr:Rule-based_system dbr:Spider_trap dbr:Shallow_parsing dbr:Ragel dbr:English-Arabic_Parallel_Corpus_of_United_Nations_Texts dbr:Eqn_(software) dbr:Marathi_language dbr:MySQL dbr:Lex_(software) dbr:Parsing dbr:OCaml dbr:GFA_BASIC dbr:LR_parser dbr:TI-BASIC dbr:Operator_(computer_programming) dbr:General_Architecture_for_Text_Engineering dbr:Deterministic_finite_automaton dbr:Lexical_token dbr:Printf_format_string dbr:Tokenization_(lexical_analysis) dbr:Off-side_rule dbr:Apache_cTAKES dbr:Microsoft_Phoenix dbr:Patrick_Hanks dbr:Programming_language dbr:Analysis dbr:Finite-state_machine dbr:IBM_BASIC dbr:Lexicology dbr:Minimalist_program dbr:Scanner dbr:Doxygen dbr:43_Things dbr:Analyser dbr:HP_Time-Shared_BASIC dbr:Lexical_grammar dbr:Lexer_hack dbr:Camel_case dbr:The_Art_of_Computer_Programming dbr:Eric_Schmidt dbr:Kenneth_E._Iverson dbr:Regular_expression dbr:Scope_(computer_science) dbr:Standard_Generalized_Markup_Language dbr:Semantic_analysis_(linguistics) dbr:XPL dbr:Automata-based_programming dbr:Google_Ngram_Viewer dbr:Automatic_semicolon_insertion dbr:PDF dbr:Perl dbr:Metaprogramming dbr:JavaCC dbr:Asymmetry dbr:Here_document dbr:Natural_Language_Toolkit dbr:Symbol_table dbr:Dartmouth_BASIC dbr:Search_engine_indexing dbr:SYNTAX dbr:History_of_compiler_construction dbr:GRASS_(programming_language) dbr:Direct_voice_input dbr:Stropping_(syntax) dbr:Scannerless_parsing dbr:PQCC dbr:Interpreter_(computing) dbr:Preprocessor dbr:List_of_algorithms dbr:Pattern_matching dbr:VTD-XML dbr:GLib dbr:Library_management dbr:Lemon_(parser_generator) dbr:Shift-reduce_parser dbr:RiTa dbr:Software_bug dbr:BASIC_interpreter dbr:C_syntax dbr:ZX80_character_set dbr:Finite-state_transducer dbr:Compilers:_Principles,_Techniques,_and_Tools dbr:Content_similarity_detection dbr:Comparison_of_programming_languages_(syntax) dbr:Software_development_effort_estimation dbr:Binary_Application_Markup_Language dbr:JetPAG dbr:Perl_virtual_machine dbr:Raku_rules dbr:Locomotive_BASIC dbr:Seed7 dbr:Sigil_(computer_programming) dbr:Programming_language_theory dbr:One_Definition_Rule dbr:Precompiled_header dbr:BulNet dbr:Language-based_security dbr:Re2c dbr:Recursive_transition_network dbr:Software_forensics dbr:String_literal dbr:BASIC09 dbr:ULTRA_(machine_translation_system) dbr:Roslyn_(compiler) dbr:Toi_(programming_language) dbr:Criticism_of_C++ dbr:SGLR dbr:Sarah_(chimpanzee) dbr:Name_resolution_(programming_languages) dbr:RIPS dbr:RE/flex dbr:S/SL_programming_language dbr:ZX81_character_set dbr:TenTen_Corpus_Family dbr:Parameter_word dbr:Irony_(framework) dbr:Gastarbeiterdeutsch dbr:Ruzzo–Tompa_algorithm dbr:ZPE_Programming_Environment dbr:Lexical dbr:Semantria dbr:Attention_(machine_learning) dbr:Token_(parser) dbr:Token_scanner dbr:Token_splitting dbr:Tokenise dbr:Tokeniser dbr:Tokenize dbr:Tokenized dbr:Tokenizer dbr:Tokenizing dbr:PackCC dbr:Transformer_(machine_learning_model) dbr:Lexeme_(computer_science) dbr:Lexer dbr:Lexer_(computer_science) dbr:Lexer_generator dbr:Lexers dbr:Lexical_Analysis dbr:Lexical_analyser dbr:Lexical_analyzer dbr:Lexical_parser dbr:Lexical_syntax dbr:Lexing dbr:List_of_lexer_generators dbr:Scanner_(computing) dbr:Semicolon_insertion
is dbp:genre of	dbr:RE/flex
is foaf:primaryTopic of	wikipedia-en:Lexical_analysis