cdramey/alrm
1
0
Fork 0
Code Releases Activity

separated parser from tokenizer, wrote some tokenizer tests

Browse Source
This commit is contained in:
Christopher Ramey
2021-01-17 16:41:28 -09:00
parent 3a4317f3a9
commit b675d8714e
7 changed files with 222 additions and 103 deletions
Download Patch File Download Diff File Expand all files Collapse all files

5
config/testdata/comments.tok vendored Normal file
View File

@ -0,0 +1,5 @@
# one two three
one two three
#four five six
four five six #seven eight nine
# EOF

8
config/testdata/quotes.tok vendored Normal file
View File

@ -0,0 +1,8 @@
"one" "two three"
"four five"
" #six" "" "seven" "ei" "ght"
"multi
line"

6
config/testdata/simple-broken.tok vendored Normal file
View File

@ -0,0 +1,6 @@
one two three
four five
six

1
config/testdata/simple.tok vendored Normal file
View File

@ -0,0 +1 @@
one two three four five six