Skip to content

Commit 0c41353

Browse files
committed
Add a comment on something that needs fixing in the reader
1 parent b7e302a commit 0c41353

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

src/edu/stanford/nlp/pipeline/CoNLLUReader.java

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -164,6 +164,7 @@ else if (MWT_LINE.matcher(line).matches())
164164
else if (TOKEN_LINE.matcher(line).matches())
165165
tokenLines.add(line);
166166
else
167+
// TODO: this is ignoring "empty" tokens
167168
return true;
168169
return false;
169170
}

0 commit comments

Comments
 (0)