From: NeilBrown <neilb@suse.de>
Date: Fri, 12 Jul 2013 21:18:06 +0000 (+1000)
Subject: scanner: must call close_token before returning the token.
X-Git-Tag: draftparser~13
X-Git-Url: https://ocean-lang.org/code/?p=ocean;a=commitdiff_plain;h=7b92f3a0d8eb8ba9758bf8e80477f22cd2ec6386

scanner: must call close_token before returning the token.

Signed-off-by: NeilBrown <neilb@suse.de>
---

diff --git a/csrc/scanner.mdc b/csrc/scanner.mdc
index 58ccd6b..06fef7d 100644
--- a/csrc/scanner.mdc
+++ b/csrc/scanner.mdc
@@ -722,6 +722,7 @@ information and return one token.
 			if (ignored & (1<<TK_newline))
 				continue;
 			tk.num = TK_newline;
+			close_token(state, &tk);
 			return tk;
 		}
 		// Indents are needed, so check all white space.