From: NeilBrown <neilb@suse.de>
Date: Sun, 24 Nov 2013 07:14:11 +0000 (+1100)
Subject: parsergen: centralise (some of) the collecting of next token.
X-Git-Tag: indentparser~1
X-Git-Url: https://ocean-lang.org/code/?a=commitdiff_plain;h=9ebc82df03b2919afe61ddfd9ae76743663fa6e6;hp=9ebc82df03b2919afe61ddfd9ae76743663fa6e6;p=ocean

parsergen: centralise (some of) the collecting of next token.

A future patch will introduce next sites where we want to
discard the current token.
Rather than calling "token_next" at each site, make it possible
to just set "tk = NULL", and the next token will automatically
be collected when needed.

Signed-off-by: NeilBrown <neilb@suse.de>
---