Removed unneeded initialization of more_tokens and need_new_token.