CucumberGherkin.tokenize

You're seeing just the function tokenize, go back to CucumberGherkin module for more information.
Link to this function

tokenize(feature_file)

Tokenizes a feature file. Normally you should not need this.