Pyparsing introduction: BNF to code

20 Jan 2008  Development

Here’s a BNF definition:

  • lcchar ::= a | b | c | … | z
  • varname ::= lcchar | lcchar varname
  • equals ::= “=”
  • operator ::= + | - | * | /
  • operand ::= integer | varname
  • unaryoperation ::= operand
  • binaryoperation ::= operand operator operand
  • operation ::= unaryoperation | binaryoperation
  • expression ::= varname equals operation

Exercise: you should be able to write some lines of Python code to implement this by yourself now, give it a try before proceeding to the next page :-) One more operation you should know is the ‘^’ operand, which can be used to OR two Pyparsing operands.

Pages: 1 2 3 4 5 6

Tags: , , ,

Related entries

5 Responses to “Pyparsing introduction: BNF to code”

  1. sb said on 20 Jan 2008 @ 6:09 pm

    Six pages?? Ouch. And no next button. Any chance you could put it all on one page next time? I feel like I’m reading some ad-infested hardware blog.

  2. jauco said on 21 Jan 2008 @ 7:22 am

    very nice tutorial! thanks!

  3. Olivier Berger said on 21 Jan 2008 @ 11:15 am

    What’s the difference to other parser systems like simpleparse ?

    Regards,

  4. Francis said on 19 Apr 2008 @ 9:22 am

    I don’t see the difference in (except for the whitespaces)

    print sentence.parseString(’hello world’) # notice >1 spaces
    # returns [’hello’, ‘world’]
    print sentence.parseString(’Hello world’)
    # raises a ParseException

    Why does the second one raise an exception ?

  5. Nicolas said on 19 Apr 2008 @ 2:17 pm

    Francis: I guess you’re referring to the snippet on page 2? It says:

    from pyparsing import OneOrMore
    sentence = OneOrMore(word)

    The definition of ‘word’ is given on the previous page:

    word = Word(lowercase)

    where ‘lowercase’ is imported from the ’string’ module and equals

    abcdefghijklmnopqrstuvwxyz

    The definition of the BNF type ‘word’ is Word(lowercase), ie. a concatenation of any character in the string (or list, so you want) ‘lowercase’, which is a-z.

    A sentence is defined as OneOrMore words.

    The string ‘Hello world’ can not be parsed since it does not match OneOrMore(word): the first item in it (’Hello’) contains characters not matching the definition of word: the ‘H’ (since we defined a word to be a concatenation of lowercase characters, it shouldn’t contain any uppercase characters).

    As you can see, on page 3 a better definition of sentence is constructed using a ’startword’ definition which should be a concatenation of one uppercase character, followed by zero or more lowercase characters.The example shows ‘A valid sentence.’ can be parsed and validated. The string ‘Hello world!’ would be valid in this BNF construct too. ‘Hello world’ would not match since we’re missing a punctuation sign.

    Using the definitions from page 3

    almost_valid_sentence = startword + body

    or (even more limited)

    hello_caps = startword + word

    would validate and parse ‘Hello world’.

Leave a comment