Do you still have the SMS in your inbox? AFAIK there was a bug in the app where in you have to delete any SMS from the number you wish to block from your inbox for the blacklist to work on that number - I just don't know if this bug is still there in the latest build.