In his essay Why I Am Not A Christian Bertrand Russell argues that a divine figure would either know that the tree would not have figs or could have simply produced the figs by a miracle and thus finds the story illogical.

[..] Then there is the curious story of the fig tree, which always rather puzzled me. You remember what happened about the fig tree. "He was hungry; and seeing a fig tree afar off having leaves, He came if haply He might find anything thereon; and when He came to it He found nothing but leaves, for the time of figs was not yet. And Jesus answered and said unto it: 'No man eat fruit of thee hereafter for ever' . . . and Peter . . . saith unto Him: 'Master, behold the fig tree which thou cursedst is withered away.'" This is a very curious story, because it was not the right time of year for figs, and you really could not blame the tree. I cannot myself feel that either in the matter of wisdom or in the matter of virtue Christ stands quite as high as some other people known to history. I think I should put Buddha and Socrates above Him in those respects.