A builder accused of being Banksy after he was snapped next to one of the elusive artist’s works says people need to “grow up ...