Mário, I will give you my honest opnion. Think the image would have been far more better without aging. On the one hand like to say that fishermen didn't wear such caps in the past and on the other hand tink that your original B&W or sepia image already had that much charm that it wasn't necesarry to add all those scratches and spots.
Regards, Cornelius