It's probably a case of they all do that. The starting can be quite variable, both of mine would sometimes fire straight away or could take 30 second or more of cranking to wake them up.
It's unlikely to be the fuel pump just yet but if you haven't changed to a Walbro pump then it's best ot do that as soon as possible. The standard pump will fail, it's just a matter of when!