Hearthlings get slower if they carry thing, and its actually even dependent on what they carry, for example, a boat makes you move slower than chair.
Should the same apply when you ride with a horse and carry something? Also kicksled etc.
Its quite dumb that you can move the same speed when carrying boat with horse than without.