I don't think carrying fibers is particularly fun or efficient if we're hauling them to a specific building. At least not for towns doing crazy enough cloth fields that this automation would be needed.
Wouldn't it make more sense to ask for a loom speed buff that can be earned instead?