Yea, the answer is 1. Nice job ruining it for Dutchad
My reasoning was the same as yours. Tom's the one going to St. Ives, he just ran across those 7 women on the way there. Nothing suggests they're going to St. Ives too.
Even then though, 1 man + 7*7*7*7 is 2402, not 2401.