There is no canon location for House Potter, but Ser Robin Potter is known to have been at Highgarden, so it is considered to be a House of the Reach.
House Potter is canonically insignificant enough that it could be absorbed by a larger project.