You could use FindColorsSpiralTolerance to get a TPA (Array of TPoint aka TPointArray). Once you have a TPA you can search through it or split it into a box.
procedure Test;
begin
FindColorsSpiralTolerance(X, Y, TPointArray, Color, X1, Y1, X2, Y2, Tolerance);
ClearTPAFromTPA(TPointArray, InvertTPA(TPAFromBox(X1, Y1, X2, Y2)));
WriteLn(''+ToStr(TPointArray)+'');
end;
1) Finds the colors and puts them in a TPA
2) Clear all points from the TPA except the box you specified
3) Writes in all the points in that box
Then you can click a point that is the nearest to a specific point you want. The point closest to the top left will have lower co-ordinates than points in the bottom right corner.
NearbyPointInArray(Point(X, Y), Distance, TPointArray);
Will look for the nearest point in the array you define.
Just play with that and see what you get.