Do We Really Wash For Wet Fruit?

As you will see on the Seder night, one of the steps is "ורחץ," where we wash our hands before touching the wet vegetable to be used for karpas.
Washing for wet fruit is a halachah brought in Shulchan Aruch (שו"ע או"ח סי' קנ"ח ס"ד). Yet, for some reason, this practice is not very widespread and is not seen very often throughout the year...
There is some room for justification: Washing for wet fruit is out of fear that the fruit will become tamei as a result of one's impure hands touching the liquid that subsequently contaminates the fruit. This was in pertinent in days of old when people ate their regular food only while pure. Today that we are tamei anyways, there is room to justify (albeit not being the accepted halachah).
It is said of the R. Chaim Halbershtam (Grand Rebbe of Tzanz, author of "Divrei Chaim") that washing for karpas on Pesach need only be done by the head of the group. It is further testified that in Poland and Russia, no one was careful with this practice throughout the year.
The Rebbe, quoting the Chok Yaakov, however, says that even those that are not careful the whole year should do so on the Seder night to arouse the interest of the children.
שו"ת שרגא המאיר ח"ד סי' קי"א אות ב
ועי' שו"ע הרב או"ח סי' קנ"ח ס"ג. ערוה"ש שם ס"ד
ועי' הגדה של פסח עם לקוטי טעמים ומנהגים פיסקא ורחץ ונט"י ואינו מברך
See here