This pagemay be of interest.
Apparently the 2006 Mac Mini can be upgraded to 2 GB RAM which will cost you £30 over here. Well worth doing.
Going back to the original problem, I would suggest telling the Mac to forget the Wifi network, disable wifi (go to the AirPort menu and turn the AirPort card off) and reinsert the LAN cable.