Try Stef at Le Clos du Tertre (leclosdutertre@wanadoo.fr). His guesthouse has three rooms which can each take upto 4 people. You can book rooms individually, by the night.
Located in La Chapelle la Reine, a few miles south of Milly la Foret. We've stayed a few times, reasonable prices and great breakfasts!