The Le Fossé estate likely takes its name from a feudal mound to the west, upstream from the Tôt. Owned by local dignitaries until the late 19th century, it was occupied in the 18th century by Étienne Coignard, Lord of Tournebus and Le Fossé, and secretary to the King. From his marriage to Elisabeth de la Rive, three children were born, the eldest of whom, David, would become the Lord of Rombosc. Jean Daliphard, the owner and mayor of Mont-Cauvaire at the end of the 19th century, restored the Directoire-style château, known as the "White Château." Edmond Spalikowski, a Norman writer and historian of the early 20th century, was critical of this restoration, though he wrote with great admiration of the nearby octagonal dovecote.
The last nobleman to occupy the estate, Henri de Saint-Victor, sold it in 1900 to the Société du Collège de Normandie, founded by a group of Rouen industrialists in 1895. The college, inspired by British educational methods, opened its doors in 1902 with seven pupils based in the château and its annexe. Under the drive of its successive headmasters, Joseph Duhamel and later Louis Dedet, the school’s rules were built on trust and student responsibility. There were no walls or gates; authority was, above all, a moral matter.
Under the leadership of Mr Louis Dedet, the college flourished until 1934, necessitating the construction of several brick buildings—Les Pommiers, Les Tilleuls, Les Lierres—and the development of sporting and cultural infrastructure: a swimming pool reputed to be the finest in France, several tennis courts, athletics tracks, team sports pitches, a fencing room, and a theatre.
The 1908 welcome prospectus notes that pupils were divided into groups across "Houses" managed by married teachers, fostering a family environment. The college followed the official curriculum but placed a heavy emphasis on modern languages and sport. In 1930, a chapel designed by the architect Pierre Chirol was erected for monotheistic worship. Between 1902 and 1972, more than 2,000 pupils attended the Collège de Normandie, which became a key gathering point for the French and international bourgeoisie and aristocracy. After passing their Baccalauréat, these students went on to the most prestigious Grandes Écoles in France.
During the Second World War, the estate became a military hospital. The pupils were sent home in May 1940, and the site was occupied by German troops. In 1944, work began on a V1 rocket launch ramp. The estate was bombed, and the Germans destroyed the facilities in August 1945. At the Liberation, the estate was little more than a pile of rubble. Thanks to the tenacity of the administrators and the efforts of Mayor Placide Alexandre, the college was eventually reborn by merging with the École des Roches. The college reopened in 1951 and finally closed in 1972.
The Association Médico-Éducative Rouennaise (AMER) purchased the estate in 1972 to care for children with intellectual disabilities. The facility was named the "Centre Dominique Lefort" in honour of its director, who passed away prematurely. In 1980, the centre was accredited to house 120 children and adolescents. In 1983, the Les Pommiers building was refurbished to accommodate adults. A grant from a British foundation allowed for additional residential space in 1986. Finally, in 2013, the renovation and extension of Les Pommiers were officially inaugurated.