When you live in the contentious world of Washington, D.C., where do you go to get away? For David Frum and Danielle Crittenden Frum, escape isn’t to be found on the nearby Atlantic beaches, but rather in rural Prince Edward County, Ontario. This island community on Lake Ontario, two hours east of Toronto, offers soft-sand beaches, sophisticated restaurants, a still-strong sense of its agricultural roots, and a connection to family.

“My mother has had a place on the lake for 20 years, and we’ve been coming here ever since,” says Crittenden Frum, an author and a contributing editor at the Huffington Post. That house became a hub for Danielle and David—a columnist and author who served as a speechwriter for President George W. Bush—and their three children.

The area “had fallen on very hard times when we began visiting,” Frum recalls, but the beauty of its landscape exerted a strong pull. What followed was “this rejuvenation and efflorescence of the county,” as Frum puts it, with chefs, winemakers, and organic farmers taking up residence. “The place has discovered this second life as a preserve of Canadian agriculture and Canadian art,” he says.

The family made the trip every summer. But as the children grew older—Miranda and Nathaniel are 23 and 20, respectively; Bea, the youngest, is 12—the pair decided to commission their own hideaway next to the house that Crittenden Frum’s mother, Yvonne Worthington, shared with her husband, the late journalist Peter Worthington. The Worthingtons’ property included a house, a barn, and, about 300 feet from the house, an open field bordered by buckthorn shrubs. That field became the site of Frum and Crittenden Frum’s new place, looking out on the vast blue expanse of Lake Ontario.

The couple enlisted a Washington-based architect, Richard Williams, to design a concise building that would provide them with their own space and allow them to share in hosting duties at the compound. They’d already worked with Williams on their house in Washington, a century-old cottage that they restored and “took from 1905 to about 1927,” as Crittenden Frum jokes.

For their Ontario getaway, Frum says, “We wanted to do modern, but we also wanted to do cheap.” That meant a firm budget of $500,000, including furniture and landscaping. Williams accepted the challenge, and they dubbed the project Twitter House—a building for a pair of writers that had to be eloquent within tight constraints. “It was about very simple ideas,” Williams says. “How do you reduce a house to the absolute bare essentials?” Their answer was a 1,500-square-foot modern layout that would include a bedroom suite, a study that could serve as a guest room, and plenty of space for friends and family.

The house is a stretched rectangle running parallel to the shore. One long side faces north toward a road in the distance and is covered in a mix of gray wood siding and copper-colored aluminum. Three tall windows in the middle offer views through to the windows on the opposite side of the structure and beyond. “As you approach, you can already see the lake right through the house,” Frum says. “That’s the most arresting thing about it.”

Williams shaped the house to be simple and highly efficient. It has no air-conditioning; the windows on the north and south sides are arranged just out of alignment to encourage cross-breezes. Heating comes from a few wall-mounted electric heaters, a fireplace, and the sun. And the low-slung building doesn’t make a loud architectural statement. “The idea is to be integrated with the land—to be low-impact, not just in terms of your claims on natural resources, but your claims on people’s attention,” Frum says. “Not to say, ‘Look at me,’ but to say, ‘We are going to be as invisible as possible.’”

Within is an efficient and robust interior composed of simple, hardy materials. The main living and dining areas and kitchen occupy the west end of the house, surrounded by a wraparound deck; at the east end are the master suite and the combined guest room and study. The troweled concrete floor was poured in place by the builder, Peter Knudsen. The only flourish is a band of oak hardwood along the wall and ceiling of the northern edge of the house, defining a corridor from the front door through the galley kitchen to another door.

Working with Julie La Traverse, a Toronto-based interior designer, Frum and Crittenden Frum settled on an Ikea galley kitchen with stainless-steel countertops. Low-key furniture, a sideboard made with Ikea cabinets, and a custom dining table fill out the space.

The dining table is the center of activity. Crittenden Frum recalls her mother’s comment at the first big gathering in the home, after a sampling of local wine: “You didn’t build a house. You built a party house!” At the same time, Frum adds, the building is just as comfortable when he and his wife are alone or with Bea, sitting together and watching the light shift slowly on the lake. “It’s constantly changing character,” Crittenden Frum says. “Walking into the house, you suddenly feel this incredible sense of peace. I can sit on that sofa looking out at the lake, winter or summer, at all hours.” Across the lake, Washington is hundreds of miles away.