This phase II trial studies how well olaparib and cediranib maleate work in treating patients with endometrial cancer that has come back (recurrent), does not respond to treatment (refractory), or has spread to other places in the body (metastatic). Olaparib and cediranib maleate may stop the growth of tumor cells by blocking some of the enzymes needed for cell growth.