It's rare but when this happens to me I swap GPU models. From Nvidia to AMD or vice versa.
As to other builds you are in for at least a few hundred as you void the Windows OS too.
Read builds from https://www.reddit.com/r/PCMasterRace/wiki/builds
Im currently building my pc... sorta, and i need some help. I currently am using a HP Pro Desktop with a core i5-2300 and a 265watt psu on windows 10 pro, I bought a PNY GTX 1050 2gb thinking i could slap it in the pc and it would work just fine, but it didnt. the prebuilt that i have has a coupertino 2 motherboard witch apparently doesnt support gpus.so when the gpu is in and i boot it up it gets stuck on the HP boot screen. So im planning on buying a case a motherboard and a new more powerful psu. but i dont know what kind of motherboard to buy for the cpu (core i5-2300) Its a lga 1155 but i dont know where to find a decent one for a cheap price that will be compatible and that supports gpus... PLEASE HELP! I want to be able to game with my 1050 2gb my i5-2300 and the 8gb of ddr3 ram that i already own. what are some good motherboards that will work with that?

Chowhound
Comic Vine
GameFAQs
GameSpot
Giant Bomb
TechRepublic