
I think you should go for it! You can simplify the setup by fab'ing a square plate with your on/off switches, audio jacks, and USB ports etc, as well as video hookups and ethernet jacks. I'd make it out of a piece of 2x4, or hard, quality plywood (think leftover furniture parts) first, and coat it with something by hand with a brush like wood oil, furniture polish, etc. You drill holes for extension cables (mind the ends m/f, type) , and fill the holes with wood putty to lock them in place into the plate. Then cut an undersized hole in the side of the fridge, and mount the plate to the fridge, probably to the inside, if you have dremels and stuff. You can probably seal it to the fridge side with auto gasket sealer or silicone glue ($2.50 a tube). Use sheet metal hex head screws.
This way you can hook your monitor and acc. up just like a standard case.