Keep in mind I am not an expert, just a lay person.
I am not sure about flux density. I think a higher voltage will push the fields out further, but that is just a guess. Maybe rewind the coil to a different shape? Also keep in mind that magnetic strength is equal to distance squared.(twice the distance has only a fourth the magnetic field)
Your limiting factors for current through the conductor will be IR^2 losses(twice the current means four times the losses). Too much current and you will over heat your magnet. For voltage your limiting factor will be insulation(I am guessing enamel?) breaking down due to high voltage combined with high heat, and electric arcing.
As for AC vs DC efficiency. I think DC is slightly more efficient for wattage through a given wire size and type. By that I mean more power can flow through a thinner wire, not that you will loose less power to heat. If the frequency is high, such as 60Hz or more, and you have three or more phases than it does not really matter, as both AC and DC will carry about the same energy. If you meant energy losses that depends on current, components that you use, and the quality of your electromagnet.
Another thing to keep in mind is that AC is much more gentle on electronics because it slowly builds voltage and repeatedly crosses the zero potential mark. Many switches and breakers can handle a lot more AC power than DC because DC will try to arc weld the contacts when they open. AC does not have that much of a problem because when the voltage reaches zero the electric arc shuts down and will not try to jump back across when it builds back up.
As for flux and electromagnets. I think depending on what you are trying to do there may be a big difference between an AC magnet and a DC magnet. The AC electromagnet will have it's fields constantly growing and collapsing with whatever frequency (Hz) it is running at. That can make things more complex than a DC magnet with fixed magnetic fields.
I hope something I said was useful. I will try to attach a freeware magnetic flux program that I have. Edit: I Found it and uploaded it to my site.
http://www.dustin.o-f.com/storage/femm34bin.exeTry
www.otherpower.com There are many experts there that can help you, or search their archive. Also
www.eng-tips.com can help you.