Avoiding all dairy?

Huffington Post has a controversial piece by Dr. Mark Hyman that advocates avoiding dairy entirely. Apparently, the dairy requirements in the food pyramid guidelines are "udderly ridiculous." (Ha!) Link here.

Hyman's Six Reasons to Avoid Milk Entirely:

1. Milk doesn't reduce fractures.(i) Contrary to popular belief, eating dairy products has never been shown to reduce fracture risk. In fact, according to the Nurses' Health Study dairy may increase risk of fractures by 50 percent!
2. Less dairy, better bones. Countries with lowest rates of dairy and calcium consumption (like those in Africa and Asia) have the lowest rates of osteoporosis.
3. Calcium isn't as bone-protective as we thought.(ii) Studies of calcium supplementation have shown no benefit in reducing fracture risk. Vitamin D appears to be much more important than calcium in preventing fractures.
4. Calcium may raise cancer risk. Research shows that higher intakes of both calcium and dairy products may increase a man's risk of prostate cancer by 30 to 50 percent.(iii) Plus, dairy consumption increases the body's level of insulin-like growth factor-1 (IGF-1) -- a known cancer promoter.
5. Calcium has benefits that dairy doesn't. Calcium supplements, but not dairy products, may reduce the risk of colon cancer.(iv)
6. Not everyone can stomach dairy.(v) About 75 percent of the world's population is genetically unable to properly digest milk and other dairy products -- a problem called lactose intolerance.

Here is a video with Dr. Hyman explaining his argument.