There is still an issue with miners jumping between the 3,000 alt coins using scrypt and causing the network hashrate to plummet when the diff increases. I’m not sure much can be done about this until the diff/price increase enough to make it more stable.
I know moving FTC to BTC-e takes a long time with their 100 confirms when the diff has gone up, but not so long when the diff drops down.