In 2008 53% of the population considered itself middle class, about 161 million Americans, according to the Pew data referenced here and here.
But in 2014 only 44% consider themselves middle class any longer, almost 140 million based on current population. That means about 20 million have dropped out of the middle class during the Obama presidency so far.
Where'd they go?
Well, not up. The upper class has also declined, about 16 million, from 21% of population in 2008 to 15% in 2014.
The only class seeing an increase is those self-identifying as lower class, and that has exploded from 25% of population in 2008 to 40% in 2014. That's up over 50 million, from 76 million in 2008 to 127 million in 2014.