It turns out that the deliciously-named Jason Richwine, author of an anti-immigration reform paper from the Heritage Foundation, is also the author of a 2009 Harvard public policy dissertation called "IQ and Immigration Policy," which claims that because Latinos are genetically intellectually inferior to whites and Asians, their immigration to the U.S. should be tightly restricted. Richwine has also contributed to a white nationalist website called AlternativeRight.com.
The human brain remains, in many crucial aspects, a mystery to science. So what is IQ? It is a measure of the capacity to learn in the linear fashion prized by Western culture, and we know that it is partially determined by genetics. Yet in the life of the average, individual human, those "innate" genes are vastly, vastly overpowered by the effects of environment: decent nutrition; an emotionally stable, vocabulary-rich home life; physically and emotionally attentive parents; good schools and teachers. Those factors tend to be in shorter supply among high-poverty populations. Claiming that such populations are genetically inferior ignores about a century of research and writing on the malleability of IQ and the proper uses of intelligence assessments.
Alfred Binet, the French psychologist who invented IQ testing, made quite clear that his exams could not draw conclusions about the difference in innate ability between two individuals from different cultural and socioeconomic backgrounds. Little has changed. In 1995, after the tempest around Charles Murray's The Bell Curve, Nobel Prize-winning economist James Heckman summarized what is known about intelligence, race, class, and heritability. The consensus is that IQ can help distinguish between the capacities of "within-group" individuals--for example, two upper-middle class American Jewish girls who attended good public schools and then Brown University. However:
1. IQ supremacists claim IQ is a measure of innate ability. Yet IQ tests are actually achievement exams, which, in Heckman's words, can be "manipulated by educational interventions." If a child is asked during an IQ assessment to memorize and repeat a long string of numbers, she will do a better job if she has an excellent math teacher or if her dad helps her with her math homework at night -- if, in other words, she has had the opportunity to gain confidence around numbers.
2. If two race-similar individuals are compared, the person with the higher IQ will often have superior social outcomes. He is more likely to graduate high school or get a high-paying job. Yet the evidence suggests that IQ itself--as opposed to all the other social factors correlated with IQ, like parental income--is responsible for only a small fraction of this difference in achievement. Not to beat a dead horse or anything, but correlation does not imply causation.
3. IQ is one predictor of success on the labor market, but it is not the only or even the most important factor. Social skills and work ethic are not measured by IQ, yet can be substantially improved through education and training, especially if that training is received in childhood.
4. We know socioeconomic factors influence intelligence, but our measures of those factors are crude. For example, a nutritious diet increases cognitive function, but we don't know by exactly how much. If we get better at isolating and measuring such effects, it might turn out that genetic intelligence is even less important than we assume.
One of the books I recommend most often is The Big Test by Nick Lemann. He shows how wave after wave of new immigrants, including white immigrants, were assumed to be innately stupid, in part because of their initial bad scores on IQ exams. This is true even of those groups, like Jews, whom we think of as "smart" today. Here Lemann writes about IQ tests given to World War I recruits, and the way the scores were intepreted by Carl Campbell Brigham, a Princeton psychologist who became an author of the SAT:
On the Army IQ tests, Nordics scored higher than Alpines, who scored higher than Mediterraneans. The test results as a whole were like a photograph of American culture, so faithfully did they reproduce the social order. Officers scored higher than enlisted men, the native-born scored higher than the foreign-born, less recent immigrants scored higher than more recent immigrants, and whites scored higher than Negroes. There were ironclad natural laws at work here, Brigham felt, and he warned that wishful thinkers who pretended otherwise were deluding themselves--writing, for example, "Our figures, then, would rather tend to disprove the popular belief that the Jew is highly intelligent." Brigham's stern conclusion was this: "American intelligence is declining, and will proceed with an accelerating rate as the racial admixture becomes more and more extensive...These are the plain, if somewhat ugly, facts that our study shows."
The social and cognitive science has improved since then. But somehow, Richwine didn't get the memo, so we keep rehashing these noxious old arguments.
Update: Via Twitter, Daveed Gartenstein-Ross points out that in his dissertation, Richwine does discuss the Brigham research. He concludes that Brigham unfairly discriminated against certain white immigrant groups, since those groups, like Italians, now perform equally to Northern European Americans on today's more sophisticated IQ tests. This is from page 20:

Richwine recognizes Brigham's bias toward certain white people. Yet he assumes that innate genetic traits are responsible for Latino's lower IQ scores over the past several decades, as opposed to the many socioeconomic realities described above and acknowledged as far-greater predictors of IQ. Richwine writes that since Asians are both poor and do well on IQ tests, this destroys the argument that poverty accounts for Latino's lower scores. Yet poverty is not a monolithic phenomenon. It differs culturally, across the globe, in terms of how much emphasis is put on academic learning. Ex; Until Reconstruction, it was illegal in the American south to teach black people to read. Chinese culture has emphasized success on written civil service examinations for over a millenium. Some Latino teenagers arrive in American public schools nearly illiterate in Spanish; they come from agricultural communities in countries where anything beyond an elementary education is off-limits to the very poor. Comparing Asians to Latinos is thus exactly the sort of "out-group" analysis that Heckman and Binet warned about.