Post List

Research / Scholarship posts

(Modify Search »)

  • October 14, 2012
  • 05:55 AM
  • 568 views

Citizen science and digital platforms: folding it all the way to outer space

by Cobb & Hecht in Do You Believe In Dog?

ScienceRewired is a philanthropic initiative that aims to promote public engagement in science through digital and social technologies. Their mission is to aid non-technical science practitioners and the digital domain in working together, to look at science from new perspectives while helping educate and empower individuals to create significant positive change in the world. Their focus spreads across science education, science communication and citizen science initiatives – what’s not to love about that?!(source)I was fortunate to be awarded a scholarship to attend the day in Adelaide (730km / 450 miles away from home) by the Australian Science Communicators. The event was themed ‘Connect, Collaborate and Communicate for Change’ and intended to bring together science communicators, academics, media professionals and digital visionaries for a one day conference of debate, insight and education as a springboard for ongoing communication and action. We heard from a wide range of wonderful speakers about different digital/social media initiatives (most session content has been reported here), but what I wanted to share with you today were two really exciting and different projects that are underway using citizen science.(source)(source)What is Citizen Science anyway?Citizen science has been gaining momentum since the mid-1990’s, but just in case you haven’t heard the term before, relax. You already know what it is even if you haven’t heard the label. Simply put, it’s when amateur scientists or non-professionally-scientific people (i.e. general public) collaborate and help contribute to science. The internet has made this super easy.... Read more »

Hand Eric. (2010) Citizen science: People power. Nature, 466(7307), 687. DOI: 10.1038/466685a  

Khatib F., Cooper S., Tyka M. D., Xu K., Makedon I., Popovic Z., Baker D., & Players F. (2011) From the Cover: Algorithm discovery by protein folding game players. Proceedings of the National Academy of Sciences, 108(47), 18953. DOI: 10.1073/pnas.1115898108  

Parsons Jeffrey, Lukyanenko Roman, & Wiersma Yolanda. (2011) Easier citizen science is better. Nature, 471(7336), 37. DOI: 10.1038/471037a  

  • October 13, 2012
  • 11:53 AM
  • 122 views

Science and the gender problem

by Sam Hardman in Ecologica

Within academic science there has long been a gender bias favouring men over women. Male scientists are more likely to be hired than women despite equivalent qualifications, men get paid [...]... Read more »

Ceci S. J., & Williams W. M. (2011) Understanding current causes of women's underrepresentation in science. Proceedings of the National Academy of Sciences, 108(8), 3157-3162. DOI: 10.1073/pnas.1014871108  

Moss-Racusin C. A., Dovidio J. F., Brescoll V. L., Graham M. J., & Handelsman J. (2012) Science faculty's subtle gender biases favor male students. Proceedings of the National Academy of Sciences, 109(41), 16474-16479. DOI: 10.1073/pnas.1211286109  

  • October 13, 2012
  • 11:00 AM
  • 1,010 views

A new vocal learner found?

by Henkjan Honing in Music Matters

In a study that appeared in PLoS ONE two days ago, co-authored by Gustavo Arriaga, Eric Zhou and Erich Jarvis (Duke University), it was shown that a motor cortex region in mice is active during singing, and that it projects directly to brainstem vocal motor neurons that is necessary for keeping song more stereotyped and on pitch.... Read more »

Holy TE, & Guo Z. (2005) Ultrasonic songs of male mice. PLoS biology, 3(12). PMID: 16248680  

Arriaga, G., Zhou, E. P., & Jarvis, E. D. (2012) Of Mice, Birds, and Men: The Mouse Ultrasonic Song-system Has Some Features SImilar to Humans and Song-Learning Birds. PLoS ONE, 7(10). info:/10.1371/journal.pone.0046610

  • October 12, 2012
  • 05:35 AM
  • 716 views

What's new in Music Cognition and the Cognitive Sciences?

by Henkjan Honing in Music Matters

Why should music be of interest to cognitive scientists, and what role does it play in human cognition? ... Read more »

Pearce, Marcus, & Rohrmeier, Martin. (2012) Music Cognition and the Cognitive Sciences. Topics in Cognitive Science, 4(4), 468-484. info:/10.1111/j.1756-8765.2012.01226.x

  • October 10, 2012
  • 08:00 AM
  • 453 views

Retraction classic: Physics and feminism

by Zen Faulkes in NeuroDojo

When I want to talk to students about how the scientific publishing process can go awry, I almost always end up telling the story of how the Canadian Journal of Physics published a screed against feminism.

In the early 1990s, I was in graduate school when the story broke. The Canadian Journal of Physics had published a set of papers on chaos. Chaos theory was big at the time, following James Gleick’s best-seller Chaos (1987). Among the regular sort of papers one would expect to find in a journal of physics was one very unusual short paper.

First, it was labelled “Sociology.”

Second, it contained exactly two citations. And one reference was to a dictionary for a definition.

Third, the paper was outlandish. It was an almost unimaginable broadside attack on feminism. blaming it for most all of society’s ills. Almost as an aside, it incidentally insulted almost all social science at the same time. To give you a little sampling, this paper claimed:


Women should not be in the work force, because they are“nurturers.”
Half the children of working mothers suffered “serious psychological damage.”
Surveys and controlled experiments in social science distort findings, and “wisdom” is a superior method of obtaining knowledge in the social sciences.
Abstinence until marriage would improve things, which should be vigorously promoted through television advertising campaigns.


It’s rare to find such most blunt “women belong in the home” arguments in any print medium, let alone a scientific journal. It was astonishing.

The article was penned by Gordon Freeman (pictured), who was the guest editor of this one issue of the journal. It was pretty obvious what had happened, in broad strokes: he abused his editorial power to get his poisonous opinion piece into the pages of the journal.

The details of exactly how this happened were a little more complicated. Freeman organized a conference on chaos theory, and was assembling papers that had been presented at a conference for publication in the Canadian Journal of Physics. Apparently, the deal was that the journal would publish all the papers Freeman compiled, provided that they were presented at the conference, and that they were peer-reviewed.

Freeman lied about presenting the paper at the conference.

Somehow, Freeman managed to get back a positive review. The mind boggles, but he did.

The paper was published, and the excrement collided with the rotary cooling device.

Once this story blew up, as was inevitable, the regular editor of Canadian Journal of Physics,
Ralph Nicholls, refused to reveal who the reviewers of Freeman’s
article were, following the standard practice of anonymous peer-review
that most journals follow. Nicholls was removed as editor for refusing
to show the review to the editor in chief for all the National Research
Council journals.

It also came out that Freeman’s institution, the University of Alberta, considered this to be human subjects research, and that Freeman had not obtained approval for it.



The journal apologized for the paper nine months after it was published (Dancik 1991a), but did it in a very uninspired way. The did say Freeman’s work “had no place in a scientific journal,” but it didn’t specifically disavow Freeman’s opinions. And there was no explanation of how Freeman’s paper managed to get into the journal in the first place. Although Science magazine later described the notice as a “retraction,” the word doesn’t appear in the three sentence editorial.

The Canadian Association of Physicists certainly considered it a retraction, and wrote to Freeman asking him to shut up about his paper.


The Editor-in-Chief of the
NRC Research Journals has published an editorial note in the Canadian
Journal of Physics stating that your article has no place in a
scientific journal and expressing regret that it was published. This
clearly retracts any approval of the article by the CJP and, in effect,
retroactively disavows its publication. ... I would ask you, therefore, in view of
the harm engendered to the scientific reputation of the Canadian Journal
of Physics and, by extension, to the whole physics community, to
refrain from making any further references to this article in any public
forum, and not to distribute reprints with the name of the journal
attached. I believe that scientific ethics demand that this article
effectively be struck from the public record(.)

Moreover, the retraction / apology was printed on an unnumbered page, which made it hard to cite, and to link to the original paper. This led the journal to print the apology a second time a few moths later (pictured; Dancik 1991b).

The outrage over this paper was so great that many people were advocating reprinting the entire issue without Freeman’s article, and sending it to every library, so there would be no trace of it left. But a petition to reprint the issue didn’t get any response until the story appeared in Science magazine in 1992 (Crease, 1992).

The Nation Research Council, the publisher of the journal, at one point considered publishing a special issue about the controversy around Freeman’s paper as a mea culpa. But it was not appearing. At one point, the plan not to publish this came out held a conference on the ethics of publishing (reported in Crease 1993; Huston 1993). The uninspired response for why there was no supplement? “It seems a little late now.” This seems to support a claim by newspaper columnist Morris Wolffe on how the controversy was handled:


The NRC, it was clear, was hoping the Freeman matter would go away.

Ultimately, some additional commentary did appear in the March/April 1993 issue of the Canadian Journal of Physics. Proceedings of the ethics symposium appeared in the journal Scholarly Publishing.

If you go to the Canadian Journal of Physics website today to look up the article, this is what you find:




It’s still available, with no indication that this wretched paper has been retracted, or warranted an apology, not once, but twice.

This story was one of the first cases where I became aware of the
concept of retraction. It definitely shaped by view of what retraction
was mean to do. The notion of reprinting the issue set it in my mind
that the goal of retraction was to, as near as possible, expunge an
article from the scientific record. I’ve since realized that in
practice, retraction is a much more complicated beast.

But if ever there was a paper that deserved an unambiguous retraction, this would be it.

References

Freeman GR. 1990. Kinetics of nonhomogeneous processes in human society: Unethical behaviour and societal chaos. Canadian Journal of Physics 68(9): 798. DOI: 10.1139/p90-116

... Read more »

  • October 8, 2012
  • 06:53 AM
  • 511 views

Solving Environmental Problems Through Metabolic Engineering

by Jason Carr in Wired Cosmos

Environmental problems, such as depleting natural resources, highlight the need to establish a renewable chemical industry. Metabolic engineering enhances the production of chemicals made by microbes in so-called “cell factories”. Next Monday, scientist Professor Sang Yup Lee of KAIST (Korea Advanced Institute of Science and Technology) will explain how metabolic engineering could lead to the [...]... Read more »

Yu Kyung Jung, Tae Yong Kim, Si Jae Park, & Sang Yup Lee. (2010) Metabolic engineering of Escherichia coli for the production of polylactic acid and its copolymers. Biotechnology and Bioengineering, 105(1), 161-171. info:/10.1002/bit.22548

  • October 8, 2012
  • 05:38 AM
  • 854 views

A tail with no end is a sorry tale indeed.

by Cobb & Hecht in Do You Believe In Dog?

Hey Julie,What a great topic to bring to the table: that what we, as people, like to see in our dogs, may not always be in the dogs' best interests. Indeed. Considering that got me thinking not just about the features we select for when breeding dogs, but also our track record in surgically altering the appearance of dogs through procedures like ear cropping and tail docking, for the purpose of owner satisfaction in how the dog looks.A postcard used in an RSPCA awareness campaign in Australia.Don't worry, I'm not going to show a whole lot of disturbing images, but I would like to talk about the role scientific assessment and objectivity can play as a catalyst for change in regards to animal welfare issues. Pauleen Bennett (source)My PhD supervisor, Pauleen Bennett, founder of the Anthrozoology Research Group and Executive Director and Chair of the Australian Anthrozoology Research Foundation, contributed significantly to ending the stand-off surrounding the issue of 'tail docking' occurring in Australia around ten years ago. She has bred and shown pure breed dogs, so had contact with people and pure-breed dog associations who were strongly opposed to the calls from welfare organisations and veterinary groups to ban the practice of tail docking in Australia.  This issue really came to light following anti-docking legislation (except where medically indicated by a vet) being implemented in several Scandinavian and  other European countries in the mid-late 1990's. Several main arguments founded in historic practice and emotive reactions were blocking the cessation of tail docking in Australia.  Pauleen's review of these issues surrounding tail docking systematically identified and considered the main arguments proposed for continued docking:Maintaining tradition / The breed standard called for a docked tail.The public would not recognise these breeds without their docked tails.The dogs will injure their tails if undocked.The dogs will get dirty tails if undocked.Personal preference (less likely to knock over furniture items, prefer the look, etc.).Within this paper, she also considered the arguments for ceasing tail docking in the same objective and non-emotive manner. The objective and informed facts:Tail docking is painful. It was routinely done to young pups (1-5 days old) who are unable to be anaesthetised (too young) and not given pain relief. Young puppies can feel acute pain.Tails are major communication tools for dogs.Tail docking approx. 500 dogs may avoid one tail injury. (To give this some context with a human flavour, approximately 1 in 255 people fracture their arms annually in the USA, but funnily enough, Americans don’t amputate babies’ arms at birth to avoid this.)Some traditions need to be ceased in light of new information and changing societal expectations/norms. ... Read more »

  • October 7, 2012
  • 10:05 PM
  • 286 views

Better a John than a Jennifer

by Liza Lester in EcoTone

On the market for scientific jobs, male applicants enjoy a substantial advantage, say Yale University researchers.... Read more »

Moss-Racusin CA, Dovidio JF, Brescoll VL, Graham MJ, & Handelsman J. (2012) Science faculty's subtle gender biases favor male students. Proceedings of the National Academy of Sciences of the United States of America. PMID: 22988126  

  • October 7, 2012
  • 01:00 AM
  • 585 views

Is birdsong music?

by Henkjan Honing in Music Matters

Many studies on the origins of music concern the question of what defines music. Can birdsong, the song structure of humpback whales, a Thai elephant orchestra, or the interlocking duets of Gibbons be considered music? ... Read more »

Araya-Salas, Marcelo. (2012) Is birdsong music? Evaluating harmonic intervals in songs of a Neotropical songbird. Animal Behaviour, 84(2), 309-313. info:/10.1016/j.anbehav.2012.04.038

  • October 5, 2012
  • 12:42 AM
  • 421 views

Technology Is Rapidly Lowering the Cost of Testing

by Eric Horowitz in peer-reviewed by my neurons

People may view this as something for the good news/bad news file, but technology has quietly made it significantly easier to grade tests electronically. For example, a new paper in the Journal of Science Education and Technology highlights a system called “Eyegrade” : While most current solutions are based on expensive scanners, Eyegrade offers a [...]... Read more »

  • October 2, 2012
  • 01:07 PM
  • 556 views

Is ADHD different around the globe? The role of research cultures

by Richard Kunert in Brain's Idea

An illness is an illness wherever you are. Perhaps this is true for organic diseases but the cultural background can play a tremendous role in the progression and even diagnosis of mental disorders. However, what has been neglected is an appreciation of how culture affects the research underlying the diagnosis and treatment of psychological disorders. As a consequence, our view on the disorder can change.... Read more »

Hodgkins P, Arnold LE, Shaw M, Caci H, Kahle J, Woods AG, & Young S. (2011) A systematic review of global publication trends regarding long-term outcomes of ADHD. Frontiers in psychiatry / Frontiers Research Foundation, 84. PMID: 22279437  

Polanczyk G, de Lima MS, Horta BL, Biederman J, & Rohde LA. (2007) The worldwide prevalence of ADHD: a systematic review and metaregression analysis. The American journal of psychiatry, 164(6), 942-8. PMID: 17541055  

  • October 1, 2012
  • 08:39 PM
  • 463 views

Heroes - and - why do we feed our dogs to death?

by Cobb & Hecht in Do You Believe In Dog?

Hey Julie,I’m glad you’re a fan of Paul McGreevy’s too! I admire so much of the work he’s done (and facilitated or helped others to do). He’s not afraid to raise sensitive topics and tricky questions through his science and I appreciate that enormously.Your last post got me thinking about who my canine science (or general doggy-people) heroes are – I’m still pondering on this, but there are plenty of them!(source)I think I’ll get back to you with my conclusions and explanations another day after I’ve had some more time to ruminate on it a bit more.Meanwhile, I wanted to get back to you to talk fat dogs.Sampson, June 2011 (source)One of my local animal shelters was attracting global attention recently when 8 year old Sampson was surrendered to the shelter for rehoming and weighed in at a whopping 84kg (that’s 185lbs). Sampson’s not alone. Up to 40% of Australia’s pet dog population are overweight ad this is comparable to other developed nations. The weird thing is – why? Vanessa RohlfAs pet owners, we humans are in control of their food, we understand that amount of food + amount of exercise = pet weight. We even have ept food companies who have developed weight control formulas so we can feed 'more' but give 'less' - so why can’t some people control the balance to keep our pets healthy?(source)Vanessa Rohlf is a fellow PhD candidate of mine in the Anthrozoology Research Group and she has done some excellent work looking into this area of pet owner/caregiver psychology.... Read more »

Rohlf Vanessa I., Bennett Pauleen C., Toukhsati Samia, & Coleman Grahame. (2010) Why Do Even Committed Dog Owners Fail to Comply with Some Responsible Ownership Practices?. Anthrozoos: A Multidisciplinary Journal of The Interactions of People , 23(2), 155. DOI: 10.2752/175303710X12682332909972  

  • September 29, 2012
  • 05:00 AM
  • 558 views

The SAT Zombie Apocalypse

by nooffensebut in The Unsilenced Science

State SAT and ACT scores follow a North-South divide that somewhat fits the spread of racial diversity.... Read more »

Duckworth AL, Quinn PD, Lynam DR, Loeber R, & Stouthamer-Loeber M. (2011) Role of test motivation in intelligence testing. Proceedings of the National Academy of Sciences of the United States of America, 108(19), 7716-20. PMID: 21518867  

  • September 26, 2012
  • 07:13 PM
  • 430 views

canine confirmation confound – lessons from poorly performing drug detection dogs

by Richard Kunert in Brain's Idea

Intuitively, the use of police dogs as drug detectors makes sense. Dogs are known to have a better sense of smell than their human handlers. Furthermore, they cooperate easily. Still, compared to the generally good picture sniffer dogs have in the public eye, their performance as drug detectors in real life is terrible. The reason why scent dogs get used anyway holds important lessons for behavioural researchers working with animals or humans.... Read more »

Doyen S, Klein O, Pichon CL, & Cleeremans A. (2012) Behavioral priming: it's all in the mind, but whose mind?. PloS one, 7(1). PMID: 22279526  

Hickey S, McIlwraith F, Bruno R, Matthews A, & Alati R. (2012) Drug detection dogs in Australia: More bark than bite?. Drug and alcohol review, 31(6), 778-83. PMID: 22404555  

Lit L, Schweitzer JB, & Oberbauer AM. (2011) Handler beliefs affect scent detection dog outcomes. Animal cognition, 14(3), 387-94. PMID: 21225441  

NSW Ombudsman. (2006) Review of the Police Powers (Drug Detection Dogs) Act 2001. Sydney: Office of the New SouthWales Ombudsman. info:other/

  • September 24, 2012
  • 05:57 PM
  • 622 views

The science of carrots and sticks

by Cobb & Hecht in Do You Believe In Dog?

Hi Julie, Today I want to tell you all about the great time I had last week. But first, you have to know about my lovely friend, Kate. We originally met through our research group at Monash University. We’re colleagues who have completing our PhD’s (both aiming to complete SOON) in common, but we also share a background in Zoology and the fact we have been juggling our research with our work for the past few years. Kindred spirits!This is Kate!Kate works primarily as an animal behaviourist (you can check out her business website, or follow her on facebook), but she is also a media personality, experienced freelance writer and delivers professional and public training workshops. The Melbourne Aquarium asked Kate to come and present to their staff about the ‘Science of Animal Behaviour and Training’ and Kate asked me to come along to help out.Hello penguins!I said yes. Kate’s presentations comprised of theoretical (learning), observational (watching) and practical (doing) exercises. It is always so good to see ongoing professional development in any workplace and the aquarium staff were really engaged and enthusiastic participants. I took lots of fun video footage that you would have seen on our facebook page.Kate’s a great presenter and someone who believes in the fact we (as people) never stop learning. She lives this belief and engages in lots of ongoing professional training opportunities in furthering her understanding of animal behaviour and how we can influence it. For example, she just got back from learning with Ken Ramirez at Shedd Aquarium and over the past few years has also been to Natural Encounters Inc and done chicken camp with Terry Ryan. So what does this have to do with dogs? So much!Animal training specialists understand about animal behaviour (taking into account the individual animal’s history and the effect of the current environment) and the science of learning theory. They use this knowledge to help shape animal behaviour to improve things like animal welfare, enrichment goals and human safety.Divers do group fish feeds in the large aquarium in front of the public. There are big sharks and stingrays in there.(source)... Read more »

Haverbeke A., Laporte B., Depiereux E., Giffroy J.-M., & Diederich C. (2008) Training methods of military dog handlers and their effects on the team's performances. Applied Animal Behaviour Science, 113(1-3), 122. DOI: 10.1016/j.applanim.2007.11.010  

  • September 22, 2012
  • 05:00 PM
  • 474 views

The power to see the future is exciting and terrifying

by Dan Mirman in Minding the Brain

In a recent comment in Nature, Daniel Acuna, Stefano Allesina, and Konrad Kording describe a statistical model for predicting h-index. In case you are not familiar with it, h-index is a citation-based measure of scientific impact. An h-index of n means that you have n publications with at least n citations. I only learned about h-index relatively recently and I think it is a quite elegant measure -- simple to compute, not too biased by a single highly-cited paper or by many low-impact (uncited) papers. Acuna, Allesina, and Kording took publicly available data and developed a model for predicting future h-index based on number of articles, current h-index, years since first publication, number of distinct journals published in, and number of articles in the very top journals in the field (Nature, Science, PNAS, and Neuron). Their model accounted for about 66% of the variance in future h-index among neuroscientists, which I think is pretty impressive. Perhaps the coolest thing about this project is the accompanying website that allows users to predict their own h-index.Since hiring and tenure decisions are intended to reflect both past accomplishments and expectations of future success, this prediction model is potentially quite useful. Acuna et al. are appropriately circumspect about relying on a single measure for making such important decisions and they are aware that over-reliance on a single metric to produce "gaming" behavior. So the following is not meant as a criticism of their work, but two examples jumped to my mind: (1) Because number of distinct journals is positively associated with future h-index (presumably it is an indicator of breadth of impact), researchers may choose to send their manuscripts to less appropriate journals in order to increase the number of journals in which their work has appeared. Those journals, in turn, would be less able to provide appropriate peer review and the articles would be less visible to the relevant audience, so their impact would actually be lower. (2) The prestige of those top journals already leads them to be targets for falsified data -- Nature, Science, and PNAS are among the leading publishers of retractions (e.g., Liu, 2006). Formalizing and quantifying that prestige factor can only serve to increase the motivation for unethical scientific behavior.That said, I enjoyed playing around with the simple prediction calculator on their website. I'd be wary if my employer wanted to use this model to evaluate me, but I think it's kind of a fun way to set goals for myself: the website gave me a statistical prediction for how my h-index will increase over the next 10 years, now I'm going to try to beat that prediction. Since h-index is (I think) relatively hard to "game", this seems like a reasonably challenging goal.Acuna, D. E., Allesina, S., & Kording, K. P. (2012). Predicting scientific success. Nature, 489 (7415), 201-202. DOI: 10.1038/489201aLiu, S. V. (2006). Top Journals’ Top Retraction Rates. Scientific Ethics, 1 (2), 91-93.... Read more »

Acuna, D.E., Allesina, Stefano, & Kording, Konrad P. (2012) Predicting scientific success. Nature, 489(7415), 201-202. DOI: 10.1038/489201a  

Liu, Shi V. (2006) Top Journals’ Top Retraction Rates. Scientific Ethics, 1(2), 91-93. info:/

  • September 21, 2012
  • 04:20 PM
  • 548 views

William Gosset: A True Student

by Pranab Chatterjee in Scepticemia

Today I attended a Basic Epidemiology class meant for the undergraduate students as I thought it would be good to brush up on my basic knowledge. The topics for the day were Hypothesis Testing and An Introduction to Randomized Controlled Trials, both pretty important ones, no matter which level you are studying at. What struck [...]... Read more »

  • September 21, 2012
  • 03:11 PM
  • 433 views

On Authorship, Part I

by Hadas Shema in Information Culture

Most articles today are results of teamwork, whether it’s only two authors working together or thousands, (think CERN). As science keeps getting bigger, authorship no longer equals actual writing, but one way or another of contribution to team effort.  Authorship of massive scale, or “Hyperauthorship” (Cronin, 2001) is very common in high-energy physics and certain [...]









... Read more »

  • September 21, 2012
  • 08:00 AM
  • 315 views

Academic astrology

by Zen Faulkes in NeuroDojo

Last week, I published a little post about my predicted h-index scores over the next 10 years. There has been more discussion that I think warrants follow-up.

First, I put no more faith in this predictor than I would in astrology. The h-index predictor ought to come with the sort of disclaimer that skeptics asked newspapers to add to horoscopes: “purely for entertainment purposes.”

Justin Kiggins made the best critique of the h-index predictor:


according to the H-Index predictor, my cat will have an H-Index of 9 in 2022




So in ten years, Justin’s cat will have a higher h-index than I do after 20 years of publishing science. In fairness, though, this is Justin’s cat:





More seriously, I was a little surprised by some of the discussions I saw around the Nature paper (Acuna et al. 2012). For instance, this news article botches the basic idea of the article.


But the new formula is more than twice as accurate as the h index for predicting future success for researchers in the life sciences.

It’s not “more accurate” than the h-index, it is the h-index. It’s just a way to predict h-index out into the future, when h-index is acalculation based on what you've done in the past.

There’s a few other things that are worth pointing out about h-index.

First, the whole point of h-index is that it is supposed to give some indication of scientific quality or reputation, and not reward people for publishing rubbish papers. Someone who publishes a lot of papers that nobody cares about or cites should have a low h-index. The theory is sound, but a recent paper found that the number of papers you’ve written explains 87% of the variation in h-index (Gaster and Gaster 2012).

In a way, this is reassuring. This suggests that most scientists are competent, and most papers are worth citing. But it suggests that paper quality is not very important to this measure.

Another issue is reproducibility. For instance, my h-index according to Google Scholar is 8. According to Web of Science, it’s 6. There is not way that h-indices are going to be calculated by hand by human beings; they must be done by computers running algorithms. And if different datasets give the different results, it’s limited in its usefulness.

Measures like h-index this are entertaining, and as I’ve said before, they are expedient. But the moment you hear any administrator seriously suggesting using these alone, in isolation, to make important decisions like tenure and promotion, run. Or fight. But don’t just accept it.

References

Gaster N, Gaster M. 2012. A critical assessment of the h-index. BioEssays 34(10): 832. DOI: 10.1002/bies.201200036

Acuna, D.E., Allesina, S. & Kording, K.P. (2012). Future impact: Predicting scientific success, Nature, 489 (7415) 202. DOI: 10.1038/489201a

Related posts

Expedience
Gazing into the crystal ball of h-index

External links

The Genius Index: One Scientist's Crusade to Rewrite Reputation Rules... Read more »

Gaster Natascha, & Gaster Michael. (2012) A critical assessment of the h-index. BioEssays, 34(10), 832. DOI: 10.1002/bies.201200036  

Acuna Daniel E., Allesina Stefano, & Kording Konrad P. (2012) Future impact: Predicting scientific success. Nature, 489(7415), 202. DOI: 10.1038/489201a  

  • September 21, 2012
  • 01:40 AM
  • 398 views

False-Equivalence Leads to Inaccurate Views On the Connection Between Vaccines and Autism

by Eric Horowitz in peer-reviewed by my neurons

The discussion about false-equivalence in the media tends to focus on abstract philosophical questions about the media’s role and responsibilities. This media-centric view isn’t unwarranted — after all, journalists are the ones who will have to solve the problem —  but it does ignore an important part of the equation: How does false-equivalence specifically influence [...]... Read more »

join us!

Do you write about peer-reviewed research in your blog? Use ResearchBlogging.org to make it easy for your readers — and others from around the world — to find your serious posts about academic research.

If you don't have a blog, you can still use our site to learn about fascinating developments in cutting-edge research from around the world.

Register Now

Research Blogging is powered by SMG Technology.

To learn more, visit seedmediagroup.com.