Replication failure is not replication

A reader recently mentioned Coolessence. As the linked web site shows

Coolescence LLC was a privately funded research company located in Boulder, Colorado. The company was originally formed to rigorously examine repeated experimental reports of so-called ‘cold fusion’ (low energy nuclear reaction – LENR), generally manifesting themselves in the form of unexpected or ‘excess’ heat, from a number of scientists around the world.  Over the past 12 years the Coolescence team has replicated the most celebrated of these experiments, with no positive results that have not been attributable to measurement artifacts or chemical effects.

This page will introduce the study of the work done by Coolessence. The relevant papers are linked below. If readers are interested, reading those papers before I study them will increase experience and comprehension. If I know anything about LENR, it is because I have studied materials in the field over and over. It’s not magic.

I was quite impressed by Coolessence, in many ways. When I was planning a tour of the U.S. and Canada in 2015, I hoped to visit them … but that trip was cancelled when my Subaru, in the first fifty miles of the trip, broke a timing belt and the engine was destroyed. So, as far as I know, I have never met the principals. Late in 2016, there were private discussions with them on the CMNS list.

From my point of view, Coolessence demonstrates how to take high risk of wasting time and money . I intend, here, to review the projects they undertook. Mostly, these would not be projects I would have chosen for first work. To be sure, this is hindsight, and it took me a few years in the field to develop perspective.

Writing several years ago, I laid out Plans A and B for LENR breakthrough. Plan A was to have Rossi (or someone like him) save us by making products appear in Home Depot, or the like.

As I pointed out, Plan A was risky, but had the benefit of not requiring Any Actual Work by anyone (other than the inventor, of course).

Given the possible importance of LENR, we needed a Plan B, and Plan B was to undertake what had been recommended by both United States Department of Energy reviews (1989 and 2004). Basic science, to nail down and confirm or clearly disconfirm earlier findings.

Plan B began with Phase I. Phase I was to confirm, ideally with increased precision, what had already been confirmed. The point was not to reinvent the wheel, but rather to start with what is far more likely to succeed. Failure is a damned nuisance, unless it leads to learning. I had identified the work showing a correlation between anomalous heat and helium production as not only rather widely confirmed, but as much more strongly probative than simple isolated findings of anomalous heat, or tritium, etc., without correlations.

Looking ahead from there, Phase II would be work to create one or more “lab rats.” I.e., protocols with adequate reliability to be readily reproducible most of the time. This could actually create a “product,” such as standardized, prepared, and pre-conditioned cathodes for FP class experiments or the like. There are indications that these cathodes could be pretested and would later work as tested.

Phase II would study already-reported and, where possible, already-confirmed protocols, not new ones. The reason is, again, to make success more likely.

Phase III would be a wide variety of investigations, using the lab rats where possible, or creating new ones. Phase III would include attempts to replicate isolated reports of interest.

Phase IV would be blue sky. By this time, if the first phases are handled (with Phase I and II being completed), there will be plenty of money for wider explorations and playing hunches, etc.

This proposal did encounter some opposition in the field, because Phase I was considered to be a waste, since “we already knew that helium was being produced.” Tonto: “What you mean, “we”?

Many of us may know this (the evidence is actually strong, though there is much room for improvement), but “we,” i.e., the human and the scientific communities, don’t have this as collective knowledge. Yet. What will it take?

The DoE reviews laid it out: replications with improved methods, published in the “journal system.” The LENR community doesn’t trust the journal system, so there you go. That’s a self-maintained trap.

In any case, Coolessence describes five projects. I will study each in dedicated pages. Here is the list:

Studies
POSSIBLE NUCLEAR REACTIONS MECHANISMS
AT GLOW DISCHARGE IN DEUTERIUM (1992)
Intensification Of Low Energy Nuclear Reactions Using Superwave Excitation (2003)
Results
Glow Discharge Loading of Pd (2007)
Update on results at Coolescence, LLC (2008)

Studies
RADIATION PRODUCED BY GLOW DISCHARGE IN DEUTERIUM (2007)
Results
Partial Replication of Storms/Scanlan Glow Discharge Radiation (2008)

Studies
Use of CR-39 in Pd/D co-deposition experiments (2007)
Characterization of tracks in CR-39 detectors obtained as a result of Pd/D Co-deposition (2009)
Results
Search for charged particle emissions resulting from Pd-D Co-Deposition (2011)

Studies
Establishment of the “Solid Fusion” reactor. (2008)
Hydrogen/deuterium adsorption property of Pd fine particle systems and heat evolution associated with Hydrogen/deuterium loading (2009)
Results
MECHANISM OF HEAT GENERATION FROM LOADING GASEOUS  HYDROGEN ISOTOPES INTO PALLADIUM NANOPARTICLES (2012)
Origin of excess heat generated during loading Pd-impregnated alumina powder with deuterium and hydrogen (2012)
Mechanisms for Heat Generation during Deuterium and Hydrogen Loading of Palladium Nanostructures (2012)
Using Bakeout to Eliminate Heat from H/D Exchange During Hydrogen Isotope Loading of Pd-impregnated Alumina Powder (2012)
Effect of temperature gradient on calorimetric measurements during gas-loading experiments (2012)
Measurement Artifacts in Gas-loading Experiments (2012)

Studies
Data from Melvin Miles’ July 2016 experiment and My Recent Kitchen Experiment (2016)
Results
Miles Summer 2016 Ridgecrest Experiment – Coolescence Analysis (2016)

Impressions

According to the classification in my Introduction, Coolessence chose what would be Phase 3 or Phase 4 projects. Given the difficulties in the field, the probability of failure was high. In reviewing this, I will be looking for behaviors and approaches that may have fostered failure. Notice: “failure” means not finding a definitive conclusion. At first glance, the Storms/Scanlan study may have been successful. The others, as far as I have seen so far, did not find the same results as the original reports, so these would be “replication failures.”

“Failure” is not defined as not confirming LENR. If an experiment confirms earlier findings, it is a successful replication, but “findings” does not mean “conclusions.” If the work is left there, fine. It’s a successful confirmation of earlier results.

If it goes on, after that, and demonstrates with controlled experiment that the original results were misleading, i.e., artifact, that is a success (and to be careful, it should, itself, be confirmed. Sometimes, historically, that step has been skipped and premature conclusions drawn). And, of course, if it nails results, eliminating possible artifacts, or increasing precision, it is also successful.

Looking for what is wrong with an experiment or analysis is not the first step. Not ever, except in one way. If one can look at anomalous results and see an obvious artifact, one may not want to put in the effort to actually confirm, and that is a reasonable personal (or organizational) choice. Ordinary skepticism is there to keep us from wasting time. Taken too far, though, it can blind us.

The most recent “Replication” is misnamed. They did not attempt to replicate Miles’ results. Rather, they analyzed his data and came to different conclusions.

Importance

Again, from my point of view, most of this work was of low value, compared to other possibilities. Gas-loading is nowhere near the center of what has been well-confirmed. Glow discharge has always been iffy (and is quite dissimilar to the original findings). There is a general fuzziness that lumps together anything that might be nuclear.

I was originally quite excited over the SPAWAR work, but the neutron results, not the charged-particle results that Coolessence studied, which have always been shaky in some ways (with replicators showing a lack of precision in defining what have been called “SPAWAR tracks). I didn’t like CR-39, it is messy and difficult to interpret, LR-115 might be much easier (but Pam Boss told me that the absorption curve for LR-115 would not be as sensitive as CR-39. Maybe.)

Remarkably, When I opened a box Coolessence sent me (they donated a large cold fusion library to Infusion Institute), stuck in the box was a plastic ziplock bag with what looks like a sheet of LR-115.

No, the neutron findings are more interesting! But still there is a huge problem. The protocols SPAWAR used do not look for excess heat. And you run this experiment for five weeks or more and then pull and develop the detectors. There is no other indication of whether or not the original effect (heat) was present. It’s a small experiment and would not be expected to produce much heat, but this makes a SPAWAR study, even if it shows a radiation effect, close to anecdotal. And from other evidence, if radiation is being produced, it’s at very low levels and has little or nothing to do with the main reaction. All it does is increase the mystery and confusion.

In my 2015 paper, I suggested further study of one protocol other than measuring the heat/helium ratio, and that was the dual-laser stimulation approach of Dennis Letts. It appears that others agreed with the importance of this work. It is known that Industrial Heat worked with this, but that work was discontinued when they closed their lab and released the staff. There was an attempted replication by ReResearch, also published in JCMNS, vol. 20, 2016.

It failed. I notice an acknowledgement from the authors:

we would like to thank Coolescence LLC for the contribution of Pd
material to test in this experimental campaign.

Eek! It is known that the source of palladium can be crucial. There can be unknown impurities or structure present from manufacturing. “Perfect palladium” apparently does not work.

ReResearch showed that replicating Letts wasn’t easy. Letts has claimed high reliability, but that was in his own practice. He might be carrying just the right mojo hand.

McKubre laid out how to run replication; it starts with seeing the effect, where possible, in the original lab and then, step-by-step, this is moved to the replicating lab. As necessary, the original reporter participates in the new lab, the replicators want to see the effect in their own lab. Eventually, the work becomes completely independent and eventually, controls are added. This is painstaking work, done properly.

For future work, my hope is that helium measurement be added. This is difficult and expensive, but … consider the ReResearch work. They clearly did not obtain the FP Heat Effect (or it was not at adequate levels). With helium measurement, this could be confirmed. In the Letts work, the primary study is of the effect of laser stimulation and laser frequency. (This is dual-laser and the effective frequency is thought to be the beat-frequency of the two lasers, in the THz region, as predicted by Hagelstein.)

There are many details where failure is possible.

(One of the supporting activities in the field is and will be the development of more precise helium measurement methods and sampling protocols. My sense is that what already exists is adequate for work where there is significant heat, but if sensitivity and precision can be increased, this will allow the extension of reaction confirmation into lower heat levels.

Other work that might be classified in Phase II would be the identification of additional signals of the reaction. These do not need to be “nuclear” if they are shown to be associated with the nuclear effect. An example: suppose it turns out that the acoustic signals reported by SPAWAR are distinct and associated with reaction “success.” It could then become easier and faster to identify the reaction.

There are fire alarms that depend on heat. (Sprinker systems activate when a plug melts in the sprinkler, and then the movement of water in the piping triggers an alarm. But fire alarms can also detect smoke!)

With a strong signal like helium, if there appears to be heat, and there is no helium, this would then be additional grounds to suspect calorimetry error. Ultimate assessment should be based on extensive experimental series, and hopefully many measures, not just anecdotes and single measures, as has happened too often.

Author: Abd ulRahman Lomax

See http://coldfusioncommunity.net/biography-abd-ul-rahman-lomax/

4 thoughts on “Replication failure is not replication”

  1. Is there a report/document to help some academic/industrial group to organise a basic science effort on LENR.
    The one I would defend would be in line with early PdD efforts, like Coolescence, or even Iwamura&replicators.

    I remember Edmund Storms had such a proposal…
    Coolescence seems to have an interesting approach, even is some judge some errors were done.

    As far as I know, budget and workforce will be scarce, but just avoiding to redo past errors, to rediscover well known facts for experts, to reinvent what is known to work, may save most budget from waste…

    I cannot judge myself, so I will just report if there is something looking good.

    best regards.

    1. I’m not convinced that there is anything really well-done, to introduce LENR to non-believers. Often, people are referred to lenr-canr.org, which is massive. If there is interest, I will start a thread to identify the best document, and to support writing one if needed. In fact, we might do this on Wikiversity, it’s ideal for that. (Wikiversity can easily support alternate documents. It is not a one-page-per-topic structure, if there are any disagreements. Very un-Wikipedian.)
      Lenr-canr.org presents two documents: an Introduction, which then shows a series of articles, including A Student’s Guide to Cold Fusion by Storms.
      Okay, thanks to Alain raising this question, I know what is missing, why it is missing, and how it can be supplied, and supplying it could transform how society views cold fusion, or at last make a major step in that direct. Who is game? Who will support this effort?

      (edit: Actually, looking back at Alain’s question, he asked something different. A solution is roughly the same process. Both are great questions.)

  2. Abd – maybe you can characterise Plan A as hitting the ground running by some lucky chance, and Plan B as learning to walk before you run.

    Though the CR39/LR115 neutron tracks using co-deposition can be re-done, it seems that LENR neutron-production is very low (almost by definition). Given that naturally-occurring neutrons are not a constant flux but have random variations, it’s going to be difficult to be absolutely sure of the real source given just the tracks. Given that you’re running the experiment over weeks, and there really isn’t a good way of measuring the heat to sufficient accuracy, I don’t see this as convincing anyone on its own. IIRC, there was a choice of Pt, Au or Ag wires being used as the base, with Ag producing signifcantly more neutrons. May be interesting depositing on Nickel instead, given Mizumo’s results.

    Hopefully you’ll be able to report good results from the first phase of Plan B. That may need a special batch of the original Type A Palladium alloy from Johnson-Matthey, and a bit of luck in that the original craftsman who made it is still available or that the precise procedure was all written down.

    1. The Energetic Technologies protocol has been confirmed by SRI and ENEA. I don’t know what they are using in Texas.

      The idea with replicating the SPAWAR neutron findings was to attempt to create a uniform protocol and have many people run it. However, suppose it works. Suppose there are neutrons. The rate is very low and there is no correlation. So many controls are necessary, many repetitions, and other measurements. SPAWAR neutron studies, to be useful, would require a lot more work.

      As Pam Boss wrote the protocol, there was a choice of Ag, Pt, or Au. Krivit didn’t like that, wanted a single metal. At that point, the neutron finding was classified. So Pam chose Ag, which produces, as shown in a later published experiment, fewer apparent neutrons than platinum, and far fewer than gold. So the Galileo project used gold, and nobody checked the back side of the detector, as far as I know.

      There are many ways for a Galileo-class experiment to fail. Let your heavy water absorb some water from the air, there you go. Light water is understood to poison the reaction, and it doesn’t take much, 1% can apparently do it. Or, say, is the lithium chloride dry? The protocol did not mention taking any precautions.

      Coolessence did not attempt an exact replication of SPAWAR’s charged-particle work. The protocol was quite different. They ignored a basic rule: when attempting to replicate an experiment, start out with all conditions exactly the same, as closely as possible. Their conditions were quite different. The one attempt we made used LR-115. I was completely aware that this might fail. But it was cheaper than CR-39 and much easier to interpret, and I was looking for neutrons, so the LR-115 was actually outside the cell, where chemical attack should not reach it. I used a sandwich of films, emulsion-to-emulsion.

      Something happened to the films in development, they were mostly wiped. There was an undamaged area and I found a single triple-track in it. Stuff Happens.

      I don’t see that Coolessence got “SPAWAR tracks” at all, looking at that report. They interpreted what certainly looks like chemical damage as “SPAWAR tracks” and then attributed it to chemistry.

Leave a Reply to Abd ulRahman Lomax Cancel reply