The Classical Schrödinger Equation

There is a common view, perhaps, that discovery is straightforward and the people involved know what is going on. In the interest of encouraging independent thought, and experimentation, I would like to present some apposite opposite evidence.

In my view, the course of history rarely runs straight, and it is often more confusing to those directly involved. You may think that you are doing one thing, but soon events and knowledge overtake you and you realize that you are actually doing something different. That has been my stark experience several times in scientific research.

I would like to present that experience in summary because I hope it will encourage young researchers to stick at their investigations.

Do not be dissuaded from your course of action by uncertainty, peer resistance or non-comprehension – whether your own, or that of ofter people. We are all human and the wonder of the new is that it can be most perplexing. Nature is a Chinese Puzzle. She has her way to be — your task is to find that out. The true Scientist is compelled to mold his or her mind to Nature and not Public Superstition.

Follow Nature where the evidence leads you, even against the Conventional Wisdom.

So it was for me in early 1991. I had just finished my first publication dealing with my doctoral work on Quantum Inference. This was one of the early works on Quantum Information Theory. It showed that the Heisenberg Uncertainty Principle was more subtle than people first supposed. When you take account of the statistical Law of Large Numbers, then you discover that quantum states can be precisely measured. However, you would need an infinite supply of identically prepared systems to be able to do that. I was looking for applications of Quantum Inference and so thought of experimental tests of the quantum transformation theory.

I reasoned that if you could measure states precisely, which you can given enough of them, then you might make a sensitive test of the so-called Wigner theorem. I started out as an experimentalist in Chemical Physics, so I knew all about ultra-cold atomic and molecular beams. I had done my Bachelor of Science thesis in the Research School at ANU on Vibrational Pre-Dissociation Spectroscopy. Using an atomic-beam setup, to shoot cold atoms through a cavity, you should be able to detect non-linearity via a failure of Wigner’s theorem. This is the simple thought that got me started.

So I started looking at possible generalizations of the Schrödinger equation. I knew there had been some work and that the subject was of considerable mathematical difficulty. Hence I resolved to test my understanding with a simpler problem. Since quantum measurement involves the coupling of a formerly well-isolated quantum system to a classical-level measuring device I wondered if the classical limit might involve some non-linearity. Perhaps when a whole bunch of particles got together, there would be a stronger non-linearity. It made sense to me, given that the Schrödinger Cat Paradox only applies to linear theories.

To test this idea I framed a simple mathematical question:

Can one find a wave-equation which propagates waves so that their position and momentum expectation values follow classical trajectories?

Of course, I knew about the Ehrenfest Theorem, but I also knew it was approximate. The goal was to look for an exact equation. Obviously, that could not possibly be the ordinary linear Schrödinger equation. It took me a whole year of constant reflection. Then the answer suddenly struck me like a bolt from the blue:

Of course you could! Moreover, the answer would be unique.

It all followed from a beautifully simple piece of group theory due to Herman Weyl.

I could see the entire proof laid out before my eyes. It was, in essence, a very simple geometrical construction. It was so simple I could not believe it. However, it was also perplexing because I knew I had done something, but could not figure out what.

It can be that way in mathematics sometimes. People like to pretend they know what they are doing when they do mathematics. This is a fiction. If you know what you are doing it is certainly old mathematics. I knew I had new mathematics. Then things fell into place. I could prove the equation was necessarily non-linear, and was unique.

Aha! I said. This is the nonlinear representation theory of dynamical systems.

Reasoning about my own mathematics, I recalled a paper by Weinberg which I had glanced at when finishing my PhD thesis. It was called Testing Quantum Mechanics. In a frenzy, I searched for his paper and was immediately gratified that the equations looked different. However, I am a good enough mathematician to know that simple appearances can be deceptive. Sure enough, I figured out how to generalize his scheme to wave-functions and find an equivalent result.

The Classical Schrödinger Equation was for real, both ways!

I was elated for a simple reason. Many people might assume that it is discouraging to find prior work on a similar track. This is not so. I was elated because I had found something peculiar in my mathematics.

Operators were secondary to wave-functions.

Try as I might, I could not banish this feature. Once I found the result in the equivalent scheme of Weinberg I could see why. I had discovered something. Schrödinger mechanics was more general than Heisenberg mechanics.

Operators were an artifact.

Furthermore, the Classical Schrödinger Equation remained exact for any value of the Planck constant. This was a great surprise. I checked and re-checked everything but it always came out the same way. Greatly puzzled, I figured out why. It involved a Taylor series style expansion that got you back the ordinary Schrödinger Equation.

Excitedly, I prepared a summary of my result and sent it to Weinberg. He was kind and very generous with his time and I presented a seminar at the University of Texas, at Austin on Jan 30th 1992.

I was very nervous and prepared and rehearsed my talk extensively. At that time, I had very little seminar experience. When you first start out it is difficult to get much practice. I worried greatly that I would make a slip in my math somewhere. This is natural for young people. However, important work is never that way.

If I can offer any advice to young researchers it would be this:

Frame and motivate your question clearly.

So, I gave my talk. The result was silence. I was baffled and perturbed. Weinberg was kind enough to ask me later what I thought my talk was really about. I explained that the scheme of mathematics he had proposed for testing quantum mechanics actually contained a complete and exact copy of classical mechanics.

He looked at me intently and said: Oh!

In that moment, I knew I had a problem. As the saying goes:

You broke it, you fix it!

Later I completed the mathematical proof that Copenhagen Quantum Mechanics is Incomplete. I was grateful nobody noticed.

It is a bad feeling to break a perfectly good theory when you don’t know how to fix it.

However, where there is a will there is a way…

Incoming…

The older I get the more I realize I made the right decision to branch out. Academic Physics was too much like Church for my taste. All Ceremony and Fake Wine.

Of course, I do appreciate and enjoy study of the Physical Sciences. However, I am far more moved by what happens in the Real World: hence my employment in Defense and Finance. These pursuits are intellectual but harbor a combative element. I do not by nature pick fights, but I cannot stand when the effort made elicits no reaction.

At least in military or financial affairs you can be certain of a reaction when you pull the trigger. That beats the sometimes deafening silence of politely disengaged academic discourse. Each to their own. We are made differently after all.

I realize now I was always cut out to be a Heathen Mongol and never a High Priest.

Quiet monastic omphaloskepsis was never for me.

Rather than lead the quiet life ensconced in The Citadel I would rather: Sack It!

300px-Bagdad1258
Hulagu’s army conducting a siege on Baghdad walls.

Lock up your Reliquaries, Pilgrims!

I am a self-confessed Heathen Mongol with a Ghenghis Kahn complex. Give me a band of Mongols and a Moonless Night. We could ride down from the Steppes, Sack the Citadel and make off with the Horses, the Gold and the Women, in that order.

It is when the World moves, that I feel Moved. When nothing happens at all, life gets very dull. What moves the mind moves the world – that is my motto.

No wonder I never fitted into the traditional academic world with that attitude!

Yep, a Hedge Fund and a private Helicopter Gun-Ship for me…

The best kind of scientific paper is like a sea-skimming Exocet missile.

It should come in low and fast, without warning, and take out the Flagship…BLAM!

Nobody, but nobody, should ever see it coming.

Then you simply Crash-Dive and lay low for a while.

Incoming…

Lost Papers #1 and #2

In a previous post entitled The Lost Papers of Highgate Hill I described my project to restore some old and long lost works. I have just put up two of these on arXiv:

UM-P-91/45: The Classical Schroedinger Equation

UM-P-91/47: On Quantization, the Generalized Schrödinger Equation and Classical Mechanics

At this time, the Internet was young and arXiv was a dream. The preprint system was largely paper based. This means that the fossil record has a few gaps which will certainly challenge future historians of science.

In my case, the two published articles:

Classical Mechanics as an Example of Generalized Quantum Mechanics

General method for deforming quantum dynamics into classical dynamics while keeping hbar fixed

were based on more detailed work done at the University of Melbourne in 1991. I just uploaded these to arXiv after restoration from floppy disk.

If you look at the references in the first paper from PRD you will find two references to preprints: UM-P-91/45 and UM-P-91/47.

Each of these was sent out for peer review and received hostile referee reports. The first I withdrew for a rewrite pending a clearer physical interpretation and the second was rejected and later rewritten to appear as the second paper above, in PRA. However, the rewrite of UM-P-91/45 never happened.

I did come up with the physical interpretation in a PRA article entitled The Exclusion of Intrinsically Classical Domains and the Problem of Quasiclassical Emergence, but The Classical Schroedinger Equation never made it to print.

Over time, I had so many rejected works in this area that I actually assumed that UM-P-91/45 had been rejected also.

In fact, as I now know from my records, I withdrew it from the Annals of Physics after the initial hostile review. All of this, including the original LaTeX source, got lost and forgotten for twenty years as I moved house, left physics and misplaced my notes.

The notes and files got boxed up at my late parent’s house in Queensland and then followed them around as they moved all over. Only now is everything back in the one place after my parents passed away and I found the lost material in their garage.

It has taken a little time to sort out the old electronic storage media and obsolete file formats but I can now bring the material back to life.

I suspect there are many people out there with the same problem. When you get through the slog it is worth it.

In my case, I has long assumed that The Classical Schroedinger Equation was rejected from the Annals of Physics.

It wasn’t. I withdrew it, lost it and then forgot what I intended to do with the manuscript.

Life is funny sometimes.

The Quantum-Classical Embedding Theorem

My last post on Church-Turing Noise aroused some reaction. In order to clarify further my uncomplimentary remarks about complexity theorists let me elaborate (a little).

I can see I will need to write a longer paper on this, but first let me tell a simple story.

Firstly, here is a PDF of the paper describing how quantum dynamics is a special case of classical dynamics: The Schroedinger equation from three postulates.

To put this in context, it was my (successful) attempt to re-axiomatize the non-relativistic quantum dynamics in a form suitable for considering non-linear generalizations. Very few physicists and, so far as I know, zero complexity theorists know of this result.

This is why it is extremely popular to preface each new quantum computing article with a statement of what quantum computers can do which classical computers cannot. The linked article above demonstrates that this language is too imprecise.

Using the above mathematical result it is obvious that any quantum computer (non-relativistic) can be simulated by a classical computer.

However, since it is also trivially obvious that the said quantum computer has an integrable dynamics, any non-integrable system cannot be simulated by the quantum computer. This is what I mean when I say classical computers can do things quantum computers cannot.

It would seem that the people in complexity theory simply do not know this.

They have assumed (wrongly) that because quantum dynamics contains non-commuting operators, and Hilbert spaces, and complex numbers, and many other neat things that it cannot possibly be less general than classical dynamics.

Well, they are wrong.

How come nobody seems to know this?

I think there is a simple reason.

Physicists have taught themselves day-in and day-out that the quantum theory is new and special and different and just so much better!

Well, yes, it is. The predictions differ and the scope is larger. I do not dispute that.

However, what they do not appreciate is that the underlying mathematical scheme is less general. This is where the complexity theory zoo gets interesting.

Guess what?

Not only does classical dynamics (in the abstract form above) fully contain quantum dynamics but a particular version of generalized quantum dynamics (an infinite-dimensional non-linear variety) fully contains classical dynamics!

Presently we have a bunch of complexity theorists delighting each-other with new theorems about how useless classical computers are.

What they have failed to comprehend is that mathematics (and Nature) are stranger still.

When you do the complexity theory properly then there is an infinite regress of one system containing another.

Linear QM is contained with CM in finite-dimensional form.

However CM is fully contained within Non-linear QM in infinite-dimensional form.

That means you can embed Linear QM within CM inside Non-linear QM.

(inside… ad-infinitum).

How about that for a cute trick?

Confused? You should be.

Conclusion: Complexity theorists do not know diddly squat about this topic.

So, where do I stand on this?

I developed the new axioms because I believe Nature follows a Non-linear dynamics.

If that is true, then an actual real physical computer in the REAL WORLD could do things that the complexity class studied right now (linear quantum computers) could not do. One of those things is to faithfully simulate dynamical chaos.

Over to all those super-smart complexity theorists to make their butterfly collection.

As part of that, the people involved will need to stop conflating two concepts.

The speed of execution is different from the scope of execution.

These are, I think, two different concepts.

One speaks to the physical and the other to the mathematical.

I suspect this is the ultimate reason for the above disagreement.

Church-Turing Noise

Call me a cantankerous old fart but I continue to find the quantum computing wars to be a singular encapsulation of the Breathtaking Stupidity of Our Age. There are endless papers proving statements about computation in the physical world.

While the assembled idiot authors are supremely confident in their respective proofs, they have not the wit to get down to actually building anything. Instead we are stuck with what I call: Church-Turing Noise. This involves people making assertions about what can or cannot be done in the Real World based on mathematical reasoning alone.

There is a rather elementary difficulty with all this contemporary noise and nonsense.

One cannot actually prove a property of the physical world through mathematical manipulations. It was not so long ago, as little as thirty years, that scientists, mathematicians and (yes) high–school teachers understood this fact.

It is central to the empirical nature of scientific knowledge.

Certainly, we can make postulates about the world. Definitely, we can axiomatize those into a series of abstractions with which to reason about the world. However, we cannot prove properties of Nature by cogitation alone. That path leads to Perdition…

However, the Road to Perdition is the path that contemporary Physics has taken – we are now deep into the Dark Age of Modern Physics. It is a terrible thing to witness, and poses a grave risk to human progress. I despair of finding common sense in this realm.

All cogent evidence of incompleteness in the quantum mechanical axioms has simply been ignored. Theories founded on different tenets which make acceptable contact with experiment have also been ignored. The fiction of certainty is substituted.

In place of educated questioning doubt, we now have uneducated voluble certainty.

Result: an Entire Generation of Non-Scientists busy proving the Nature of Reality.

They will, indeed they must, prove the Nature of Reality by cogitation alone!

There is no room for humble doubt that the ultimate axioms are unknown. NO. We are now certain we know the quantum rules. In that case, why bother with experiment? Why even build a quantum computer? How wondorous the achievement of our time!

We are quantum teleported straight back into the Dark Ages of Ignorance.

These are the Marks of Mediocrity, the dark foetid depths to which Science has sunk.

This was precisely the error of Greek Philosophers and something which took a genius of the stature of Galileo to dispel. In one fell swoop, this giant of human history torpedoed the Ptolemaic System. His direct observation of the Moons of Jupiter shattered the conception of Crystal Spheres, as dramatized so well in Bertolt Brecht’s play The Life of Galileo:

GALILEO Now we have proof. The fourth must have moved behind Jupiter where we can’t see it. There you have a star with another revolving around it.

SAGREDO But the crystal sphere that Jupiter is fastened to?

GALILEO Where is it indeed? How can Jupiter be fastened to anything if other stars revolve around it? There is no scaffolding in the sky, there’s nothing holding the universe up! There you have another sun!

SAGREDO Calm down. You’re thinking too fast.

GALILEO Fast, hell! Man, get excited! You’re seeing something that nobody ever saw before. They were right!

SAGREDO Who? The Copernicans?

GALILEO Yes, and you know who. The whole world was against them, and yet they were right.

Here we have the story of all scientific progress in a nutshell.

The prior belief, born of the Ptolemaic system, is the notion of a geocentric system with the planets and sun orbiting the earth. These were supported by crystal spheres.

Of course, in the dramatization of Brecht, Galileo and Sagredo are in discussion about the obvious inconsistency caused by the observations of moons about Jupiter. How could that be, if Jupiter was anchored to such a sphere? Surely they (the moons in orbit) would Shatter the Crystal Sphere. Whether factual or not, the point is well-dramatized. Inconsistent theories simply point the way to better theories.

Galileo was right: Fast, hell! Man, get excited about the Discovery of Quantum Incompleteness! You are seeing something that nobody ever saw before.

The connection between this piece of history and today is the continuing infatuation with quantum computation. Many otherwise thoughtful persons are caught in the grip of this psychological tractor beam. Quantum computing is special. Quantum computing is different. Quantum computing is Wondrous. The blather never ceases…

Certainly, computation on a quantum substrate will be different in many ways and not a little special and/or interesting. It will have serious commercial applications.

However, one can prove, in strong form, an elementary property of the mathematical systems employed in this crazy Church-Turing conversation.

As I showed more than fifteen years prior, in my Adelaide Festschrift article: The Schrödinger equation from three postulates it is possible to fully embed quantum dynamics inside classical dynamics.

(here is the PDF)

Let me try to explain what that means in practical terms for the benefit of the over-excited quantum computing types.

The mathematics of classical mechanics fully contains quantum mechanics as a special case. Here, as in much of the English language, special emphatically means less general.

In strictly provable mathematical sense, it is a specialization. For complexity theory zealots, that means any quantum computer can be fully simulated by a classical computer. Ohh… bummer. There goes the delusion of grandeur.

That is a genuine provable statement in the mathematical world. It is the reason why the present crop of theorem wielding wet-behind-the-ears complexity theorists can be very safely boxed about the ears and told to: 1) firstly, shut-up; 2) go away and learn some mathematics; and 3) come back when you understand what Science is actually about.

Of course, the astute reader will immediately respond:

How can you criticize people for using mathematical proofs to say something about the real world when you yourself use a mathematical proof to say something strong and didactic about the nascent field of quantum computing?

That is a very valid question. It is because I am using a mathematical proof to assert something about a mathematical system.

I am simply saying that, in a strictly provable sense, quantum computers (as a class) are less general and can be completely simulated by classical computers. We are not talking about what you can and cannot do in Nature. Indeed, that is a more open question.

Logically, and provably, this means that most of the discussion is about nothing. Folks are excitedly proving all the wonderful things that could be done by a quantum computer that could also be done by a classical computer.

Importantly, the classical computer in the above scenario is more general than the quantum computer. Put differently, the classical computer could do some things the quantum computer could not. One of those things is to simulate dynamical chaos.

You would think, would you not, that with all these mega-geniuses running around in quantum computing that they would know this?

Well, apparently not.

Perhaps they cannot read? Perhaps they cannot think? Perhaps they do not want to?

Who knows? Who cares? It is the Dark Age of Science, don’t you know?

Just make it all up and then go Make Some Noise.

How absurd the delusions of our time.

Towards Agile Physics

Something struck me the other day.

Why is it so damn difficult to progress Physics?

Some would argue: That is because the ways of Nature are Subtle and Difficult!

With that I would agree, but I think there is more to it than that.

I think perhaps the Physical Sciences could learn something from Software Development.

In the software industry, new ideas are constantly floated and rigorously pursued to failure and exhaustion. It seems to me that Software Developers very well understand that the Nature of Computing is Subtle and Difficult. Further, they are over feeling bad when a project did not work. They simply junk the source code and move on. There is no shame there, just a thing learned and a new brick in the foundations of the discipline.

What then of Physics?

Things do not work this way in the Physical Sciences. There is Precious Reputation to be defended. There are Ivory Towers to be built, and Gilt Ramparts to defend. Mostly there is Hierarchy and there is Orthodoxy. There are Popes and Priests and Cardinals. There are fancy cloaks, titles and prizes. Perhaps even funny hats and Ermine Collars.

In short, there is a bunch of Ceremony and Puff-Penguin Nonsense there for the Crowd and not Progress. It is Ritual Blather to dissuade anyone from Perspicacious Inquiry.

You see, Physics is a difficult enough Science that we manage to Canonize each faltering step forward. The moment one pushes a toe forward we have to canonize that and halt all further progress for a century or two.

It is the most agonizingly hide-bound Science on the Planet.

Think about it.

Right now we have grown Men and Women running around declaring that Many-Worlds is Gospel and Everything Happens at Once. They deny the very existence of the individual events on which accumulated evidence the theory is founded.

This is a Divine Comedy worthy of the Middle Ages.

Yet there are few voices raised against such nonsense.

It is Canon.

It is Gospel.

It is Law.

However, in my world it is Pure Bunkum.

Let us move forth in Agile Fashion.

Fork the Physics Kernel. Try new things. See what works.

Soufflé Subjects

Contemporary physics is home to many Soufflé Subjects. These are subjects born in ignorance, grown on enthusiasm and destined to die on insight.

Quantum Information Theory is one such subject. It is born of a misunderstanding, based on ignorance, which led to the enthusiasm, it is new and great, which will ultimately lead to the insight, a widespread understanding of a simpler unifying stance.

Let us start at the beginning, the misunderstanding.

Physicists believe they understand what a wave function is – it describes the probability of finding a point particle here or there. That is the essence of the Born Interpretation and the surrounding philosophy of Niels Bohr comprising the Copenhagen Interpretation.

It seems fair to say, most physicists continue to believe in the Born Interpretation of wave functions. However, it seems they no longer believe in the Copenhagen Interpretation, as it describes Quantum Measurement. In their view, that bit must be wrong somehow while the other bit, the Born interpretation, must be right. This thought process is natural. In the common view, it is best to change one thing at at time. Why change two things at once?

Of course, there is a fairly elementary problem with that attitude. Scientific theories tend to involve a series of assumptions which collectively are necessary to ensure consistency. The careless thinker assumes that it is perfectly okay to negate one of these without changing any of the others. Er, good luck with that Eugene!

So, where in this soup do we find clear evidence of a misunderstanding?

On my reading, physicists have already abandoned the idea that wave functions describe the probability of finding a point like particle here or there. They are busy constructing theories to say how accurately particles are found. Very clearly they do not believe in the Copenhagen Interpretation but they still believe in the Born Interpretation.

Curious, huh? How is that logical?

Clearly, they are mighty confused. On the one hand, they think a wave function describes the probability of a particle popping up somewhere. On the other hand, they want to describe the explicit dynamics of measurement to avoid this.

It is a perfectly confused amalgam of what Schrödinger said versus what Bohr and Heisenberg said. Terribly safe to pass the exam, but perfectly crap as a theory.

How does this relate to Quantum Information Theory?

Well, in that theory we suppose there are two kinds of information. We are supposed to believe that there is Classical Information and Quantum Information. However, nobody ever really defines what this means.

Why?

Answer: It is a Soufflé Subject.

When you prick Quantum Information Theory the subject deflates instantly leaving a ton of hot air. The reason is simple. The wave function itself is actually an unknown parameter, and you cannot determine it directly. Thus the probability densities we define on unknown wave functions are only known indirectly through inference of observations at the classical level. The information theory continues to be couched in probability terms, but there is absolutely no need for some special quantum probability or quantum information.

Sadly, this has eluded most workers. They continue to suppose that some “special” theory for probability and information is required. This is where the enthusiasm comes from:

Wow! Maybe we (physicists) get to re-invent everything!

Heroic physicists can replace: probability theory; information theory; control theory etc etc.

The jury will be out for some time, but I think the outcome for physics is just embarrassing.

Physicists simply lack insight. They are struggling to reconcile their view of Probability as Intrinsic (the Copenhagen Interpretation) with that of Probability as a State of Knowledge (Statistical Inference and Information Theory). This is a tension between two incompatible views, with the second one in the ascendant.

In short, the physics community is just taking the long way around. Physics is essentially the very last science to comprehend statistical inference in any level of depth. This is an uncomfortable position for physicists, since they like to think they are first to everything.

However, in this case Physics is definitely last with a bullet.

When you consider the possibility that probability is a state of knowledge, then many of the conundrums of Quantum Theory simply melt away. In particular, one can then view the wave function as an important latent variable, or to use the more common physical parlance, a hidden variable.

Let’s see: Engineers, Economists, Computer Scientists, Sociologists and even, the God Particle Forbid, Parapsychologists know what a latent variable is. Latent variables are the things you can only indirectly observe which you posit influence those variables that you can directly observe. In short, their values are inferred, a statistical concept.

Physicists, as a community, have the most immense problem with this concept. The idea of a latent variable, a thing which cannot be directly observed, is acid to their very soul. How could anything be hidden to the all seeing and all knowing God-Like eye of the Physicist? That is pure sacrilege! It cannot, it must not be. Resist to the bitter end!

This is such a soul destroying idea to one in the grip of the Mind Projection Fallacy, that it is a genuinely unthinkable thought. The simplest possible explanation, that the wave function is the hidden variable, is the one no practicing physicist can think.

Hence they do not, to their very great cost.

This idea, although simple and productive, is beyond their ken.

When you take this line of thought, things look very very different.

You are entitled to introduce probability densities on wave functions to describe your knowledge of them. You can sharpen your statement of physical theories by stating priors: such as de-coherent systems prefer to be in eigenstates of the pointer basis selected by the environment.

In short, the confusion simply melts away. The physics community cannot conceive of a probability density over a wave function, since that would be a probability of a probability. This is very confusing if you only ever learned that probabilities were frequencies.

However, if the wave function is simply a hidden parameter:

1) there is no problem with a probability density over its value

2) the hidden nature of the variable leads to an explanation for in-determinism

3) we do not need any new Quantum Information Theory or Quantum Probability

In short, the wave function is a dynamical parameter, an initial condition, so a probability density of that makes perfect sense. Further, the wave function is the natural non-local hidden variable underpinning observed stochastic behavior at the classical level.

That is the insight that deflates the soufflé.

The Mind Projection Fallacy

What got me really fired up with my last post was some of the recent literature I have read announcing ever more elaborate philosophical interpretations of the wave-function. It is my opinion that these attempts (too many to cite here) are afflicted with what E.T. Jaynes called the Mind Projection Fallacy.

The essence of this idea is the common affliction to mistake models for reality. There is a popular and equivalent concept of distinguishing carefully between Map and Territory. For those who like big words, the difference between Ontology (what is real) and Epistemology (what is known). It is my contention that contemporary physics is in a deep bind precisely because it has ignored this distinction.

The Shut up and Calculate crowd are complacent about what they think they know, while the philosophers obsessively change the words without changing the content of the theory. Each of these extremes leads to trouble.

So let me now make a bold assertion. I now firmly believe that important sections of the new quantum theory have already been published. Yes, you heard me right. Accepted for publication and in print.

This statement ought to shock people.

If there is a new theory of quantum mechanics already out there, then: How come nobody has ever heard of it? Surely with all these hyper-smart people running around in physics they could not be blind to the existence of a new quantum theory right under their noses?

In the journals they know and read? Surely not!

Let me explain why I think this to be the case and exactly why nobody has noticed.

Firstly, if the assertion is correct then how could people not notice?

Answer: Jaynes was absolutely correct. Physicists as a community suffer from the Mind Projection Fallacy. They fervently believe that their theory is correct and therefore they have stopped noticing difficulties. Now we are in the terminal phase of this illness. People not only do not notice difficulties, they do not notice solutions. How can you notice a solution to a difficulty you do not believe exists? Of course, you won’t.

It all started with a few small issues being swept under the rug. However, as time goes on little problems build up. I will state only two of direct relevance to this post:

1) the ongoing perplexing problems of infinities in treatment of self-energy; and

2) the apparent existence of a non-zero cosmological constant.

Of course, there are answers to both conundrums. The first is dealt with in the Standard Model through the program of renormalization, while the second was catered for early on by Einstein’s “great blunder” – his modification of general relativity to achieve a stationary universe by including a cosmological constant.

What if these two pat answers hide something deeper? Perhaps renormalization is simply a stop-gap. Perhaps the presence of the cosmological constant signals something else completely like a self-energy of geometry?

Secondly, if the assertion is correct, then: Where is the evidence of a new theory?

The best example I know is the Self-Field Quantum Electrodynamics of the late Asim Barut and co-workers. There is a lot more than that, but we are simply establishing prime-facie evidence for the logical possibility of my thesis.

Thirdly, if there already is a new theory: Why don’t people pay attention to it?

Here is an old conundrum: Why does mankind oftentimes fail to take heed of warnings?

A host of very distinguished physicists: Einstein, de Broglie, Schrödinger, Bohm and Bell, foremost amongst many, have been critical of the Copenhagen Interpretation of quantum mechanics. They thought it was missing something: that is was incomplete.

Niels Bohr persuaded physicists that these problems either: 1) had deeply philosophical answers; OR 2) were not to be considered part of the practical program of calculation.

In other words, Bohr persuaded folks that it was okay to blur ontology and epistemology. When one did not work, simply slip effortlessly into the other mode until your audience is mentally exhausted and simply gives up.

Whenever something did not make sense you should either: change the words employed, or try not to think about calculating anything. With this device you could happily sweep any problem under the rug.

However, over time this ruse has caught up with physics. There are now so many different words used to say what a wavefunction means that nobody knows anymore. Further, the different tricks and devices have turned fundamental physics into one giant hairball. It is next to impossible to know what to say, or what to do.

I believe this situation is now self-evident. However, the very many professional academic physicists out there will doubtless dismiss this appraisal as betraying a lack of familiarity with the wondrous advances of recent years.

I say: Hooey to that!

Let me close with a simple observation.

Some years ago I conjectured something I called the hypothesis of restricted observables. For now, I will give the one sentence, just go with the flow, formulation:

The hypothesis of restricted observables posits that matter waves are real, but that reality, as we perceive it and experience it, constitutes only the reduced one-body fields projected from the total entangled multi-body matter wave in configuration space.

In short, Schrödinger was right, with one small proviso of restriction, and Bohr and the rest of the team were dead wrong. And no, Dorothy, this ain’t philosophy. You missed your stop in Kansas. This is physics with a big P. The surf is up and the waves are huge today.

As a corollary to that statement, I would go further and state:

If I am correct then 99.999% of the Academic Physics community are dead wrong and we need a new theory. Since they do not believe a new theory is needed, and supposing I am right, they will simply read about it one day. They are not even in the race.

Let us close with a simple general challenge to the Academic physics community.

Here is a “picture” of the Electron Localization Function (charge density) as used daily by Chemical Physicists. The image is form a recent Nanotechnology article on experimental imaging of the electron density. That is (essentially) a one-body density.

I started out in experimental Chemical Physics so I have awesome respect for these people. They solve truly hard problems and do not have Particle Physics Big Head Syndrome. In short, they are good old-fashioned scientists.

Here is my challenge to academic physicists:

According to the hypothesis of restricted observables the above picture is a description of laboratory reality. Yeah, you read that right. That is it. Done and dusted.

The challenge is to prove this statement incorrect through experiment.

In return, I accept my own challenge – one of theory.

Can I build a self-consistent field theory based on the hypothesis of restricted observables?

I believe yes. The physics community (I warrant) believes no. One challenge speaks to ontology (decisive experiment) the other to epistemology (constructive theory).

People who do not understand why this challenge is real are welcome to simply have their heads explode on the spot. There is no shame in saying:

I won’t play, this physics game is just too perverse for words!

First you say: particle; then wave; then both; then what, exactly?

As a final icing on this cake, let us reprise the de la Vega Confusión de Confusiones theme and an old advertisement from the South Sea Bubble days. In that time, there were many prospectus offerings to raise money for dodgy ventures.

I am a financial guy, so here is the prospectus for my part of this here challenge:

…a challenge for carrying out an undertaking of great advantage, but nobody to know if it has been done already

Let the fun begin!

Confusión de Confusiones

Lately I have been reading some of the recent literature on Quantum Information Theory.

I thought I might just catch up with references and then write out a few of my old scribblings from the bottom drawer.

You have to remember, it is twenty-six years since I first started work in this field and fully eighteen years since I last published anything on it of any substance.

With that introduction, there has clearly been a lot to catch up on.

Well, I have been diligently catching up…

My conclusion thus far: Boy, is this subject confused!

People in Quantum Information Theory do not seem to know if they are Arthur or Martha.

Hence the title: an homage to the classic 1688 work Confusión de Confusiones by stockbroker Joseph de la Vega on the pure madness of crowds in pursuit of fame, notoriety and profit.

The lesson of Quantum Mechanics to the modern scribbler has been received and perfectly misunderstood. Go forth and multiply!

Take every well-founded subject known to man and turn it into pure mush.

There are interminable papers that claim to have re-invented pretty much everything.

We have, let’s count ’em:

Quantum Logic
Quantum Computing
Quantum Probability
Quantum Inference (guilty as charged)
Quantum Information Theory
Quantum Control Theory
Quantum Geometry

and the list just keeps getting longer by the day.

It seems that the lesson of Quantum mechanics to physicists has been this:

Everybody else who ever thought about anything is wrong – let’s go raid their larder, eat their food and then present them with our “new improved” version of their subject.

I have some serious difficulty with this notion.

On reading the level of confusion expressed by physicists about their own subject I doubt they are competent to write about anything much at all.

Furthermore, it seems probable to me that the condition of “fixing up other subjects” merely betrays a psychological projection of pure animal fear. I think the physics community have a scent: something is wrong with our subject.

Indeed, there is something wrong with physics. It has abandoned the scientific method.

The late (and great) Edwin T. Jaynes put it very well.

Physics suffers from the Mind Projection Fallacy.

The way out of this mess is to start by cleaning up Quantum Information Theory.

This is a soufflé subject in need of singular encounter with reality.

There is a mess out there, believe me.

Time to take out the trash.

Forking the Physics Kernel

Is the Tree of Field Theory Forked?
Is the Tree of Field Theory Forked?

There remains much unfinished business in contemporary quantum physics.

Perhaps the most important issue of all is the correspondence between the mathematical objects of the theory and the reality of the laboratory. This is an old wound in physics, one which split the Church back in the 1920s when our new theory first came down from the mountain. Moses may be long dead now, but Abrahamanic tradition lives!

In the red corner, we had Bohr, Bohm and Heisenberg preaching the doctrine of the incomprehensible other, the land of the small, which was inherently non-commutative and involved (shock horror) matrices. In the blue corner, we had Einstein, de Broglie, Schroedinger and a bunch of other malcontents believing in fields and continuity.

In our own world today, this schism has resolved itself most imperfectly. We have, it would seem, rejected both Bohr and Einstein. To make matters worse, we no longer read either Schroedinger or Heisenberg. Perhaps we have a Tree, but the Fruit is Strange and leaves a sour taste. It is most unsatisfying to the intellect.

Quantum physics today is a theory most perfectly severed from its roots and what came before. It drifts around like a fallen autumn leaf on a pond, executing ever so fine whorls of in-consequence.

The theory is now a mess, a very fine mess indeed.

We have rejected the Copenhagen interpretation and now favor some populist nonsense that Quantum Theory is so weird that book sales would be most increased by pretending that everything happens at once and everywhere.

We have Many Worlds and in each of them some book will be a best-seller, Goddammit!

These days the cognoscenti have stopped pretending that the Theory of Everything is “just around the corner”. No no no. Now the theory of favor for Everyman can be found just around whichever corner he chooses to look!

No longer do we believe that there is The Theory. No no no. Everyman must have his very own theory. Theories for all… that is the New Physics.

Go forth and Fork the Physics Kernel.

The more monkeys we have at the cosmic typewriter the better.

One day, one lucky monkey will strike out the riff that is gold.

A best seller.

Physics as Airport Novel.