The Warrior-Scout Spirit

Capt Reginald Walter Jones, MC, MM
Capt Reginald Walter Jones, MC, MM a deadly rifle shot

Today is an appropriate day to remember my grandfather, Capt. Reginald Walter Jones, MC, MM of the 14th Battalion of the 1st AIF. He was a decorated and highly effective Scout-Sniper and Company Commander in World War I.

He had a good war, meaning he survived, while his two brothers Cpl. Llewellyn Rowland Jones, MM (K.I.A. France. 18th September 1918) and Sgt. Raymond Leslie Jones (K.I.A. France. 11 April 1917) did not return.

In the case of Ray, 128 or more men of the 14th were K.I.A. on that day alone, not to mention the next. They were very ugly battles in those days. He was killed along with a total of 2260 men from the 4th Brigade in the infamous Battle of Bullecourt:

“So ended the Battle of Bullecourt, the most disastrous, the most bloody, yet perhaps the most glorious day in the history of the 4th Brigade.”
History of the 14th Battalion, AIF, by Newton Wanliss, 1929

People cannot relate to such things now, it seems incredible.

Nor do they remember Jones of the 14th, because the role of a Scout-Sniper is not well understood outside of the theater of operations.

If you want to know what a Scout-Sniper actually does, think of the character of SFC Norm “Hoot” Gibson in the movie Black Hawk Down.

That movie character was in fact based on an amalgam of real-life people: SFC John Macejunas, SFC Norm Hooten and SFC Matthew Rierson and their exemplary conduct at the Battle of Mogadishu.

That is what Jones and Jacka did during World War I, in and around the trenches and No Mans Land of the Dardenelles, Turkey and the Fields of Messines, France. There were no special forces or commando units then.

Certain men just volunteered themselves for the tricky jobs and got them done: Capts. Jones and Jacka at Messines. Jacka in the Dardenelles for a Victoria Cross.

Jones, Jacka and Wanliss
Jones, Jacka and Wanliss

Although Jones enlisted as a Private, the Army soon figured out that he was a deadly rifle shot and promoted him. As in any war, the best shooters become snipers. With that, naturally goes the role of scout. This involves missions to probe the enemy and determine threats, and to find weaknesses in their defenses.

Such work requires men who are very resourceful, quick-witted, and fearless under fire. Their role requires high powers of observation and intuitive perception. This means they often work alone. A good scout may stake his own life on his own intuition and abilities, but will not risk the life of others without cause.

That is why scout-snipers often appear to be outsiders. They make a wall. Reg did that.

However, that does not make them poor leaders of men. On the contrary, Capt. Jones led companies in France in action alongside those led by his good mate Jacka. Jones of the 14th was by then a highly regarded combat veteran, and counted as one of the “three or four best men”, in the AIF, in the company of that deservedly famous soldier Capt. Albert Jacka, VC MC and Bar, according to the official War History.

Jones was effective in command, and as a soldier, because he was single-minded and had a simple view on leadership by example.

Strategy according to Jones:

Form a Shooting Gallery and stock it with the finest riflemen in the Battalion.

Tactics according to Jones:

Shoot every man who pops up his head, stone cold dead.

Risky Business - Gun Shot Wound to Shoulder
Risky Business – Gun Shot Wound to shoulder from opposing sniper

He was never a cruel man, but he knew the enemy sniper was a clear and present threat to him and his men. It is the threat, and not the man, that must be eliminated.

It was that simple.

The sniper's curse: bullet fragment in the eye from opposing sniper ricochet.
The sniper’s curse: bullet fragment in the eye from opposing sniper ricochet.

As a sniper, he accounted for over fifty Turkish soldiers and snipers in the Dardanelles. He was shot several times himself by enemy snipers and lost many mates, shot right beside him. They would work in teams of two with periscope and often one got hit.

In later life, he would recount such tales of war. It was never with pride at having taken the fathers and sons of many families. He was a deeply religious man who lost many friends and both his brothers in the Great War. However, he did consider that he had shot well. He had shot across ravines, through brushes, and dust and swirling smoke at ranges of up to a mile in harsh and deadly conditions. That was the only thing he really took pride in. He did his duty, shot well and survived.

Understandably, while he had a good war, he had a difficult peace.

Even today, the Special Forces and other highly demanding roles for the professional soldier are not well regarded. Society does not rightly understand what it demands of young men and women when we send them off to war.

This is very unfair to such men and women. They do their duty for their country at great personal physical and psychological risk. We demand a Titanium Psyche of them and we really should respect them for taking on such a burden.

Reg certainly had a powerful psychic presence. That I recall, but we did not interact much when I was a child. He passed away before I was five.

In truth, he scared the Living Daylights out of me.

However, as any small boy, I did admire his 0.303 Lee-Enfield rifle. That was some kind of weapon, designed for a shooting war with two opposing galleries and a mountain of mud and guts in between. That 0.303 is what got Capt. Jones through the war.

That, and a very cool head for risky situations.

The official history describes Jones as an “aggressive” soldier, however he had a clean war record, all 174 pages of it. Occasionally, he would get into minor skirmishes with superiors over this and that, but nothing serious. In our family, the story was told that he was busted for jumping ship in Italy to go and see Rome, because he did not want to: “Come this far and miss it.” However, I could find no mention of that in the war record. In any case, if he was busted, he was very soon promoted once more.

The AIF so respected Capt. Jones that when he asked for something he got it. He had been shot up a lot already, and then his brother Ray was killed in action at the very bloody Battle of Bullecourt. His mother and sister became sick with grief and worry. At his request, the AIF gladly sent him back to Melbourne for two months with their blessing. Then he went straight back to the front in France.

Special leave granted to return home and comfort his family.
Special leave granted to return home and comfort his family.

People say the Word War I command was harsh.

The Australian Command were tough yes, but in the AIF they respected good men.

Jones never shirked a battle, but was often in hospital. On one occasion, he manged to blow his own thumb off when probing a captured German Flare Thrower. The official War Record makes very clear this was an accident and was no fault of Jones himself. People today would not understand what that means. In those days, if you shirked a battle through intentional self-wounding, the command could, in their rights, have you Shot as a Deserter. That’s War. No Shirkers. No running from what needs doing.

Reg blows his thumb off by accident.
Oops! Reg blows his thumb off by accident.

The highlight for the military career of Capt. Reginald Walter Jones was his award of the Military Cross for a daring raid in France. He covered 800 yards of open ground under heavy machine gun and sniper fire to disable and capture a German gun emplacement. He captured three 77mm German guns and a large cache of ammunition. The result was an advance of the whole line by 800 yards at one stroke.

Commendation for Military Cross: This operation resulted in an advance of 800 yards into hostile territory, he displayed the greatest tactical skill and judgment throughout.
Commendation for Military Cross: This operation resulted in an advance of 800 yards into hostile territory, he displayed the greatest tactical skill and judgment throughout.

Not a Bad Day Out in France for a Bloke from St Kilda!

True to form, Reg got himself shot, just enough, by accident, and not too much: through the cheek and neck. That was an MC. The wily fellow was sharp enough not to get himself killed and risk a posthumous VC.

The real prize and commendation was to: advance the line and survive.

Today, of all days, I am proud to remember my grandfather: Capt. Reginald Walter Jones, MC, MM (returned). I am especially proud of the last citation: returned.

I have to say, I was not always proud though. Sometimes, the whole family history really creeped me out. When I was a child, I would say to the other children in the playground:

My Grandfather, Reg, shot fifty Turkish snipers at the Dardenelles!

Then the other kids would not play with me, so I never ever spoke of it again.

However, now I am older, and wiser. The veteran of my own battles, I say:

My Grandfather, Reg, sniped for The King so he could go hunt Grouse!

That is the proper division of labor in any society:

Those who can shoot, Snipe.

Those who can’t shoot, hunt Grouse.

I really hope my grandfather can hear that now.

It would bring a smile to his sometimes strained face.

He was a good man: “Jones of the 14th”, and I am proud to be his grandson.

On ANZAC day, my thoughts go out to all who have fought, loved and lost in a War.

Rhyme and Revolution

genghis
Where to now? People suppose that society gravitates to order.

I do not think that the natural state is chaos. Mankind greatly prefers order. However, the creation of a Fresh Order is always difficult, particularly in the World of Ideas.

The Greeks were right. Man is a Teleological Creature, animated and propelled by spirit.

Here, I follow Carver Mead. His thoughts on physics energize me. They make sense.

His recent outing at an electrical engineering conference impressed me.

The essential point that he made is this:

Science Ultimately serves Humanity.

This goes double for the Engineer. If your ideas help no-one then why have them? You must develop and simplify your ideas to move us all forward.

Carver Mead has spoken of the Crisis in Physics. This once noble subject, which has served as the bedrock of Engineering, now seems to be a Rotting Corpse.

The people in it seem to have forgotten that Physics is useful, even if it is old physics. I would go further, the Old Physics is the most venerated and useful of the lot.

What do we see instead?

An endless obsession among Academic Physicists for: New Physics.

This is an ego-maniacal exercise on the part of the community to “Wipe the Slate Clean” and Enter the History Books. Hence the recent comment of Mead:

A Bunch of Big Egos are Strangling Science

I think he is damn right. On target, to perfection.

The essential problem is that Physics cannot change quickly. Nature does not change her laws. Why pretend that New Physics is Always Just Around the Corner?

This is lunacy. It is also damaging to young careers. Expectations are too high.

Classical Physics evolved continuously for some 300 or more years after Newton. The laws did not change but the depth of our understanding of them did.

That is the Clarion Call of Mead:

For God’s Sake People: Let us make the Present Quantum Theory Make Some Sense.

Consider this. The majority of Physicists will not rise to this challenge. They respond, weakly and wanly, in the spirit of Feynman:

Well, Gee, Nobody Understands Quantum Mechanics!

Well, did you ever goddam try? Really! I like Feynman, but this crap really annoys me.

It is a holier-than-thou attitude. I am Feynman, I tried, and it did not work out for me.

Mead made a valiant attempt at this goal in his monograph Collective Electrodynamics.

The book seems to have received the same attention as his talks.

None.

I find this perplexing.

How can people claim that it is legitimate to run around claiming all kinds of grand insights into speculative physics such as String Theory and then Pooh Pooh every considered effort to understand the: Goddam Theory We Already Got?

In my opinion, Mead is spot on in his critique. Laser sharp and right on target.

You may think his solution poor, but he goddam tried.

All the Big Egos are off very safely speculating on things that will never be examined.

The solution, I feel, is obvious.

Let Engineering Inherit the Earth.

Physics is One Lame Mule.

Put it down now. We could take the theory we got and just work hard at simplifying it.

I can see massive opportunity to do this already, and society is alive to understand Quantum Mechanics. For some bizarre reason, the public want to understand it.

Not the Teleportation Bullshit…

I mean understand how the world actually works without the Holy Wow Shit.

People want “To Get It!” They are hungry for actual real live working understanding.

So: Stop Bullshitting Folks! Stop pretending that blowing Opaque Colored Smoke out of Every High Priest Orifice counts for understanding. It Counts for Nothing.

It is a Ruffle Collar and a Purple Robe and Bunch Of Cryptic Latin Verse.

Right now, I see zero evidence of that among the carefully groomed Egos of Big Shots.

I see an endless: Fan the Flames of Confusion Ego Trip.

A droning dull as dog crap incantation: This stuff is so weird you will never ever get it.

Bullshit! That is why I am not a Physicist anymore.

It is just too Goddam Embarrassing.

I am a Quantum Engineer.

The Mongol Way

shootbackThe Mongol Way
I Genghis, Scourge of the High Priests of Quantum Zealotry, and fond admirer of the Color Blue of Eternal Heaven, do hereby declare:

1) The Mongol Horde shall only trade in: Marketable Theories of Something.

2) Trade in Theories of Anything, Everything and Nothing is: Punishable by Death.

3) Jousting for Mind Fluff, is permissible, but only on Feast Days, which are held daily.

4) Those traveling without a passport stamped “j” will be the: Object of a Game of Polo.

5) When a choice of color is involved it shall: involve Blue.

6) When no choice of color is involved it shall: be Blue.

7) There is no choice for the square root of minus one – It Shall be “j”, The Mongol Way.

8) Those under the banner of “i” shall be hunted down mercilessly – You “i” You Die!

9) Loyalty to “The Mongol Way” enjoins: Merchantable Solutions to Many Problems.

10) The Mongol Way is based on merit. You solve it, you enjoy the: Spoils of Plunder.

The Mongol Horde may lay siege to any problem under the: Blue of Eternal Heaven.

The Spoils of War are Yours when: The Back of Opposition is Broken.

Bury your Gold. Lock up your Horses, your Women and your Goats.

The Mongol is Coming!

The War of the Copenhagen Succession

War of the Spanish Succesion
War of the Spanish Succesion
The concept of a War of Succession is well established and deeply rooted in history.

In essence, it represents the natural human reaction to a Power Vacuum.

I may comment primarily on Physics, for this blog, but my audience should understand that economically I am a Professional Investor. Sure, I know physics and you will, by now, understand that I am opinionated (Ed. No, really? Ed. Yes, you Dozy Bastard!).

However, from a professional, earn my crust, battle-proven, perspective I am an Investor and Trader. The last qualification, the single word Trader, is significant.

Emphatically, it means I am a Turncoat.

I would just as happily buy you as sell you. Not You specifically, but my inventory exposed to the thoughts and actions of you as I perceive them. If I see a glut of Bananas coming then I will certainly sell you Bananas.

However, mostly, I will not appear eager to do so.

Why would I want you to know that I have too many bananas?

Well, even that depends. Perhaps you are a great customer and I will warn you?

Then again, perhaps not!

That is the thing about traders. They are, well, Traders. You can trust them but only if you move with the times. I say this because very many people despise traders. They say: Why do you first sell me bananas and now lemons?

Er, you got good grades in school: Work it Out!

Back to the War of Succession.

What has this historical phenomenon (repeated over and over and over again) have to do with trading? It is very simple. People are made differently, which is a Good Thing. Traders know which way the wind blows and when it blows they Change.

They have a knack for self-preservation. Like a Cat, they land on their feet. They are non-aligned and say things that will certainly piss off: Somebody – All of the Time.

You do not actually need many such people. Their function is limited and their craft is very murky. On the other hand, you do need many stalwart people who more or less assume humanity is: Well-Directed – Most of the Time.

In Roman terms, these people are the proverbial Salt of the Earth. They are good, hard-working, caring people who contribute actively to progress.

They are the Bulk of Society.

However, let me remind you of a strange geological fact.

Every so often, the magnetic field of the Earth reverses. What was the North magnetic pole becomes the South and vice-versa. I mention this fact, not because of any mystical connotation, but to explain for what reason a War of Succession happens. The majority of folks have no interest in Hacking the Kernel of Human Nature. However, if you want to be a good Trader, and certainly if you crave Excellence, you must.

When the magnetic field of the Earth reverses… that is a War of Succession.

People seek security in Authority because they are generally good, hard-working souls. They rightfully expect that authority, certainly Authority of Noble Descent, will reward them for their labor. That is reasonable, and the normal state of affairs.

Beware though! When the stars realign and the field switches polarity then: The Old Allegiances are Thrown into Chaos. The Ancient Greeks knew this well, from bitter experience, and invented a bunch of Remedies.

Tragedy, Poetry, Philosophy and many other sundry diversions including Wine!

Modern Man is ill equipped for the present shift in thinking. It takes many forms and is near Universal. Contrary to a bunch of popular nonsense, it has nothing to do with The Mayans, Astrology, Disaster, or the Urgent Need for Nuclear Weapons to Fry Incoming Asteroids. However, it has everything to do with finding new productive ways to live.

When traditionally productive activities are threatened then the Good Folk, who make things happen, who care little for hacking human nature, feel threatened. Indeed, they are Restless for a Reason.

The old ways of living are not working and so there is desperate search for New Authority. Often that involves the Canonizing of, or Demonizing of, Old Authority.

Just like Football Teams! This is Our Time, Right Now.

In such times, it pays to know History.

The title of this blog: The War of the Copenhagen Succession betrays my concern.

I see a great Foment of Activity about a simple fact: Modern Physics is in Crisis. It has just this year progressed from Theories of Everything to Theories of Nothing. This is a manifestation of Social Crisis. Niels Bohr, with help from Werner Heisenberg, gave us the quite useful Copenhagen Interpretation of Quantum Mechanics. This concerns our deepest and most mysterious theory of how Nature works.

However, that theory is old now… 85 or 100 years old, depending on how you count it. Humanity has grown out of it, and asks questions which the theory denies entirely.

Ergo… the geomagnetic field reversed and that World View is Toast.

Like all theories it was and is a Mental Construct. It is an impermanent Approximation to Truth. However, folks do not comprehend how the picture we employ of the world may well turn on a dime. They do not concern themselves with philosophical nonsense!

One year the earth is flat, the next it is round and we have potatoes.

This perplexes folks and leads to Wars of Succession. If now the world is round and we have Potatoes, what is to become of my Aubergines?

Shall I mount a protest and Storm the Bastille?

My advice, as a Trader, is: Never Fight Change.

If the mind of the physicist should move – like a Star Quake – from contemplation of Theories of Nothing in the direction of Theories of Something then do not fight it.

Just work out what people will Buy in that New World!

Even better, if you really want to survive, be the Agent of Change.

The Eye of the Storm is the Calmest Place in God’s Firmament.

The Mongol Horde

220px-YuanEmperorAlbumGenghisPortraitGenghis Khan
A striking feature of the Academic Physics Community is the failure to engage with its own diaspora. I left because I was completely bored with academic research. I had no shortage of new results, but the culture of physics research in those days was toxic.

Firstly, there were the infantile rejection letters and stupid priority fights. Secondly, there was the unashamed plagiarism, which I experienced first hand. Finally, there was the ignorant Sun King attitude of leading professors when you showed them something different that they did not already know.

Let them Eat Cake and Dine on Stringy Ectoplasm.

Not for any of these people a research path that may actually lead to success!

When you deal with that kind of nonsense at a formative age it kind of changes your view of the world. I made up my mind in 1995 that Academic Physics was certainly headed for a Titanic Fall from Grace. I just up and left in search of greener pastures.

However, now I can discern how that very fall might encompass a rise in the general level of research quality and a fuller public engagement for Physics – The Enterprise.

As I see it, the central issues to be addressed are these:

1) The Academic Physics Business Model is Busted

2) It is Illogical that The Physics Diaspora are effectively excluded from research

3) The push for New Physics is delusional with regard to the claimed social benefits

Let us take each of these in turn and then propose a partial remedy.

The Academic Business Model is Busted Since the 1950s and 1960s expansion there has been a near universal business model for the conduct of physics research. Outside of a handful of industrial labs such as Bell labs and IBM Research the bulk of physics research was academic and grant funded.

Success in this world required tenured status as a Professor followed by expansion of the venture through public grant moneys to hire and employ graduate students.

Result: a huge expansion in product, both research papers and PhDs.

Sometime around the 1980s and 1990s this business model began to break. It is no surprise why. It has the properties of a pyramid scheme.

To progress a career one needed to manufacture more PhDs. Very soon there is no room for all the PhDs and they get sent out into the big wide world. Nothing wrong with that! However, as the Professors who stay behind compete ever more furiously for grants they get more and more specialized.

Worse the product is research papers which can only be read by other specialists.

That is where we are now. Overly specialized PhDs who come out knowing a great deal about the abstruse and speculative elements of the research frontier. The vast bulk of what they know is not established in any way shape or form as Science. A great deal of it is Pure Junk and useless to society at large. Worse, the poor PhD never learned any of the eternally useful old-fashioned physics that describes how Nature actually works.

Result: a glut of hyper-arrogant know-nothing specialists in speculative souffle subjects. These people are useless to hire in any engineering enterprise and dangerous when set loose in financial markets. You give them a Vanilla Mortgage and they make a Constant Proportion Portfolio Insured Portfolio of Synthetic Collateralized Debt Obligations with a Neat Auto-Destruct feature when the capital buffer falls below 5%. Light fuse, RUN!

That is a thoroughly broken business model.

The Excluded Diaspora As anybody who did leave graduate school can attest, the attitude of the professors to those who leave is often rather arrogant. They look down on PhDs who entered commerce in search of a living as “not cut out for research.”

This is a stupid attitude. There are now far more physics PhDs outside of Academia than there are inside. The critical mass of brain power is not in the Ivory Tower.

It exists outside the Walls of the Citadel.

It is a Mongol Diaspora, happily living out on The Barbarian Steppes of Commerce.

Far more significantly, and against the professorial prejudice, the folks outside of the Academic environment are often among the more engaged, capable thinkers and creative problem solvers. They typically entered graduate school because they were gifted academically and chose physics since they liked to think about how things work. However, once exposed to the arrogance of professional research and the stupidity of its mores they simply left in search of a more stimulating and rewarding environment.

I know many many physics PhDs around the world who fit this description to a tee. Furthermore, since they were forced to make new careers in a host of different fields they are much more open minded about science than the typical academic. They actually have very fertile minds and great preparation for cross-disciplinary work.

This is where most scientific advances are made. However, Academics typically prefer to specialize. Once you are an established expert in a tiny area, cross-pollination is viewed as an existential threat.

The Push for New Physics is Delusional I myself am involved in a privately funded effort to develop a New Quantum Theory based upon the Barut Self-Field Quantum Electrodynamics. Therefore, this last point may seem a bit contradictory. How can you say New Physics is Delusional when you are pursuing exactly that?

The point I would like to make is that genuinely new physics generally springs from exposure to important problems. One of my associates and collaborators is involved in fracture mechanics. This is a key area of materials science and engineering. The other day he shared with me how old fashioned the models are. We agreed to work together on it. We saw a huge opportunity overlooked by the Academics.

The delusional element in the typical push for new physics from Academics is the idea that they will find it by pursuing a grant application. The risk calculus of research grant applications is that you should never ever write one unless you already know the answer to the problem being posed.

Ergo… they are a complete and total waste of money.

The best way to find new things is to be exposed to a rich array of hard problems that matter. Academics generally shun such dirty, messy real world problems because they mess up the grant application! The Research Hamster spins ever faster to make the stuff we already know less readable. Hell, Physics with Functors! Why Not?

I see this now with the on-going D-Wave quantum computing saga. In various of my own business interests I deal with solid commercially minded enterprises who are evaluating the technology.

About this development I have some bad news for the quantum computing zealots. The feedback I have is that this new architecture is well suited to complement more traditional processing for constraint problems.

The buyers of D-Wave computers (we are up to #4 now) do not give a Rat’s Arse what the dang thing is called. They do not fundamentally care if it is called a quantum computer or not.

Hell, you could have called it the Windows 666-Box and they still would have bought!

They just care about solving a commercial problem.

That is commerce 101. Meanwhile, back in Academic Zealot Land we have spent billions of public dollars to work out that $$15=3\times 5$$. You get the point. Superconducting electronics now has an emerging marketplace. Thanks to who?

Thanks to D-Wave.

The Mongol Horde – A Remedy Academic Physics has Jumped the Shark. It promised this World, a Teleportation Machine to New Worlds, and a whole new Parallel Universe of your own. In place of that we got:

Icky-Sticky Pea-Brained Stringy Ectoplasm and A Splendid Theory of Nothing.

The Citadel is now chock-full of Quantum Jumping Half-Crazed Lunatics.

The PhD trained physicists that I correspond with are all members of the Academic Diaspora. They all pretty much shake their heads in unison about how sad and twisted physics has become. Reading the headlines of the science reporting magazines is one long succession of Psychobabble, Fudge and Souffle.

I believe there is genuinely New Physics in the wings but I do not trust any Academic to find it. It would seem to me that they are diligently ignoring the specific evidence about where they should look for it.

Recognizing this fact, I think we can introduce a New Business Model for Physics.

This is an idea borrowed from an article published in the The Clute Institute Journal:

Big Physics At Small Places : The Mongol Horde Model Of Undergraduate Research

The central thrust of that experiment was to engage undergraduate students in a big physics project at the accelerator labs. Through bringing eager students into the process of detector design and development the researchers hoped to get more value for their grant dollar and also some able young minds on the job.

The most delightful idea in this paper lies embedded in the title: The Mongol Horde Model of Research. I love this idea so much I am going to run with it.

However, I aim for a much more ambitious experiment. Given the earlier work I did in nonlinear field theory I think it is feasible to build a New Quantum Theory. I am going to release my own bottom drawer research as start-up capital to seed this project.

The Mongol Kernel Fork of the New Physics will be hosted at www.MongolPhysics.com

There is plenty of work to be done, so I am happy to crowd source the parts that I am missing. The product will, of course, be modified equations, but much more importantly it will be software that implements them. The focus will not be the Delusional Dance of New Physics but the practical commercial goal of Non-Perturbative QED.

We will see if the Mongol Horde can accomplish what the High Priests could not.

A Genuine Theory of Something.

Subversive Epiphany

I have just gotten back from an extended business trip to the United States.

This was a lot of fun. I went to the SIAM Boston meeting on Computers in Science & Engineering. Later in the trip I went to PyCon2013 and PyData2013 to catch up with where things are at in the Pythonic universe.

It is probably close to fifteen years since I have been to a scientific conference. I very much enjoyed the developments in computational science since they involved many practical problems.

Regular readers of this blog will appreciate my love-hate relationship with mainstream physics. I tend to get very annoyed when I read physics journals, but I do enjoy the computer and applied mathematics literature.

However, I may yet come to some rapprochement with physics-at-large.

The epiphany for me was the sudden realization that most physicists today do not seem to believe in the Copenhagen interpretation but they do believe in point-like particles.

I don’t know exactly when that dawned on me, but it was somewhere in the middle of listening to some talk on numerical solutions of the Schroedinger equation in the semi-classical regime. None of the correspondents in that session seemed to know anything about my work in this area so I kept quiet.

I did not want to spoil the fun of searching for the elusive classical limit.

Reflecting upon what I already knew to be a grand folly I realized that physicists in general seem very sure that they know what rests within the Schroedinger equation. Look at it this way. They know three things:

1) the Schroedinger equation is right
2) the Classical world seems real enough and sensible
3) therefore, it must fall out of the mathematics somehow

All very sensible, but sadly untrue. The relevant mathematics does exist but is not what they are looking for!

Now to the epiphany. The physics community, in general, believe that we know particles are real. However, they are confused about what a wavefunction might be or mean since a wave is clearly not a particle!

What the community has yet to appreciate is that in a certain limit, that of the Classical Schroedinger Equation, the wavefunctions do bounce around, scatter and behave exactly like particles. However, that is a limit where the wave aspect of the physics is frozen out. You get to the idealised particle from the wave description.

However, that regime of behavior is very special and only ever approximate.

Let us now turn things around. Suppose there are no particles at all. Suppose that is merely an illusion and matter is pure wave. Even further, suppose that the phase of that wave is the gauge field (e.g. the photon). Then there is no light separate from its sources. They are part and parcel of the same phenomenon.

In that case, we have things perfectly upside down. We are using a micro-level mental picture of particles and then wondering why the classical level continuum physics is not easily recovered. Turn that around and employ a micro-level picture of pure waves. How then do you recover familiar billiard ball behavior?

That is easy, it is the decorrelated approximation of mean-field theory for which the Classical Schroedinger Equation is just the simplest example in a family (the next one up is the Hartree-Fock approximation).

What then is the reality? Well, in the alternative picture it is a matter wave in configuration space.

What about measurement theory, you ask? How come we only see fields in 3+1 dimensions not (3+1)N dimensions? How can you possibly shrink a beast in configuration space to a manageable quasi-classical field?

Easy. The very same rule invented by Max Born still works!

If you calculate the one-body density of the matter wave you get the classical level of experience. The mapping from (3+1)N dimensions to (3+1) is trivial and we already know the empirically supported rule.

Once we abandon thinking about particles, then there is no measurement theory at all. There is nothing separate, just a whole. There is no particle being measured by something, and no observer either. You can just junk the lot.

There is only one single wave and a continuum foundation to everything. Since the wave equation does admit eigenfunctions, that wave is quantized. Think of it as Universal Jelly with Natural Modes of Vibration.

Furthermore, the classical limit is merely an idealization. The wave never breaks up into independent particles in the sense that quantum field theory describes. Entanglement is ubiquitous and permanent (eat your qubit socks quantum computing zealots).

Wilder still, if you analyze the causality structure of such a theory it is not determinable.

While the underlying wave evolution may well be deterministic the one-body quantities are not sufficient as initial data. You could know them exactly and still not be able to predict what happens.

There is no need for God to Play Dice. You can have a non-local fully deterministic hidden wave theory. This you cannot do for particles, since local hidden variable theories are excluded!

The epiphany which struck me in Boston was the realization that hidden variable theories are alive, but only when constructed in the wave formulation.

If you insist that the wave describes a point-like particle then you cannot conceive of a hidden variable theory. This is because particles are local entities. Waves, on the other hand, are non-local entities. If you only think of particles you will miss this possibility.

The totality of the wave in configuration space is a non-local hidden variable.

I think it is possible to build a new theory now. However, this journey is not for the faint hearted. Quantum Field Theory simply cannot survive such a revision of physical interpretation in its present form.

QFT is necessarily a theory of particles not waves.

If we do get new physics it will be New Physics. Interpretation changes everything.

Getting the particle back as an idealized concept is easy. That is the Classical Schroedinger Equation.

Sionara QED I. Enter QED II, the sequel with added Gravitation.

The question is what to call this hidden layer of reality we are positing. Since the idea of junking QFT in its entirety is so utterly subversive I favor the term subverse.

To be really perverse, let us call the perceivable layer the PERVERSE and the imperceivable hidden layer the SUBVERSE. As Confucius himself might opine:

Contemplation of perverse perceivables guides us to subversive imperceivables.

We are now on the road to SUBVERSIVE QUANTUM FIELD THEORY (SQFT).

SIAM meetings are a lot of fun.

I’ll be back.

Computational Art & Design

800px-Jaguar_Petascale_Supercomputer
The Petascale future of computing is already here and we are now into the Exascale.

In my own home country of Australia, Business is utterly oblivious to what this means. They simply have no idea. The word clueless springs to mind.

There is a whole new computing revolution building rapidly in the wings. Business is destined to have this Rogue Wave simply break over and crush them. Government is throwing billions at a flagging car industry without realizing that the future of design and manufacture is software. It is sad to watch, but I am not my brother’s keeper. This is why I make my plans exclusive of whatever gigantic mess Australia creates for itself. It is time to avoid poor leadership and seek a more welcoming climate.

Now that I have renewed my contact with the mathematical sciences I have to say I am wildly excited. The single mathematical innovation of the last twenty years which most excites me is the wide application of control theory principles to computational design. This area goes by the rather dry name of PDE-Constrained Optimization:

large-scale-pde-constrained-optimization
Large Scale PDE-Constrained Optimization

Let us try to bring that to life a little…

The term PDE refers to the laws of Physics, Chemistry and Biology expressed in the form of Partial Differential Equations. There have been huge advances, especially in mathematical biology, in bringing those laws into mathematical form. You can think of this as the Laws of Nature freshly canned. Systems which do not presently exist can be modeled fairly well on a computer nowadays. That is a huge deal when it comes to the Lucrative Business of Design. You can now forward simulate a design and predict its behavior. This is Product Design by Computer, a trend now sweeping through the entire global manufacturing supply chain.

In addition to the huge performance boost of the multicore computing age, we now have the practical advance of optimization methods into Computational Design. The phrase Operations Research is the original name given to optimization methods and principles. It began in World War II with mathematicians and physicists assigned to figure out how to improve Allied operations against U-Boats.

That was the first Big Data exercise. Take a bunch of bombing and aiming statistics along with tactical information and work out a better way to strike the enemy. There is huge hype today about the “data” dimension of Big Data, but the truth is that Insight comes from Reductive Analysis. Compress the big data into a Smaller Model.

This fact is the origin of much public confusion over the Scientific Method. The whole reason we use it stems from the ability of Scientific Analysis to literally compress a vast array of seemingly unrelated phenomena into Systematic and Reliable Rules. It is not the data itself which presents the prize. It is the distillation of that to rules.

Sadly, they do not teach this idea in Business School. It is not complicated but many Business Leaders utterly fail to comprehend the power of it.

The PDE is the culmination of that research effort over centuries. For example, via the Navier-Stokes equation we can compute what the airflow over a complex shape looks like. The essential properties required to predict performance of an aircraft wing can be calculated. Experimental data remains valuable to check and refine methods but we can do a lot virtually. This greatly accelerates the design cycle.

Now imagine that you combine forward simulation with backward inference. Through numerical experiments you might figure out that some designs for a wing profile perform much better than others. How might you find the best for a given application?

The naive answer is the right answer.

Do massive trial and error. Use the computer to compute many designs. Through the methods of operations research, in the modern form of Optimal Control Theory, you can then home in on the better designs from among an infinite field of possibilities.

This is the essence of the new revolution in Computer Aided Art & Design.

I say Art also, since the newer methods permit such ideas as Shape Optimization and Computational Aesthetics. Our ability to describe shapes has evolved greatly since the 1940’s and 1950’s through applications of Differential Geometry, the math used by Einstein in his General Relativity. Now we can do dynamics with them!

Now we can turn this Promethean power towards Practical Art, Commerce and the Entertainment industry. It really is the very dawn of a new Golden Age of Mathematical Invention. We can capture the Natural world in equations and then use those as the raw material for a design process. The human possibilities are truly immense.

So far, these approaches have been limited to the so-called hard sciences. However, with the rapidly growing mass of social data the time of Practical Psycho-physics is fast approaching. We are learning to describe basic individual and social decision processes. At the head of this trend is Marketing, but it is wider than that.

People may have thought the Statistician and Economist Francis Ysidro Edgeworth to be an eccentric dreamer when he coined the word: Psycho-physics. However, I now believe that history shall prove otherwise. Edgeworth simply lacked the data. My own personal research into the drivers of Investor Sentiment has convinced me that mass-market behavior has predictable elements.

The Statistical Mechanics of Crowds is coming.

Contrast these advances with that of the financial community at large. Charged with the task of managing precious capital, Banks seem incompetent to do so.

I have personally spent about equal amounts of time in my career in both Science and Finance. I have had two 15 year sentences, served consecutively. Every field of human endeavor has its foibles, but Finance appears unique. All progress in finance seems cyclical, with the same mistakes repeated over and over and over again.

Finance is an area which takes a perverse pride to avoid knowing even something about anything of economic consequence. The general human desire to actually know something about the world is replaced by the charade of convincing people you know something. Sure, there is a lot of talk, but mostly it is a moveable feast of noisy commentary on what just happened.

It seems that the financial community suffers greatly from Scientific & Technological Illiteracy on a truly Grand Scale. Far worse, it is an arrogant ignorance which seems to manifest itself. The claim that not only do people not know anything practical about the real world, but that they are proud of it.

I am no longer surprised that the Global Financial Crisis happened. It is a direct consequence of a giant Cognitive Deficit in systems-level thinking.

The folks involved simply lack the mental preparation to know how to think about complex social systems and their consequences. This mental failing is present on both the upside and the downside. We saw failure on the downside with the GFC. Now let me predict a forthcoming failure on the upside.

The next Crisis will be a Titanic Failure of the Imagination:

Market participants simply do not realize how huge this next revolution will be.

It is for this reason that I chose the path of being both an Investor and Innovator. There is the old adage:

If you want to see the future it is best to make it.

The marriage of Optimal Control with Engineering and Artistic Design on Petascale Compute Clouds will be enormous.

Word Processing, Email and Status Updates are nice to have, but this will quite literally change the world.

The Long and Short of Physics

Physics is a very peculiar subject. When it changes, it does so radically in concept. However, the difference in results is barely perceptible.

Quantum mechanics is close to a hundred years old now. However, the classical theories of point and continuum mechanics are fine for most applications. How can the conceptual structure of a theory be so different and the results so similar?

For instance, under quantum theory we are supposed to believe in wave-particle duality. Bohr introduced the idea of complementarity to support his assertion that things are just too weird down there to understand. However, I wonder if this was just a ruse.

In 1926 there were two contending pathways forward: the continuum wave-mechanics of Schrödinger; and the discrete matrix mechanics and transition theory of Heisenberg. Of course, Dirac was able to demonstrate how they might be viewed as equivalent.

The philosophy of wave-particle duality has potentially obscured an important reality. While the two theories may be mathematically equivalent, due to the Dirac transformation theory, they are not physically equivalent as pictures. They suggest different ideas.

The wave-mechanics of Schrödinger leads the mind in different directions than does the matrix mechanics of Heisenberg. What we think of as natural in one picture can seem unnatural in the other picture.

For example, particle physics conceives of all particles as point-like and subject to creation and destruction via quantum transitions.

That picture is rather unnatural in the Schrödinger scheme of things. The wave equation has no inherent jumpiness to it at all. It is completely deterministic. Moreover, when one thinks this way the usual matrix elements for atomic transitions become rather obvious derivates of classical charge densities. It is a just a small variation on the classical theories of the dielectric due to H.A. Lorentz.

In the Heisenberg scheme, the transition element is just plucked from thin air. It has no obvious connection to the previous theory of classical dielectrics. Indeed, students are mercilessly beaten if they should dare to even suggest such a thought!

The lesson for me in all this can be stated rather briefly.

Suppose Schrödinger and de Broglie were right and we should treat matter waves as real stuff and not probability amplitudes?

Where would that take us? What would become of wave-particle duality? What is logical?

One thing seems very clear to me… There would be no particles.

In this picture, everything is a wave, albeit one which can be dynamically localized. The electron, as a wave, has an extent, and this is determined by the prevailing interactions. These can naturally be of two kinds:

1) mutual interactions

2) self-interactions

In the detailed development of quantum chemistry we can say a lot, in detail, about the first class of interactions. They are entangling, and so ensure that the waves in question must exist in configuration space. In short, entanglement is the normal state of affairs.

However, about the second kind of interaction we do not actually know very much. What we do know is that if you break wave-particle duality in favor of particles then you need to introduce a vacuum, along with particle creation and destruction. This is the basis for Quantum Field Theory and the reason why most particle physicists habitually refer to a wave-function of a single coordinate as a classical field.

Within this way of thinking, it is necessary to turn this classical field into an operator and then speak the language of particles.

Of course, with that goes another problem. One needs to figure out how to obtain finite answers for the electron self-energy and the related vacuum polarization effects. One has also bought into an infinite zero-point energy and a host of other technical difficulties.

On the other had, if we break wave-particle duality in favor of waves things look different. In that case, it is easy to get a finite self-energy term and there is no vacuum, nor any pesky zero-point energy. However, there are still meaningful problems. The main one is to get a stable bound structure for the electron since the static Coulomb field is repulsive. This would seem to involve the need to introduce an auxiliary field.

The purpose of this all too brief survey is to highlight one simple fact. Waves and particles are most definitely not equivalent as ideas for theory construction. When you attempt to build a theory based upon waves in configuration space then many things look different:

1) particles are no longer point-like and must therefore be dynamic entities

2) quantum fields are simply entangled wave-functions in configuration space

3) the reconciliation of mutual-interactions with self-interactions is incompletely understood

It is the last item which presents the major difficulty. Quantum Field Theory does not go over into this new regime in unmodified form. However, there is a new freedom gained to treat certain questions differently. For instance, pair processes and indeed all higher energy resonances, as seen in particle accelerator experiments, would need to be differently interpreted as resonant wave phenomena.

If I had to make a bet for the next hundred years in physics I would take these positions:

Waves: Long
Particles: Short

de Sitter Gravity: Long
String Theory: Short

Schrödinger: Long
Heisenberg: Short

Non-Linear Field Theories: Long
Linear Field Theories: Short

Einstein on Determinism: Long
Bohr on In-determinism: Short

It seems to me that these are all in fact the exact same bet.

When you change a theory, you need to make it self-consistent as well as empirically accurate. Strings go away because the reason for them is gone: the particle is really a wavy quasi-particle. The other bets relate to the physical consistency of real matter waves.

Of course, these are all quoted at very long odds right now.

However, they are my personal bets.

In a world obsessed with the very latest: everything old is new again.

Who’s Afraid of Bourbaki?

nosferatulargeNicolas Bourbaki: A Symphony of Horror

Nicolas Bourbaki is the Evil Genius Who Never Was that Ate the Soul of Mathematics.

Worse, he sucked the blood clean out of the entire subject leaving only a Dessicated Husk to Haunt the Musty Corridors of Academe.

A huge array of contemporary issues in Science Education and the Motivation of Youth to study Science, Technology, Engineering and Mathematics, STEM, subjects can be traced to the influence of this one fictitious person.

How so, you may well ask? How could a fictitious character, in the Mathematical Sciences of all places, lay waste to Society? Well, perhaps I exaggerate some concerning Society at Large, but certainly Bourbaki has damaged the Society of Mathematicians.

This happened over many years starting in 1935 with a founding group of exemplary French Mathematicians. They formed a group and published anonymously under the pseudonym: Nicolas Bourbaki.

The official title for this group is:

Association des collaborateurs de Nicolas Bourbaki

The ambitious purpose was to place all of mathematics on a rigorous foundation.

In the way of these things, the purpose for which the group was founded was preceded by the demonstration of its futility.

While the Bourbaki movement was founded in 1935, the Austrian genius Kurt Gödel had just proved, in 1931, that the pursuit of rigor in Mathematics was ultimately to prove a Chimera. There are true statements, propositions in Math-speak, which are simply undecidable within the axiomatic system.

There is an element to mathematical invention which lays beyond logic.

One can pursue rigorous arguments to support the Towering Edifice of Mathematics but the result is a Tower of Babel. The problem is that there will remain statements within any axiomatic system which are undecidable within it. Such self-referential propositions point outside any axiomatic system and declare it to be logically incomplete.

In the vernacular, logic ain’t everything it is cracked up to be.

I should hasten to add… this does not make Mathematics less useful. In truth, it makes mathematics more interesting since it highlights that which exists beyond logic.

When a real Mathematician creates new Mathematics there is an operation in play which exists beyond mere deductive logic. There is a genuine creative force. The identification of axiomatic systems, especially new axiomatic systems, is a creative exercise Ex Nihilo. You simply cannot derive axioms from axioms.

Unfortunately, the Bourbaki movement took root in Mathematics Departments and spread like wildfire. Coming fast on the heels of the Great Insight of Gödel came a mighty social movement to Make Mathematics Rigorous. It became a veritable Crusade.

The leaders involved comprised a Who’s Who of the French Elite:

Henri Cartan
Claude Chevalley
Andre Weil

Undoubtedly they are counted among the first rank of 20th Century mathematicians.

However, in light of Gödel, the movement was destined to fail from the get go.

Bourbaki produced a huge array of formal material on foundational issues in mathematics. However, it also led to a delusion among mathematicians, and later physicists, that true and correct thought was a rigorous: Definition, Theorem, Proof and Lemma style of mathematical discourse.

The idea was that Mathematics must be Kept Pure of Intuition.

Rigor is Bliss.

Of course, the problem is that Mathematics soon Disappears Up It’s Own Functor and becomes: Arid, Dry, Boring and Irrelevant.

When the express purpose is to eliminate intuition it is no surprise that there a few women in sight. Educators are surprised that few young kids want to study mathematics.

Golly Gee, I wonder why?

This brings me to the reason why Bourbaki was anonymous.

It was a direct reaction to the towering presence of the departed genius Henri Poincaré. This man may rightfully be thought of as: The Last Mathematician with a Personality.

Unlike the dry and dull mathematics of today, Poincaré rightfully stressed the development of mathematical intuition. He believed, as I do also, that the ultimate source of mathematical inspiration comes from the human spirit.

Intuition drives mathematical invention.

Just as Poincaré opined, in his reflective work Science and Hypothesis, I maintain that there is an element of invention in mathematical creativity.

Man does not derive Mathematics, but does something far greater, man invents it.

He or she does so in the manner of all invention. Through observation, introspection, experimentation and inspiration. There is not some algorithm at work that simply enumerates dry propositions from some ultimate source of truth.

Evidently, if you wish to Kill a Great Spirit, the spirit exemplified by Poincaré, then you must do so in a group and anonymously. Thus was the Great Hatchet Team of Nicolas Bourbaki born. They hacked away at the Spirit of Mathematics until it was dead.

Now there is almost nothing left of the great motivating creative force in mathematics.

It is dry, dull and actively shunned by students. It is considered abstract, tedious and impenetrable. All of the interesting mathematics happens outside of Mathematics.

It surfaces in the Computer Science approach to classical dynamics.

It pops up in the Isogeometric Analysis of NURBS-adapted Finite-Element Analysis.

It lurks in the role of Generating Functions in the area of Adiabatic Quantum Computing.

Decoding the above, I will explain the connections:

How do we understand and represent physical law in a world of software algorithms?

How do we pass between the representation and design of artifacts alongside modeling their behavior?

Where do solutions to hard problems come from and is it the programmer who solves the problem or the computer?

There is a huge amount of work to be done in getting mathematics back into shape.

I believe that this Sad and Sorry Carcass can be Re-Animated.

Today I announce the formation of a counter-insurgency group:

Association des agents provocateurs pour éliminer de Nicolas Bourbaki

We have Silver Bullets, Wooden Stakes and Buffy Attitude.

Who’s Afraid of Nicolas Bourbaki?

Rigor leads to Rigor Mortis.

Privateer Science

Pirate_Flag_of_Jack_Rackham.svgJolly Roger of Calico Jack Rackham

The ongoing multicore parallel computing revolution seems to have gone up a gear or two in the last few years. As I have written before, this is the Age of Amdahl’s Law: what matters is the serial bottleneck.

Work comes in two basic kinds: serial and parallel. The first cannot be sped up by adding new resources but the second can.

In my view, this is the least understood of all economic laws and the one with the greatest consequences for business and social innovation.

Hierarchical decision-making structures are replete with bottlenecks. Think of any bureaucracy. To get a form you stand in line. The first line is to get a number, so you can wait. You wait so you can get in line. The second line is to get the form. However, that form is the wrong form so you go back to stand in line. Then you get a number…

You get the picture. In any society that does this habitually very little gets done.

Of course, this problem is not limited to Government. Business suffers greatly from this problem. So too does Academic Research.

Call me a cynic, but my experience of academic research in physics taught me that before you were allowed to discover something you had to get in line.

The first line was about doing stuff that made you an Academic. Usually that process was so long and drawn out that you wound up forgetting what the line was for.

It turns out you could just go right ahead and discover a whole bunch of things right of the bat. However, then you were Not in Line. Get back in line!

This is a perfect example of a serial bottleneck.

However, once you understand the power of Amdhal’s law then things look different.

Here are the game changers:

1) all physics is an algorithm
2) algorithms can be turned into software
3) software can be protected and is valuable

Finally, in this new world of Google Compute Engine you can spin up a cluster for rent. Hence the capital cost barriers to radical innovation in algorithms is low.

So what are the real barriers?

The social bottleneck of Academic “publish-or-perish” screw-you syndrome pretty much ensures nobody with any good idea will get anywhere.

Chalk that up as a good thing.

The negative network economy of Academic Rivalry pretty much stalls all real advances for at least one generation until all opponents have finally died out.

The Academic flotilla may have all the Pomp and Pretty Pennants of the Spanish Main, but they are: Dead in the Water.

So how does one exploit this?

I think the answer is Privateer Science.

Academics are not crash-hot at business.

For decades, they enriched publishers by madly competing to publish in journals that nobody read. Now they are madly competing to pay top dollar to be published in journals that the public can read for free.

Okay, so first barrier down.

You can read what they did for free while they fight each-other for scraps.

What does a modern Privateer do in this circumstance?

Focus on the profitable bottleneck.

In quantum mechanics, that is many-body theory with strongly correlated fields.

I know, I know, every wanna-be genius in Physics will duke it out on quantum computers.

Okay, cool… but where is the market?

The market for strongly correlated fields is Chemistry, Superconducting Electronics, Photovoltaic Devices and Nano-structures among other things.

These are Big markets, here today, and served by existing Multi-Physics software companies with real product.

And it is all about parallel algorithms

That is what any budding Tesla or Edison of today should focus upon. The Big Score.

Work out a better QED that is simpler for strong self-interactions and you are done.

Better yet, if you find one – keep it a secret. Exit the rat-race of Publish-and-Perish.

Raise the Jolly Roger and load those cannons with grape shot…

All is Ripe for Plunder on the High Seas.