User login

Navigation

You are here

What is "randomness"?

Does the word "randomness" have antonym? If yes, what is it? Why? What view of randomness does that imply?

The notion of randomness is, of course, basic to both statistical mechanics (or kinetic theory) and quantum mechanics. But these are not the only fields where it is relevant. The notion also appears virtually in any field where probabilities are used. For example, we speak of random loads and vibrations (in structures and machine design), random noise (say, in acoustics), etc. But what does the term "randomness" really mean? Any idea? What would you say? Here, I am here looking for brain storming, so half-baked ideas, side comments, etc. etc. are welcome.

I have asked the above question just in order to get going, that's all! You are welcome to answer it as well as ask other relevant questions too! Thanks in advance!!

Henry Tan's picture

A computer cannot really generate random number.

It calculates it!

Henry Tan's picture

I also believe that there is no pure randomness in the world.

Like Albert Einstein once said, "God does not place dice with the universe."
He never could accept the randomness of quantum theory.

Thanks, Henry!

Some more questions... Some, subsequent to your thoughts, others, not so...

-- If nature does not have pure randomness, how about things like fluctuating wind loads?

-- If nature does not have pure randomness, does it carry degrees (or quantitative levels) of randomness?

If yes, can you cite two simple examples from nature which display differing degrees of randomness?

Here, I must say I am hard-pressed to find any suitable examples. All I can find are systems that *seem* to be either overwhelmingly random or not at all so. For example, time intervals between Geiger counters, speeds of gas atoms, etc. all seem purely random, and planet motions, time-intervals in the "ticks" of atomic clocks, etc. seem to be not at all random. Nothing in between the two extremes.

So, nature does not seem to carry any intermediate degress of randomness. How does this fit in with the other statements about randomness?

-- If wind loads (to continue with the example) is not purely random, what quality apart from randomness does it possess?

-- If it is *not* possible to think of an antonym for randomness, is it possible to think of a *contrast* to it? If yes, what is it?

-- Would you consider "deterministic" as the antonym to randomness? As contrast?

Amit Acharya's picture

Ajit,

My feeling on the emergence of random behavior is the following:

Take a deterministic system (say autonomous ODE). Take some time-averages of variables of this system as the variables one montiors at the level of observation.  It is quite possible that the evolution of this set of observables from a particular state for this set is not completely defined by the current state of this 'coarse' set. Consequently, evolution of the coarse set seems stochastic if only knowledge of a fixed set of coarse variables is assumed to be accessible.

 

- Amit

Hi Amit,

Thanks for your comments.

Let me first re-express your idea again in my words (and please feel free to correct me if I am going wrong). OK. According to you: The system is deterministic at the finer levels. But what one measures or monitors are certain coarse variables, say, time averages. These coarse variables are such that they cannot completely define the evolution of the system, at least not from a given particular state onwards. Therefore, at the coarse level, the system behavior seems random even if it actually is not.

So, probabilistic nature arises because: (i) the system parameters are incomplete to describe the system evolution, and (ii) those parameters which would have been complete, work at so fine a level that they are not measured.

That's a pretty nice way to put it, though, flippantly, one may might add: string theorists should be happy that someone outside of their group thinks just the way they do. :)

But, seriously speaking, questions remain--for string theorists and for your above proposal. Here are two:

(i) How do you know that the system is deterministic at the finer level in the first place?

(ii) Our usual experience is that averages are more predictable than the finer parameters. Take two examples. One, consider the so-called technical analysis of stock markets--the actual movements in stock prices and their moving averages. The moving averages can be made out at least to some extent, i.e., they are more predictable than the original stock price movements. Two, consider the kinetic theory (or any other theory involving atoms/particles). The speeds of gas molecules (finer level) are random but quantities like pressure (coarser level) are not. The latter predictably follow simple equations like PV = nRT.

In both these cases (and many similar cases), averages and other coarse measures are more predictable than the original and finer parameters. But, here, you seem to suggest the opposite. How come? Can you supply an example of the kind of system you suggest?

(BTW, on a personal note, I got busy with some PhD related formalities, so couldn't come back earlier. Sorry for the delay in reply and hope to keep better time from now on...)

Amit Acharya's picture

(i) How do you know that the system is deterministic at the finer level in the first place?

 No, I don't. But the emergence of apparently stochastic behavior from underlying determinism is one way in which randomness appears.

 

ii) Our usual experience is that averages are more predictable than the finer parameters.

 

I agree

 

Take two examples. One, consider the so-called technical analysis of stock markets--the actual movements in stock prices and their moving averages. The moving averages can be made out at least to some extent, i.e., they are more predictable than the original stock price movements.

 This is correct. However, just because you choose some particular average(s), its time-evolution may not be determined simply by knowing its value at any given time. A lot of degrees of freedom of the fine dynamics have been condensed out and they have some effect on the coarse average. So may be for a completely deterministic coarse evolution you need a few more variables, perhpas delays (memory variables) of the original coarse variable itself.

Two, consider the kinetic theory (or any other theory involving atoms/particles). The speeds of gas molecules (finer level) are random

 I don't understand - take deterministic MD for example. The fine dofs evolve by completely deterministic laws

 In both these cases (and many similar cases), averages and other coarse measures are more predictable than the original and finer parameters.

 But more predictable does not mean determinsitic. Take the MD case: the fine system can be posed completely deterministically (the fact that its solutions can demonstrate qualitative behavior sometimes indistinguishable from those of random systems due to extreme instability is a separate matter); however if you just chose a few very long, but finite, averages there is no reason why these should evolve deterministically.

But, here, you seem to suggest the opposite. How come? Can you supply an example of the kind of system you suggest?

I don't think your definition of randomness in the fine system is the same as mine.  To see a somewhat more precise discussion fo what I am talking about, you can check out a post I made to imechanica some time ago on avergaing nonlinear dynamics, if you are interested.

As for an example: If you are familiar with macroscopic plasticity theory or any theory with internal variables, consider the situation where you drop one of the state variables from the original list. In the state-space of the remaining state variables, the evolution of the system will seem stochastic.

Alternatively try monitoring viscoleastic response by only monitoring the deformation gradient or strain at the current time. Clearly the mechanical response out of  a state with the same strain depends upon the strain rate, and if the latter does not figure in the list of coarse variables, the response will seem random in that the same value of strain will correspond to different values of stress.

 I should reiterate that even at the coarse level, a completely deterministic system may show qualitative behavior in solutions characteristic of solutions of stochastic systems.

- Amit

 

Hello Amit,

I appreciate the following points made by you:

(i) The finer -> coarse model is just that: a *model*, i.e. just a possible way to show how apparent stochastic behavior might come about from a deterministic system
(ii) Characterizing system evolution in terms of averages won't necessarily be deterministic. (You really caught me here!!)

About MD: I do not have any background on MD except for what an engineer might gather by browsing general articles such as those on Wikipedia and so on. From your writing, I gather that MD procedures involve dynamic instabilities (or deterministic chaos). Is that so?

About definition of randomness--yours and mine: Frankly, I am not sure if I have *one* definition of randomness. For that matter, I am not even sure if I have *any* definition of this term. In fact, that's precisely the reason why I began this thread! If you have a definition (or any concise description) for this term, what would it be?

I had already flipped through your paper of the title "On the choice of coarse variables for dynamics" when that post of yours first appeared. Today, I once again went through it, though I am afraid I cannot understand much of it. For instance, I have no knowledge of the invariant manifold theory (or any other topic from topology). After reading your post and paper, what I gather is just a vague point that if you are going to drop *some* information in going from the finer to the coarser scale, then, even if you begin with a deterministic system, the end result is going to carry wild fluctuations characteristic of stochasticity, and there are some interesting mathematical properties about how this happens. Now, this is too general an "understanding" to be useful in science or engineering!!

I also think that for the purposes of this thread, perhaps a very simple mathematical model (say, something like the simplest logistic map) might be more than sufficient. After all, the main question I am here concerned about is not one kind of dynamical evolution against another but just the basic notion of randomness: its meaning, including the question of whether the term at all carries any meaning or not, and if yes, in what way that meaning could be delineated.... I am also posting a few more questions in this direction right in this thread; please have a look at them too....

Overall, though, let me again say that I have very much appreciated your interest. Thanks!

Amit Acharya's picture

Hi Ajit,

Response to some of your comments:

AJ - (ii) Characterizing system evolution in terms of averages won't necessarily be deterministic. (You really caught me here!!)

 This is if one fixes the set of coarse variables a-priori. If, however, one is prepared to augment this set (according to well-defined procedures in dynamical systems theory) then such apparent randomness can be expected to be removed.

AJ - From your writing, I gather that MD procedures involve dynamic instabilities (or deterministic chaos). Is that so?

 Well the nature of randomness in trajectories of deterministic MD systems is the fact that almost all trajectories visit all neighborhoods of the energy surface. Some neighborhoods are visited with higher probability density, but nevertheless all possible states consistent with constant energy are visited arbitrarily closely.

Generally, it is perhaps OK to say that a nonlinear Hamiltonian systems with many degrees of freedom exhibits unstable behavior - there are, of course, many particular examples that are well understood. But we should have some experts weigh in on this.

AJ - About definition of randomness--yours and mine: Frankly, I am not sure if I have *one* definition of randomness. For that matter, I am not even sure if I have *any* definition of this term. In fact, that's precisely the reason why I began this thread! If you have a definition (or any concise description) for this term, what would it be?

My simpleminded operational definition would be this: Generally we expect evolution to be state-dependent. This requires a definition of state. Let's say one has chosen a set of observables whose values at any given time collectively form the state at that time. If for the same state, one sees two or more possible evolution of the state, then I would call this random behavior, in the context I am talking about here.

AJ - After reading your post and paper, what I gather is just a vague point that if you are going to drop *some* information in going from the finer to the coarser scale, then, even if you begin with a deterministic system, the end result is going to carry wild fluctuations characteristic of stochasticity, and there are some interesting mathematical properties about how this happens. Now, this is too general an "understanding" to be useful in science or engineering!!

I don't know if your comment on 'generality' refers to what you understood or about the methodology I propose.

The whole point of my paper is not about randomness in coarse behavior. It is about realizing practically (e.g. algoritmically) how one can systematically make a good choice of a coarse set of variables in terms of which apparent randomness can be avoided and a determinstic theory for coarse response can be posed.

On the latter part (i.e. once a choice of coarse variables has been posed, how to develop the coarse model), my students and I have solved small but hard nonlinear problems - and, by the way, these are problems from science and engineering! If interested see the attached papers.

But the choice of an optimal set of coarse variables is not resolved in these papers and the latest one is an effort to deal with that issue. With my students we have also tried these ideas out on model systems (e.g. Lorenz) with success, so it seems like the ideas will be useful for science and engineering.

AJ: I also think that for the purposes of this thread, perhaps a very simple mathematical model (say, something like the simplest logistic map) might be more than sufficient.

If you are interested, look att he discussion surrounding Fig. 1 in the '...Some examples' paper. If one settled on the x, z variables as the coarse set, then in this state space coarse response seems random at the point of self intersection of the projected Lorenz trajectory, which of course is a completely deterministic system.

Now that I am finished, I realize I do not know how to attach files to a reply. So I just put in a new blog entry.

Hello Amit,

AA: I don't know if your comment on 'generality' refers to what you understood or about the methodology I propose.

--> AJ: In case you really couldn't get it by the context: My comment refers to what I understood by browsing through your post and papers.

Now, if nonlinear dynamical systems theory is an area of your knowlede or expertise, I would like to know if you would want to address questions like the question (2.a) in my further post dated 24th April (see below).

----

AA: The whole point of my paper is not about randomness in coarse behavior.

--> AJ: The core point of this thread is the term "randomness"--its meaning and so on...

Amit Acharya's picture

AJ: The core point of this thread is the term "randomness"--its meaning and so on...

In your first post for the forum, I believe you had said you were interested in side comments, brain storming, so I thought providing *a* point of view that relates to some manifestations of randomness wouldn't be a bad idea.

But thanks for your clarification - Iwill know to stay away.

A "side" is not a floating abstraction--it's a side of something. That something, here, is randomness.

Inasmuch as your comments pertained to randomness, they were, and still are, welcome.

Once the discussion started veering towards the details of your particular research but away from randomness, even that was OK, up to an extent. (One cannot expect people to think disconnectedly.) But when you started asking me to identify whether I understood this or that part of *that* research of yours or not, whether that methodology was understandable or not... things of that nature... I thought it was high time to keep the matters straight and to tell what this thread was all about--even if it was a Carnegie Mellon faculty member in question.

Am I happy about this turn of events? Of course not.

Further, I must add that I feel sure you wouldn't quite behave this way if both you and I were not Indians. In my experience, typically, Indians reserve their most polite interactions for others--especially (but not at all exclusively), for white Americans.

But yes, when it becomes necessary, one has to take a firm stand. I did. But it's not a matter of any further importance the way I see it. So, even if I am not happy about it, this matter is of the sort I guess I could forget within a day or two.

I close this discussion with the observation that even while publicly rueing about staying away, you *still* did *not* address the pertinent (and even "mathematical" (LOL!)) issue of dynamical systems mentioned in my point 2.1. Is this kind of communication typical of all Carnegie Mellon faculty members? (I have been wondering if my PhD research would stand a chance to get any funding in the USA. CMU being a "private" sector school, one thinks a little more.)

As to whether the point 2.1 was relevant to this thread in the first place or not, I prefer to submit this entire matter to the scrutiny of a future engineer who might read it with a fresh mind--an engineer who comes years, perhaps decades and centuries later--a future Ajit R. Jadhav, if someone must put it that way out of whatever sort of motivation he has.

Though this correspondence could have been better, I mean it genuinely when I say thanks for your participation anyways. And, yes, goodbye!

If it means saying goodbye to the whole of US researchers community, or the whole world science and engineering community, I couldn't care less.... As I said, in the absence of any proper feedback, I must regard my openly expressed thoughts as addressed to a future engineer with a fresh mind, perhaps decades and centuries later--a John Galt, so to speak (if you have read Ayn Rand's fiction)....

In the meanwhile, I brace myself for idiotic comments to percolate through Yahoo, msnbc.com, Times of India and other media in the days and weeks to come--though, given the sum totality of my knowledge, I can't expect *that* to be there decades centuries later. Metaphysically, it can't last that long, though probably I will have to face it as long as I live. (The last two paras are mostly for others, Dr. Amit Acharya!)

Here are some more things that occurred to me over the past few days.

(1) Consider the fact that there are no random numbers--there are only random sequences. If so, is "randomness" a property of a collection? Sub-questions follow:

(1.a) Any finite sequence of numbers can be plotted as a graph of points in the X-Y plane. For any such a set of points, it's always possible to find an algebraic polynomial which passes through everyone of them. In other words, there is that equation which *predicts* that sequence of numbers. So, no finite sequence can be random. Is this conclusion true or false? How about the argument itself--is it logically sound?

(1.b) Hence, does true randomness require a sequence of infinitely many points? (Here, note, a finite line segment carries infinitely many points too.)

(2) Have a look at this great introduction to the topic of "chaos" by David Harrison: Chaos. Also see a related (low bandwidth) animation hosted on the same site: Animation of 3 body problem These Web pages are accessible to undergraduates. (That is the major reason why the site appealed to me!) The following questions are specifically based on the contents of the above two Web pages:

(2.a) The animation shows how the green and red trajectories soon enough begin to diverge greatly even if their horizontal speed initially differs only by 1 %. Such a divergence is often put forth as a possible model for how randomness might come about via a deterministic evolution.

But it is just as well possible to reverse trace the trajectories. In this case, you start from the two divergent points and proceed to come converge!

The question is: If, in this model, I pick the two points arbitrarily, will their trajectories always come very close to each other sooner or later? If not, why not?

(2.b) Is the "non-repeatability" mentioned in the first Web page (near the graph of the rabbit population at L equal to 0.0000395) the same as "randomness"?

Thanks in advance for letting me know your thoughts, comments, opinions, etc.!

Often times, chaos theorists (and many others too) claim that randomness is universal. Keeping aside for a moment the philosophical questions such as how (and whether) randomness is (im)possible, what is the meaning of the term, etc., here are a few practical questions pertaining to technology:

Why can't we have a chip that has circuits especially built to produce "randomness"? Something like an electronic version of the lottery apparatus they show on TV. The lottery apparatus relies on the fluid dynamical instabilities, but this one should rely on the classical circuit instabilities. Come to think of it, if an off-tune TV (or radio) shows (or emits) noise so easily, what prevents us from designing and building a "random chip"? If mass-produced, it could get as inexpensive as under a dollar or so!

There are many efficient algorithms that could use a fast random generator. Why not produce it in hardware--and directly?

A question: What would be the estimated frequency at which one could read off the next random number from the registers of such a chip? Does anyone know any principle that sets the upper limit? In other words, shouldn't a randomn number generator of this kind have an "incubation" period before the next random number can be reliably produced by it, and if yes, how short could such a period get?

If this post doesn't generate any thoughts--on randomness, I would better stop blogging here at least for the time being. Seems like this forum is better suited to those people who should have graduated in analytical mathematics but turned out to be "engineers"--oops, "mechanicians"...

Hi Amit,

I am studying nonlinear dynamics and MD.  You mentioned about deterministic MD, that the fine dofs evolve by completely deterministic laws. 

Consider a very simple MD program. Is it true that there's randomness in MD simulations that is due to, say, the bootstrapping of the simulation using random number generators (initialization of the initial velocities of the molecules)? What I mean is that perhaps the evolution of the dynamics is sensitive to the initial conditions such that the subsequent molecule trajectories may not be predictable? If your initial conditions are always the same, wouldn't you just compute the same answer every time you run the simulation? Perhaps my view is rather simplistic. 

You mentioned that the randomness in trajectories of deterministic MD systems is the fact that almost all trajectories visit all neighborhoods of the energy surface. Is the randomness of the MD simulation due to bootstrapping related to this reason?

 Thank you in advance.

Keng-Wit Lim

 

How random are "natural" events like IP address allocation when the dial-up Internet service provider is an entity like Tata Indicom?

I plan to list here the recent few IP addresses: 126, 45, 22...

I plan to expand this entry later on...

Ajit

Subscribe to Comments for "What is "randomness"?"

Recent comments

More comments

Syndicate

Subscribe to Syndicate
Error | iMechanica

Error

The website encountered an unexpected error. Please try again later.