God does not play dice with the Universe
This is an oft quoted statement which was originally in Deutsch (but of course):
Jedenfalls bin ich überzeugt, dass _der_ nicht würfelt.
[At any rate, I am convinced that _He_ [God] does not play dice.]
---Einstein, Letter to Max Born, 4 December 1926 in _Einstein und Born Briefwechsel_ (1969) p. 130
In the context of the letter, it is thought better to translate it is:
God may be subtle, but He is not malicious.
Einstein's photoelectric effect which won him the Noble prize was one of the cornerstones of the foundations of Quantum Mechanics. However, Einstein did not like the probabilistic interpretation of QM (uncertainty principle).
For that he (and Boris Podolsky and Nathan Rosen) gave the world the EPR paradox which, as a quirk of fate, allowed Bell and Aspect to in fact prove that our universe is indeed run by probabilities (or quantum entanglement or stuff like that) and that Einstein was in fact wrong.
Einstein struggled through the second half of his life to eliminate the uncertainty from QM but never could.
Theists often use his statement to underline his belief in God. However, Einstein was an atheist and the use of the word God was only in a proverbial sense:
"It was, of course, a lie what you read about my religious convictions, a lie which is being systematically repeated. I do not believe in a personal God and I have never denied this but have expressed it clearly. If something is in me which can be called religious then it is the unbounded admiration for the structure of the world so far as our science can reveal it."
-Albert Einstein in Albert Einstein: The Human Side, edited by Helen Dukas (Einstein's secretary) and Banesh Hoffman, and published by Princeton University Press
It is unfortunate that statements made by great minds are quoted out of context and used by people for their own purposes.
Also, many of the great minds were great when the bodies that held those minds were young. But age and beliefs catch up, and the statement that Einstein made reflects more his beliefs about how the universe runs than how science believes it does. So, even if it comes from one of the greatest minds from the last century, it is something that most rational, scientific minds reject.
The following applies to many of our personal and day-to-day situations too.
Try to understand the context in which statements are made, as also the mental make of the person making it when it is made