I had the pleasure of attending PyData Carolinas 2016 a couple of weeks ago. I learned a lot and also had the opportunity to give a talk. The nice folks at PyData have put the talks up on YouTube.
Page 2 of 2
William Shirer was a foreign correspondent with UPI and CBS stationed in Europe before and during World War II. After the war he wrote The Rise and Fall of the Third Reich which was first published in 1960. As the title suggests, the book covers Hitler’s and the Nazi’s rise to power through their downfall at the end of World War II. It is a brutal and agonizing journey.
Here is Shirer’s closing:
The guns in Europe ceased firing and the bombs ceased dropping at midnight on May 8-9, 1945, and a strange but welcome silence settled over the Continent for the first time since September 1, 1939. In the intervening five years, eight months and seven days millions of men and women had been slaughtered on a hundred battlefields and in a thousand bombed towns, and millions more done to death in the Nazi gas chambers or on the edge of the S.S. Einsatzgruppen pits in Russia and Poland – as the result of Adolf Hitler’s lust for German conquest. A greater part of most of Europe’s ancient cities lay in ruins, and from their rubble, as the weather warmed, there was the stench of the countless unburied dead.
No more would the streets of Germany echo to the jack boot of the goosestepping storm troopers or the lusty yells of the brown-shirted masses or the shouts of the Fuehrer blaring from the loudspeakers.
After twelve years, four months and eight days, an Age of Darkness to all but a multitude of Germans and now ending in a bleak night for them too, the Thousand-Year Reich had come to an end. It had raised, as we have seen, this great nation and this resourceful but so easily misled people to heights of power and conquest they had never before experienced and now it had dissolved with a suddenness and a completeness that had few, if any, parallels in history.
A painful part of our collective history.
To state the obvious, this book is filled with a multitude of characters and I thought it would be interesting to see who plays large rolls and, since the book (for the most part) proceeds chronologically, when the characters come on and off the stage. This led me to parse and analyze the text. I parsed the 1990 edition which is 1,029 pages. Below is a textual analysis of this book.
I parsed and analyzed the text using python and pandas. I used a superset of stop words from here and here. The graphs are in plotly. And the word clouds were made using Andreas Mueller’s generator. All of the code is in github.
Some basics about the text:
- Number of words: 571,387
- Number of words (sans stop words): 244,881
- Number of unique words: 22,748
- Number of unique words (sans stop words): 22,266
I remember listening to a talk by Martin Fowler (although it could have been Kent Beck) recently where he mentions the Facebook poster that says “Nothing at Facebook is somebody else’s problem.” It’s posted all around the company. He tells an anecdote about the Facebook mobile app and how the entire company uses the beta app so as to find all of the bugs before it goes to the masses. If one was ever to say (and occasionally a newbie does) “this beta is painful to use… I am going to go download the legit release from the AppStore” then the FB culture shines through. “No, you most certainly will not. You will use the beta like everyone else, so that our customers see as few bugs as possible. If you are frustrated by a bug, then fix it.”
Too often within an organization there is a tendency to lay the blame for the problem at the feet of others. This tendency can fester and begin to seep into the culture. Rather than being one team with one goal the organization becomes snipping factions.
From The Rise and Fall of the Third Reich, a great quote from Winston Churchill. This was June 1940 right after the evacuation of Dunkirk.
Even though large tracts of Europe and many old and famous States have fallen or may fall into the grip of the Gestapo and all the odious apparatus of Nazi rule, we shall not flag or fail. We shall go on to the end, we shall fight in France, we shall fight in the seas and oceans, we shall fight with growing confidence and growing strength in the air, we shall defend our island, whatever the cost may be, we shall fight on the beaches, we shall fight on the landing grounds, we shall fight in the fields and in the streets, we shall fight in the hills; we shall never surrender, and even if, which I do not for a moment believe, this island or a large part of it were subjugated and starving then our Empire beyond the seas, armed and guarded by the British Fleet, would carry on the struggle, until, in God’s good time, the New World, with all its power and might, steps forth to the rescue and the liberation of the Old. (June 4, 1940)
Picking up with the author’s (William L. Shirer) commentary:
Why should Great Britain fight on alone against helpless odds? Especially when it could get a peace that would leave it, unlike France, Poland and all the other defeated lands, unscathed, intact and free? This was a question asked everywhere except in Downing Street, where, as Churchill later revealed, it was never even discussed, because the answer was taken for granted.
Let us therefore brace ourselves to our duties, and so bear ourselves that, if the British Empire and its Commonwealth last for a thousand years, men will say; “This was their finest hour.” – Churchill (June 18, 1940)
TIL, flak comes from the german “fliegerabwehrkanonen” meaning anti-aircraft gun (really aircraft defense cannons).
This is very much a work in progress, but I am process of working through the exercises in Data Smart using python in an IPython notebook.
Data Smart is a data science book written by John Forman (of MailChimp). The book is very hands-on, with lots of exercises / examples. John wanted it to be a “code free” book (at least for the first few chapters), so he uses Excel as the primary data tool. I thought it would be a helpful learning exercise to work the problems in the book with python.
It lives here: Data Smart Sans Excel Notebook
